Lots of good suggestions here. I find wheels to be a big factor. Make sure they're true, tensioned, and if necessary, hubs have been serviced.

One other thing, you may be feeling more due to your aluminum frame. Have you considered a steel frame?

https://www.missionbicycle.com/blog/...el-vs-aluminum