Had a scary wobble at 45+ MPH, it was caused by a fork that was not rigid enough. Replaced the fork with a new carbon one from a different manufacturer and no issues.

OP get your wheels trued and maybe some new rubber. Those would be cheap first steps.