You seem to be running continental slicks which is amongst the best when it comes to rolling resistance.

From where you are now, I doubt a carbon fork would do much, yes, it will shave few 100g but the thing that slow you down the most is "you". With flat bars, you create loads of drag (air resistance). If you want to be faster, you better spend the money on tucking in stuff like drop bars for better aero. Then once that's done, go for lighter aero wheel that will spin faster easier.
once Drap and Dynamic weight is dealt with you can move to static weight.

Static weight affect mostly climbing a low speed.