It looks too small. If you can't get a bigger frame, go for a longer stem and a higher seatpost. Since you have longer arms for that frame, I suggest keeping the pursuit bars.

And yeah, those pants might not be the best for 35+ mile rides. Once I made the switch from riding with jeans to riding in comfortable shorts for long rides, my riding was a lot more enjoyable. But, you know. That's not what this thread is about.

The picture of your leg extension shows that you could use a an inch or two of seat height. A 53 would be much better though. But what ever is more comfortable.