I used to ride frames conmsidered way too large for me. I'm 6'1" and rode 63 CM frames. Never had a problem. Thought I'd try out the smaller stuff. Bad idea. I'm far more comfortable on the larger frame and the next bike will be a 61-63CM.
Just my experience YMMV.