I think you could make the small work pretty easily, given your inseam. I'm slightly shorter than you with a similar inseam and I ride a 52. It's all in the proportions. A longer setback seat post and a longer stem would probably be all you need. I wouldn't get the large. It's easier to make a small frame fit larger than the other way around.