One thing to keep in mind is that Rapha sizing does not correspond to typical US sizing. Usually their medium is a US large. This is especially true with their casual gear: my fixed shirt is tight though I went one size up and got a large!
Once you get the right size it is usually really good quality though.