The only real downside I've found is that running injuries tend to keep me off the bike for a while too (still recovering from rolling an ankle, though I was able to start riding two days after the injury).