It depends on how much fitness you had before you stopped for 2 weeks... When I used to run, 2 weeks off pretty much hit the reset button for me. I've never enjoyed running... at all. With cycling, it's not as bad.
I had ankle surgery last summer and was off my bike for 2 or 3 months and it took a long time to get back to where I was. My motivation also suffers unless I'm consistent.
I'd say don't let it worry you and keep after it and you should be fine in a few weeks.