The 105s will suit you fine. Ultegra to 105 is like XT to LX/SLX. Better, but not enough to slow you down.
Once you save up some more dough, you'll probably want to upgrade something other than the drivetrain components (wheelset maybe) or buy more gear.