Honestly, you likely won't know the difference once on the bike. The jump from 105 to Ultegra is minimal. If the Ultegra bike has better wheels or kit, then the $ may be worth it. Apples to apples, the 105 is the way to go.
I have Ultegra on my cross bike and it works perfectly. I'm also running a XT midcage r/d.