I'd also say the shifters is where you'll FEEL the biggest difference between 105 and Ultegra. Shifters, Rear der., Cassette, Cranks. Just My $0.02.
That's the order i did my Force --> Red Upgrade.
Front der. I did last [unless you count saving up for the Zero-G brakes].