Isn't sora only 7 speed or something? I'm wondering if that's why it sometimes 'seems' to have better shifting.

The biggest drawback is that it'll break sooner. You'll just end up buying 3 sora shifters rather than 1 ultegra (i'm just making up numbers, I don't know the real life-spans, but someone on here had numbers at one time).