There is a graphic
here that shows Continental's view of the difference in material between the two tires - less rolling resistance, more grip, some loss in longevity.
I've never used the Ultrasports but that graphic rings true in my use of two sets of GP5000s. Feel faster, I like the grip. I'm getting slightly less mileage than I did on previous Contintental tires (can't remember the type).
I hate changing flats on the road. The first set of GP5000s each tire got a wire shard flat towards the end of their life (as measured by the wear indicator dimple on the GP5000s) - both were "polite" leak-type flats where I didn't even notice on the ride, found out before the next ride. The rollingresistance.com test of the GP5000s said they were less flat-resistant than the GP4000s.
My bottom line - the speed and grip were worth a bit of premium and the GP5000s are on sale just about every week anyway. When it is time to replace, I may go back to Schwalbe tires I've used and aren't cheap and go on sale less often - but are indestructible - see if I really notice any speed difference.