How many people ride perfectly straight, without any side to side drifting?

I assume that cyclist riding in a pace line need to ride a straight line, with little or no drifting. So I've been working or focusing on my technique; spinning tight circles, balancing push-pull (or right vs left leg), staying centered, well balanced, keeping upper body quiet. And spending more time riding the single speed. I've also dialed in bike fit and believe it's pretty close, but that's only my opinion.

The problem is, I still feel I move to much and don't hold a line very well. Naturally, this has me wondering what is normal, how do other people ride. Guess I'm just trying to improve my efficiency on the bike without knowing what's realistic.