Of course there's no reason to ride hands-off. That's the point.
Problem is that a bike should be balanced well enough that there's no lean or tendency to veer; certainly there's no sign of bias when I ride hands-on, which is why I'm wondering whether something else might be going on.