You know what amazes me? I watch TV laying on my side, so that the picture is perpendicular with my natural line of sight. But the images appear straight up to me. There must be a good amount of brain processing going on to make that seem normal.
I just tried crossing my arms and pretending to steer a bike, as dsbrantjr suggested. Wow! I couldn't do it!