Hey maybe the guy's just an introvert
Some people ride to get away from everyone and avoid contact with people for that one hour of the day.

You did the right thing so I wouldn't think twice about it.

jeff