Mindset sounds like the key issue here so just relax and focus on the road ahead because if you start swerving then that will make the motorist behind you nervous as well and delay their passing you safely. There's usually a white line at the right side of the road so keep the wheels on them, this will help but if there isn't one then focus on keeping the wheel going in a straight path along the road.