There also might not be a lot of clearance between your left heel and the clamp for the trailer depending on your bike size, geom, mount etc...at least I remember having this issue once.

Also make sure it's attached! While this may sound obvious I did have my trailer come loose on a steep descent.