Out of curiosity, B.J., where in town did you get such a response? I've never had any issues on the handful of times I've towed a trailer in the Briargate area. I think you already answered your question in your first post - short of team kit, most people don't know how to tell casual cycling attire from regular street attire, so when you pull a trailer you're just asking to be misidentified, particularly if you're near downtown (and doubly so if near Fountain Creek south of downtown).