What is a trail and what the rules are likely vary by municipality. You might want to check yours. Pass left ****** is probably a good reminder when people do that.
Where I live pedestrians have the right of way on paved trails and they're really not meant for the jack*** with a $10k triathlon bike with 5% bodyfat doing 40MPH. That said, it's not like most cities are going to police those things very much.