I cant see it causing any more damage than riding on the road.
Did you check to make sure the wheel is aligned properly, and not rubbing the chainstay when you get on the bike?