From the Trans-Siberian Handbook (Bryn Thomas):

"Itīs possible to rent bicycles in Ulan Bator too. Try Bike Mongolia or Suren. Note that Mongolian dogs like nothing better than to chase foreigners on bicycles."