I regret not buying a cheap bike from leboncoin.fr when I was there, it seemed that you could spend 50 to 60 euro for a decent beater. Cheaper than renting and the city is so accessible by bike that there are really no limits to where you can go.

Have fun!