Doable, but depending on the specifics, you've got the very real chance of having to waste time dealing with broken stuff, the inconvenience, and then you get into the whole quantifying the enjoyable tactile experience.
Sure, as a real foodee or someone who loves to cook, you can use a crappy knife or peeler or whatever, a musician can play a crappy instrument, etc etc but will you enjoy it if you are aware of said crappy item?
Up to you in the end.
but within reason, a cheap bike can be ok.....just depends on the bike.