I don't actually believe that the bike will move at all without force on the pedals or other impedance on the rear wheel, except maybe a bit from the slight momentum of the cranks if the flex is just right to spin them. Which would disprove the "spring returns everything" theory.

But that's the problem with thought experiments - they aren't real unless someone actually does it.