I don't know if the core muscles really do that much for cycling?

I think squats (I do barbell ones) do more for your core muscles than all the situps and planks.

Renegade rows are a good core exercise too, and probably help with cycling because they'll strengthen your shoulders and upper back, both of which play a role in holding you upright in position.