Have you played any sports since becoming an adult? I get the crap kicked out of me, way harder and more often playing goalie on an adult soccer team than falling off a bicycle.
Don't even worry about it. If you go down, brush yourself off and get back on. I've had four crashes in just over five years; three of those were braking and/or turning on wet pavement.