I'm 35 and this is my second year of riding. I have been in 5 cat 5 races so far and have had a good time.
I should be pretty competitive next year with my winter training regiment. If you are not too nervous riding close to people-give it a try!