no one's forcing you to take cycling seriously. you can race cat 4 while taking a pretty casual approach to racing and riding. the difference as compared to most adult level amateur sports is that there is an established upgrade ladder from beginner to pro even for adults so people tend to take it more seriously, but you don't have to.