It's up to where you are and what the locals are like. Our local 50+ fields have at least 1 or 2 past Olympians and pros in them. That said they are so immensely safer than the crash 3's. 3's are so full of younger riders that finally have a little speed but absolutely no finesse or ability to use it intelligently.
In other words at this point are you happier putting it all onthe line every race with kids that don't necessarily have to go to work on Monday or possibly getting dropped when the attacks dial up in in a field of people who are really smooth with their lines and braking, etc.