If you really want protection get one of the new ice hockey helmets with gel padding etc, made for multiple impacts and to stop concussions. The bike companies haven't caught up on that yet. I'd wear my CCM if I didn't wear a visor on it.

I ditched my cheap road helmet for a Dave Mirra BMX number and it's much more protective. I always ride with a cap on underneath and that helps anything fit well.