It's probably not the frame itself. I'd guess that it's either your form, the front wheel, or a combination of the two. It's possible that you're pulling on the bars very hard in the hard effort; it's also possible that you have a bit too much weight on the front end and aren't riding smoothly. It's possible that the wheel isn't stiff enough, but I'd imagine that would matter most on steep tracks. What track is it?