Harder the better : no
Need to invest more for more fitness : no

The price you'll pay will change speed and comfort, but you can push yourself as hard as you want on an 800$ road bike.

But you said it yourself, it's a lot more fun going through wind in the drops at 25kph than it is to strugle through it at 10kph on your slow MTN bike! The effort is the same though!