You need to eat before you are hungry and drink before you are thirsty in order to keep your body fueled. Running your nutritional stores down to zero before you refuel will not make your body happy.

I've only hit the wall once and that was enough. I make sure to eat and drink at regular intervals when I ride now.