Yep.

Personally, I can get by on a single clif bar for a 50 mile ride and typically, I'll only eat something on a ride like that if I'm riding during my normal lunch or dinner hours. I usually go about 35 miles on Mondays and Wednesdays with nothing more than water but maybe that's something you have to acclimate yourself to over time.

For you - I'd eat a nice breakfast (more than a half banana! assuming a morning ride) and then eat something half way through your ride, whether it's 25 or 50 miles. Save those gels for when you really need one. Another factor is heat and humidity, particularly early in the year when you're not accustomed to it. Stay hydrated all week long for best results.