I do that. No breakfast, no fuel until an hour or more into the ride on some of my non-race weekend rides.
The caveats are that you're going to be flatter during those "full gas" moments if you're on a group ride, you need to keep quick refuel food on hand because you can get pretty far down bonk road pretty quickly (not a good idea), and you need to be really on top of refueling post-ride.
There's some anecdotal info out there but no published studies that I know of. I trend more towards seeing if things work for me in any case, people respond differently to different training stress, even within their own training cycles.