In general, I would say no. If you're eating your normal diet and normal timing, then I would say you're probably good. If you have a sensitive stomach and have a big Vindaloo lunch, you might have digestion issues, but that's a special case.
Now, can your diet have an overall positive or negative effect on your riding? You bet.