Yes you should eat them back if your goal is maintaining weight. As already stated, your calculations may or may not be a little high.
I eat most of mine back before/during the ride if it's a social type ride. If it's a spirited 30 mile ride and I'm trying to ride quickly I'll do gatorade and maybe a PB&J sandwich. Then just eat a good meal after riding.