Proper recovery will make you faster.

Intervals tear down your muscles, literally ripping individual muscle cells apart, recovery allows them to heal, and they rebuild themselves stronger than they were before. The result is that it takes more exertion (faster more powerful intervals) to tear them down next time

Doing all the intervals in the world will only get you overtrained without recovery.