I can relate, but that isn't how it works. Base is like building engine displacement, while the high intensity work adds a supercharger and other performance tweaks. You have to do this stuff in order, and after everything clicks for a few weeks, the parts wear out and get sloppy and it's time for an overall... ie rest, recoup and start over.

Don't worry about losing fitness... you'll get it back and then some.