Originally Posted by
MetalPedaler
This makes sense. The only thing to add to the equation, is that the unfit person will usually weigh more/have higher percentage of fat to their muscle mass, which will cause them to burn more calories.
You might think that intuitively but as sreten explains above as you get fitter you are capable of putting out more power which burns more calories. Efficiency doesn't change with increasing fitness.