A stiffer frame feels more responsive to the rider, the article you linked to corroborates this. In your rather condescending tone you suggest that compact frame designers are simply forcing these frames down our throats at the behest of the marketing departments of big bike manufacturers. (do I hear conspiracy?)
I think they are responding to what riders are asking for.