I also have no problem with banana peels, apple cores, or any other natural "trash" being discarded along trails as long as it's off the trail. I've thrown banana peels away way off the side of the road. They will biodegrade in short order, will fertilize other flora, and throwing out an apple core may even plant a new apple tree.
But paper, plastic, or metal trash should be packed away and disposed of at the next trash receptacle. There's no excuse for being lazy.