65 minutes is a long time to carry a load on your back, especially, as happens to many of us, when a backpack, no matter what the design, will make your back sweaty (even during winter from my experience). However, what you call looking out of place and what I call looking out of place may be complete opposites. I'm fine with panniers on my bike but I wouldn't attach cat litter boxes whereas others on this forum don't have a problem with cat litter boxes. If you wish to continue with backpacks, there are options such as a backpack rack (image) or backpacks that mount on rear bike racks or a seatpost rack that a backpack (limited weight) can be strapped to.



As you can well imagine, I recommend panniers with a rear rack: it is a very versatile option.