I think vrkelley is on the right track. I kept changing bags and eventually came back to the same old NorthFace daypack I've been using for years. It has one main cavity and one patch type pocket on the back. Unfortunately, I don't think they make this particular model anymore (I bought it at the NF outlet 10 years ago).
Here's a real
minimalist pack. Maybe something like this?