A seat bag would be another option. There are lots of lightweight bag options out there like this one that would allow you to not have a rack and still not have weight on your back.
https://www.revelatedesigns.com/inde...=4&ProductID=7
I hope it all works out for you-