Just to be clear, the bag isn't the issue, really, it's the increased muscular tension and possible compression of nerves or blood vessels that's the problem. The bag may just be aggravating it. If it's better without, then start looking at your fit, core, neck/shoulder position, and weight distribution to get a better position. It can all matter, not to mention the kinds of roads you ride. A lot to think about...