I use "zip-ties" to tie the pump vertically to the side of the rear rack. These work well because they cannot be removed easily by hand, but are very easy to remove with a small pair of pliers (on my Leatherman tool).

In addition I put reflective tape around the barrel of the pump. I try never to miss an opportunity to make a gadget blink, flash, or reflect.

regards
Dan