Why not turn it all upside down?
Sit, holding the inverted star nut setter on the ground between your feet. Hold fork upside down over that, place a wood block over the bottom of the steerer tube, and hammer that.
Use a dead blow hammer or something soft in case you scrape the fork legs, or use a really long wood block.