If you hit the wheel hard, you may have bent the fork side to side, which would account for the steering problem. Hard to measure this without special tools. But check to make sure new wheel is centered in the fork, if its off to one side, this will cause it to steer to one side. And, try another wheel that you know is good, could be wheel problem.
Il faut de l'audace, encore de l'audace, toujours de l'audace
1980 3Rensho-- 1975 Raleigh Sprite 3spd
1990s Raleigh M20 MTB--2007 Windsor Hour (track)
1988 Ducati 750 F1