It does sound like there's a loose hub or headset on that bike. Or a tight binding headset would cause stability problems as well. Check the frame-alignment, both wheels should be on the same plane