my kilo stock HS does the same thing, as well as the ritchey logic HS on another bike. i actually like how it "snaps" back straight. it's pretty subtle, only noticeable if the bike is hanging from a stand or suspended somehow. i always thought it was by design haha.
edit: only noticed this on threadless HS btw. threaded HS seems to swing about much more, which i dislike.