In general, "cookies" has nothing to do with authentication. There is no rule that web site has to clean up its cookies when user logged off. 99.99% of the sites will drop cookies; just configure the browser to delete cookies when it closing down if you are that concern.

Google "delete cookies browser closed" for instruction on the browser that you are using.