Really depends on the neighborhood, how long you'll be inside, and whether or not you can see the bike from inside.

I'll occasionally wheel my bike inside a business or bank. If someone asks you to leave it outside, ask them politely to show you the bike rack you can lock it to. (Works better in wide open spaces of a bank than a crowded urban store.)