Though bike racks are stolen occasionally, they're not a prime target. There's no guaranty, but as you describe things, I'd probably keave the rack on full time also.
The greater risk probably isn't theft, but the chance of bending things when backing too close to a wall.
__________________
FB
Chain-L site
An ounce of diagnosis is worth a pound of cure.
Just because I'm tired of arguing, doesn't mean you're right.
“One accurate measurement is worth a thousand expert opinions” - Adm Grace Murray Hopper - USN
WARNING, I'm from New York. Thin skinned people should maintain safe distance.