I stealthed for 26 days in Oregon and Washington, and I didn't have a single bad experience.
The very first night, I was in the corner of some field, with corn on one side and a row of trees on the other. In the middle of the night I woke up to raccoons or possums or something right outside my tent. Freaked me out, but I survived.
One night I slept on the corner of a Walmart parking lot. Once a cop came into the adjacent 7-11 parking lot with his lights flashing, I was scared out of my mind that he was there for me. But it turned out to be for a robbery or something.
But the rest of the nights were fine, and after a few nights I got used to sleeping outside