My chain came off both gears once when starting up a red light. Bang! Down to the ground I went. Luckily the cement mixer behind me saw me go down and stopped before flattening me.

I agree with the posters above: you probably need a new chain, especially after 4000 miles and especially if it's not cleaned regularly.