I lived in Japan for seven years. Everything is totally safe there except umbrellas and bicycles. These are viewed as community property. If you have a loaded bike however, I'm certain you'll be fine. And if your bike is missing look first at the nearest train station.
You can keep everyone away from your bike by making it look sketchy. My favorite thief deterent is to flag underwear off the panniers.