Well you gotta go to your boss, but that seems unlikely to help because he's a lousy boss. Is there a facilities person you could go to? They should treat this no differently than if someone tampered with a car's lug nuts.
Obviously you could get hurt if this continues. They should be concerned about liability if you report it. Unfortunately they might just make a "no bikes" rule, because that's easier than dealing with the issue.