I sometimes face the same question, often when there is a pothole or metal plate. Since I'm very careful in avoiding damage and reducing wear to my tires, I try to avoid hitting those things as much as I can. But if it's a busy street with vehicles passing nearby, I slow down and keep riding straight over the "obstacles"---thanks to the fact that I never ride too fast, this is not too bad (better to damage my tires than having personal injury). There were a few times it may have saved me from potential accident, when just as I was riding over the object, a car was passing me from where I would have swerved to.
There are a lot of construction metal plates on the streets here. Here is
a fatal accident where a metal plate might have played a role.