If there's any air in the fluid reservoirs, inverting them may allow the air to get into the master cylinder and/or brake lines on some designs. I advise keeping the rubber side down with hydraulics as much as practical.
It won't hurt the fork to be inverted, however.