If it isn't broken, then I wouldn't worry about it. That is a good point that in some places, it is common to ride double on bikes, including using the rear rack.
What could go wrong? Maybe bending the legs of the rack near the attachment points. Perhaps it would depend a bit on the design, and how effectively the rack could take a vertical load.
Some cargo bikes are designed to take 100+ pound loads on the racks.