My personal opinion is, if it would look ugly as a shirt it's ugly as a jersey. Many folks take the chance to dress up like some kind of superhero, or make some political statement, just because they're putting a on bike jersey. Like they're putting on some kind of costume or something.
Why is this? You're just a regular guy riding a bike. It's not unusual or weird.
Of course team jerseys are the exception, but then you really are putting on a sort of costume, for a specific purpose.
Me, I just get bright, simple jerseys from a handful of preferred makers. My advice is to go to a few bike shops and find something that fits, and apply your regular sense of aesthetics to your purchasing decision. Would you wear a t-shirt around town with a coiled rattle snake on it? If you would, well I guess that's okay then.