Just race. Try to borrow a jersey, but if you ask your teammates for a jersey then they will know how badly you need one. You'll either end up with a jersey or a team of guys who understand why you dont have one.