As noted above, ponchos are great (I have an Ikea rain poncho that cost under $10), and Showers Pass is the best (known) brand in cycling-specific raingear.

For a more budget-friendly option, I'd recommend looking into raingear for the motorcycling market. A bigger marketplace (more demand, more volume) has lower prices. Frogg Toggs for starters.