I always ride in cycling clothes, and carry my change of clothes in a saddle bag (either carradice or acorn)

If you find yourself always falling off your bike, I would suggest trying different tires. What kind of tires do you currently have? Some tires are terrible in the wet.
Your balance and handling skills will improve as you ride more, but there are things you can change on your bike to make life easier for you right away.