It really depends on your current fitness level and your ability to grow fitness. With time that kind of commute is very feasible.

You can start out slower though, like twice a week for a week or two, then grow to 3 for a couple of weeks, etc. until you're OK doing 5 times a week. You can also ride slower. Mixing 'slow' days in between 'hard' days. By slow I mean you hardly puff. The point is to ramp up your fitness and incorporate rest days.

With time the difference between slow and hard days won't be that much in terms of the time it takes.

And yes, bring clothes. Its easier with panniers and you'll eventually figure out ways to optimize what you wear

Anyway take your time, it will grow. If you plant a seed, with time and care, a tree will grow.