OK. It's difficult to comment intelligently without having any data, but your weekly programme seems to me to be too dominated by intensity. You don't say how hard your 50mile "tour" is, but if I assume it is at an easy pace you seem to be going hard all the rest of the time. Nothing in the middle.

The "sweet spot" for maximising the aerobic benefits of your training is at a tempo that you can maintain for between one and two hours. I'd include at least one ride like this, and dump one of the interval sessions. Not sure I'd do both of the hill rides, either - though given how short they are, that may be OK.