If you want a speedy lightweight touring bike, first get speedy, lightweight gear. If you want the maximum of speedy lightweight-ness first, round up all the gear you're actually going to need, and then pare down everything unnecessary, sub out heavier things, and figure out what you can live without. Once you have the bare essentials down, find a bag system that fits them all.

Painners are the standard because they work really well for loads of varying sizes, but they aren't ideal for all circumstances. If your load is really light, you can ditch the panniers, and the racks too and use a 'bike-packing' style setup, with a handlebar bag, a frame bag and a saddlebag. This does allow you to save a substantial amount of weight over racks and panniers, and it makes your bike 'speedier.' Just about any bike can take this kind of a load and still ride properly, so you can use a nice speedy, lightweight road bike (that is set up for long distance comfort) and be happy.

Panniers are a good middle ground, they don't weigh too much, allow a lot of flexibility, and you can use just about any number imaginable between two and six (if you get creative). However, by this weight class, bikes benefit from certain special features that make them less speedy and light weight. They often use heavier tubing to reduce flex and have longer wheelbases to 'increase stability' which means 'decrease responsiveness.' This might not be the best choice if your idea of 'light and speedy' comes from the world of road bikes, but it can still be done.

Trailers are interesting, they can be used on just about any bike, allowing you to carry a heavy load on what would otherwise be a sprightly and nimble bike. However, they do tend to weigh a good bit by themselves; in fact, the weight of an empty trailer can be as much as the total load of someone going very light.

From what you posted, you have some weight you can shed easily, but it might be hard to keep all the luxuries you want and still be light and speedy. A standard touring bike should be more than capable of doing everything you want of it though, and it will only be as slow as the rider.