I leave mine at work. But my previous job required people to take theirs home every day. I feel your pain.
Get some panniers, and TEST THEM. Mine are falling apart - the screws that hold the attachment points, go into plastic. It would be easy for them to come apart on a ride, dropping the laptop when you hit a bump at speed. Anyway, once you know you have reliable ones, get some foam padding.