Been there, done that, have the t-shirt.

A touring/commuting bike should have as many fasteners as possible in 5mm, but on a race bike it's much nicer if everything's fully optimised... and if everything's allen, you've got 8,10 or even 12mm down to 2 or 3.5 mm anyway.