It's good to install stuff permanently. I use the supplied bracket and then add a zip tie or some sort of wire to prevent quick removals.

Warning: For stuff like the seat-post racks, your LBS repair guy may complain because extra stuff makes it hard for them to service the bike.