I am in the process of developing a DIY crate to rack attachment system, which would mean an easy on/off for milk crates. It would be able to hold things panniers simply cannot, such as a 24 pack of water, which is currently the only thing i can't carry on my bike.
If you don't mind having the crate there, i'd say go for that.
- Andy