Evans Cycles in Waterloo Cut and Condor Cycles always have some nice used bikes.
London Cycling Campaign have a used bike page.
For mail order, sjscycles do a wide range of practical bikes in the "Thorn" range. Orbit are another good source of proper bikes.