I hope I didn't get a defective E3! As the cable connections are very straightforward, if I made a mistake I think there wouldn't be any lights at all no matter how I spin the dynamo wheel.

I have verified that the rear lights indeed comes on, but only a few seconds after I moved off. The light would get cut the moment the bike stopped. Could well be a circuitary issue with the E3 light.