Knickers I like a lot, but leg warmers keep you versatile for spring riding. I'm sure you already do so, but you are wearing them with the tops tucked well under your shorts?....this is usually more than enough to keep them up.
(I do recall a newbie in our cycling group who was struggling to put on some leg warmers-- unsuccessfully-- until a grizzled older rider pointed out they were actually arm warmers.)