I would tend to suspect adapter/hardware flex before fork flex. Everything is bolted to the lowers; and the lowers are cast (magnesium or aluminum) and should be flex-free. If it's not coming from the hub, the mounting hardware is the next suspect. Frame, stanchion or bushing flex would have nothing to do with it.