I have the original Vivoactive and it has no issues keeping time. However, it syncs with my phone multiple times a day, so that could be why. My kids have Vivo Jr.s and they frequently have the same issue as yours as they never sync.

As others have suggested, with it being software based, it might just be an issue you'll have to deal with, or sync or let GPS connect frequently.