I’d also suspect the shift lever as the problem. Probably best to disassemble, lube what needs to be lubed, clean what needs to be cleaned and reassemble. I have found ghost shifting almost always is because the d-ring or equivalent isn’t tight enough.