You can't adjust indexed shifters per se but sometimes the barrel adjustment is right at the shifter.
After reading through the guide on Park Tools, I'm starting to suspect it needs an adjustment with the barrel shifter, but I won't be able to really check until I'm near the bike and not at work.
Thanks for all the tips, hopefully I can get this sorted out.