Yup. Derailer adjustment should fix the issue. You should be able to adjust it just with a cable tension barrel adjuster. If that didn't help to completely get rid of the shifting issue to the largest cog, you may try adjusting L screw little bit.
Its a pretty easy process. Also make sure your wheel is mounted correctly. Just lock your qr when the bike is on the floor.