Which fuji? Finest? Newest?
Which shifters do you have on your bike? Maybe find a video on youtube on how to operate them, it might just be an awareness issue.
One thought for you, if you have a performance bike shop nearby - they have beginner rides on Saturdays and it's a near certainty they'd be happy to give you personalized tips and assistance.