I can't help you because you already know the answer. At least, your legs know, and you should listen to them.

In your current FG riding are you finding your gear on the high side (tough climbing) or low side (run out of rpm cruising flat ground at a good clip).

If you can't decide, you're like baby bear and it's just right as it is.

In any case, unless you know whether you want to go higher or lower, leave it where it is until you have a reason to change. the reason will also tell you the direction.