not dropping down to the small ring is more of an issue with the cable not releasing fully or having a worn out chain, assuming the FD hasn't moved.

most times those inline adjusters will slip, so check that they are properly turning.
turn clockwise to tighten cable and counter clockwise to loosen, just like the adjuster barrel on the RD.