I agree that I would suspect the small chainring is worn.

There was no mention of what combo was noisiest, if you rule out large chainring rub, and possibly a bad chainline, then worn out ring.

I wear out small rings far faster than large.