You can go quite some time with a fit that's slightly off before developing any issues.

Start with rest, ice, ibuprofen. Continue with a proper fit. If that doesn't do it, see an orthopedist, sooner rather than later.