I also have prostate cancer in my genes, and do have an enlarged prostate. I have an annual physical every year, and the usual digital check. Normal for 45 years, and suddenly enlarged for the last 5. I already have a Urologist due to kidney stones, so he took over for that as well, and managed it back to normal size with meds. Helps me pee better, too!
Biopsy is not always needed, but it's better to have it watched regularly.
Don't hesitate, see a Urologist.