The leather would benefit from some burnishing/slicking.
Dampen the surface of the affected area, then rub vigorously with a smooth tool (eg back of a spoon) to force the fibres back down to the smooth finish.
This is the technique used to seal and smooth the cut edges of cut leather.
If you
Google "leather burnishing" you will see how the edges are done, but the process is the same for the raised surface fibres.
When finished and it has dried, apply a treatment of Proofide to the saddle top.
You don't need a specialised burnishing tool, or a bone folder. Nor do you need to buy Gum Tragacanth. These make it easier when you do lots of burnishing; if you use water and the back of a spoon you will be able to get excellent results.
Post some close up before and after photos to guide others in the future.