I am not a PT but am married to one....
I hear these stories every day.
Somewhere in the middle is the truth, usually.
Just because something causes you pain in your treatment, doesnt mean you should not do it. I assure you it wont get better if you always stop at any pain and swelling.
On the other hand maybe the therapist is not advising correctly.
My guess is you need to put more effort into following his advice until you can say you really have given it 100% and its not working.
Just an opinion and of course I dont see all the real facts.