I am going to take it to a shop. I have called around and apparently Ultegra derailleurs are no available anymore. I have located a 105 so I will buy that.
I have no idea how the inner side of the derailleur got scraped up. Someone here when I first bought it said it looked like the previous owner tried to turn it into a gravel bike.