Thank you for the advice!
After reading all the suggestions and searching on marketplace, I can find some ultegra/105 2x10 parts so that could be a better alternative to Tiagra 4700. Especially a bundle including some Ultegra 6750 brifters and front derailleur, a 105 rear derailleur and what looks like a sram 10 speed cassette(?) for 190$ (CAD) (~ $140) which I would like to deal to around $110.
Since I almost never use the 2nd speed of the front drivetrain, I don't care that much about upgrading the front derailleur. The brake calipers are also good enough to continue using them. I think the most problematic parts to change are the rear derailleur/cassette and the brifters