Yep, if you don't like a particular original part (probably with good reason), just put it aside for the time being and enjoy riding the bike with the part you prefer to use. If you ever want to show or sell the bike with original parts, just reinstall the parts you took off and put aside.