If all the guy said was you "don't need" the barrel adjuster, he is technically right. You also don't need a rear brake, handlebar tape, multiple gears, or a front shifter at all, for that matter. Removing the adjuster could only change performance if the adjuster was somehow causing friction as the cable slides through, but they generalyl do not cause any friction.
Leave the adjuster in there so you can... adjust!