I have both a Claris and a 105 equipped bike. The difference is quite noticeable. Certainly more noticeable than say aluminum vs carbon frames.
I'd say Claris is "good enough" for what most people (including myself) really need... but personally I'd pay the extra for 105 because that's what I would want.