Yes, you should need a shim.
I bought a new MTB and on the specs the seatpost is 27.2mm diameter. The seatpost for my old bike (which is longer than the one on my new bike) is about 26.8mm diameter. Do I need a "shim" to help the old one fit in or would this minor difference be sufficient? Please help!!!