you lift the bike up by the saddle and use your hand to spin the pedals and the faster you spin the pedals the more you notice an up/down movement in the rear of the bike?

try turning the bike so that it rests up side down on its handlebars and saddle, then spin pedals and see.