The smaller chainrings can usually be wiggled off the crankset, while still on the bike. Slip it over 1 spider arm, then another, then slide down the crank.

If you have a "square taper" crankset. then each crankarm attaches separately to the bottom bracket axle.
There are quite a few different types of cranksets on the market.

A picture would help.