Check discount clothing/department stores like Ross, Marshalls, Burlington, etc. I see short finger cycling type gloves in the sporting goods aisles there pretty much every visit. Usually the gloves are aimed at general fitness and weight lifting, but a few weeks ago I found some adidas branded gloves that are indistinguishable from my Giro, Garneau, Bontrager and other brand cycling gloves. Cost a whole $5.

If you prefer more padding and/or knuckle guards, check hardware stores. Some appear to be aimed at guys with MMA or ninja fantasies, but others are more practical.