Thrift stores have activewear of all types, sometimes even new, that will work as good or better than cycling specific clothes. Its also not unusual to find cycling clothes.