The use of cleats on cycling shoes for competition dates back to at least the very late 1890s. Here's an 1897 advertisement for Spalding cycling shoes that mentions cleats as an included item.