It is a combination of heat, sun and humidity that works together. A low humidity day that is over cast could be endurable into the low 100s. A relentlessly sunny day in the low 90s with nearly 100% humidity can be pretty brutal.

The ultimate judge on this is you. Some people can endure more heat than others. If it is too hot for you, it is too hot.