The fan is no longer pushing cold dry air around.
The difference in temperature vs apparent temperature is motion and humidity. The air conditioner not only cools, but also dehumidifies the air being pushed by the fan.
If the power is turned off, rather than simply turning it from AC to Fan, the loss of air motion increases the apparent heat in addition to the loss of cool dry air.
Humans are generally exothermic.
