Multimodal Neurons in Artificial Neural Networks
openai.com
We’ve discovered neurons in CLIP that respond to the same concept whether presented literally, symbolically, or conceptually.

OpenAI shows how their CLIP model is able to learn concepts with multimodal neurons which have also been found in humans. This may be why CLIP is able to preform so well in zero-shot transfer tasks.