Sparse autoencoders (SAE) use the concept of autoencoder with a slight modification. During the encoding phase, the SAE is forced to only activate a small number of the neurons in the intermediate ...

With Anthropic’s map, the researchers can explore how neuron-like data points, called features, affect a generative AI ’s output. Otherwise, people are only able to see the output itself.