Goodfire argues neural networks are far cleaner inside than researchers feared (already-clean.goodfire.com)
Goodfire's Nick Cammarata revisits the famous "cat and car" neuron and finds it responds to pointed versus round shapes, not to a list of objects. His claim: much of the polysemanticity (one neuron firing for several things) came from fixable problems, not from superposition.
Sign in to save