Anthropic interpretability team develops J++ lens
In the Fellows Program project, Kola Ayonrinde of the Anthropic interpretability team led the proposal of J++ lens, an improved version of J-lens that can replace the original method as a plug-and-play drop-in. The work clusters activations layer by layer and fits a Jacobian for each, then combines them with learned weights, while also introducing R-lens's layer-wise relevance propagation and post-hoc filtering of spurious readout tokens. The team says that in evaluations it reads out the intermediate latent variables used in the model's reasoning more reliably than J-lens and R-lens, and has released the code, the lens, and an interactive Neuronpedia demo.
In the Fellows Program project, Kola Ayonrinde of the Anthropic interpretability team led the proposal of J++ lens, an improved version of J-lens that can replace the original method as a plug-and-play drop-in. The work clusters activations layer by layer and fits a Jacobian for each, then combines them with learned weights, while also introducing R-lens's layer-wise relevance propagation and post-hoc filtering of spurious readout tokens. The team says that in evaluations it reads out the interm
Matched fieldsTitle