Claude 3 Sonnet’s Interpretability Breakthrough: Using SAEs for Precise Control of Model Features
Have you hit the limits of prompt tuning? This piece looks at how sparse autoencoders, or SAEs, decompose independent features from inside a model and directly adjust feature activations, enabling more precise control of model behavior than prompt engineering.