Sparse Autoencoders

Anthropic 的研究團隊在 Claude 3 Sonnet 中訓練了高達 3400 萬個特徵的稀疏編碼器（SAE），提取出可解釋的特徵表示。研究顯示能對模型輸出行為產生因果影響，為 AI 安全治理提供了可研究的內部訊號與潛在工具，但忠實度仍需驗證。

Anthropic’s research team trained sparse autoencoders (SAEs) with up to 34 million features in Claude 3 Sonnet, extracting interpretable feature representations. The research shows causal effects on model output behavior, providing internal signals and potential tools that can be studied for AI safety governance, though faithfulness still requires validation.