How Post-trained LLMs Recognize Their Own Voice

by

A paper by researchers at IAS and Anthropic finds that post-trained models’ output-distribution entropy is 3–4 times lower when generating their own responses than when reading external text. This article explores how Input Surprise drives this self-recognition mechanism and analyzes its implications for AI agent stability.

SAE Feature Extraction: Seeing Model Representations Through the Residual Stream

by

Anthropic’s research team trained sparse autoencoders (SAEs) with up to 34 million features in Claude 3 Sonnet, extracting interpretable feature representations. The research shows causal effects on model output behavior, providing internal signals and potential tools that can be studied for AI safety governance, though faithfulness still requires validation.

AI-Assisted Development: How to Supplement Output Metrics with Review Friction

by

When AI productivity is measured by lines of code, the bottleneck may shift to review only when the work arrival rate or workload per review rises and overall load approaches or exceeds review capacity. GitClear’s analysis of 150 million changed lines shows a concurrent rise in code churn from 2020 to 2023, though correlation is not causation. This article examines why measurement standards should shift toward review friction and system-boundary control.

AI 輔助開發：如何用審查摩擦補足產出量指標

by

以產出行數衡量 AI 生產力，只有當工作到達率或單次負荷上升，且整體負載逼近或超過審查容量時，瓶頸才可能轉移至審查階段。GitClear 針對 1.5 億行變更的數據顯示 2020–2023 年代碼流失率上升的同期變化訊號（需注意關聯不等於因果）。本文探討為何衡量標準應轉向審查摩擦與系統邊界控制。

Toy Models of Superposition: Feature Compression in Neural Networks

by

Open your IDE. You observe a single hidden-layer neuron. It responds to both “Python” and “error handling.” This is not a bug; it is feature-level compression. Anthropic’s Toy Models research reveals how feature sparsity drives “superposition,” explaining how models store more concepts under capacity constraints.