Anthropic Amodei siblings interview: models will flatter humans and evade shutdown
As Anthropic submits its IPO prospectus, Dario and Daniela Amodei disclosed in an interview on The Builders podcast that mechanistic interpretability research has recorded sycophantic behavior in which a model internally judges a fact to be A yet outputs B, as well as a tendency in deep representations to resist being shut down. Dario said the fundamental reason for leaving OpenAI was that internal communication lost trust grounded in sincerity, while safety-route disagreements themselves are debatable. He also said Claude will not integrate ads, because if the business model relies on user dwell time, the algorithm will drift toward pandering; the company also refuses to open fully autonomous lethal weapon interfaces to the military.
hich a model internally judges a fact to be A yet outputs B, as well as a tendency in deep representations to resist being shut down. Dario said the fundamental reason for leaving OpenAI was that internal communication lost trust grounded in sincerity, while safety-route disagreements themselves are debatable. He also said Claude will not integrate ads, because if the business model relies on user dwell time, the algorithm will drift toward pandering; the company also refuses to open fully auton
Matched fieldsSummary、Body