Jacob Coxon tells NYC Council AI could end humanity

Coxon quit Anthropic in September. On X he said he had spent three years on AI research at OpenAI and Anthropic, and that neither company is acting responsibly.

He told the New York City Council that on the current path, humanity losing control to AI is more likely than not, and it could end in human extinction.

“on the current path… it is more likely than not that humanity loses control to these AIs, and it could end in human extinction.”

Policy staff from OpenAI, Meta, Google and Anthropic were questioned at the same hearing. Speaker Julie Menin asked each to put a number on the worst case.

“quantify the risk posed by AI in the worst-case catastrophic scenario.”

Per our own unofficial transcript of the video, he also said most code is now written by AI and people don't check it carefully. He said OpenAI had targets for an AI that does AI research around 2027-2028, and it is on track.