Report: false AI output about nuclear cargo nearly led US forces to board a Chinese ship

A US military operation to stop and board a Chinese vessel was called off after officials found that the intelligence behind it had come from a chatbot error, according to a CNN report published on Friday. CNN based its account on four unnamed people with knowledge of what happened. Neither outlet reported a comment from the Pentagon, and the details below rest on that anonymous sourcing rather than on official confirmation.

What CNN reported

According to CNN's sources, an analyst at US Special Operations Command asked an AI chatbot to work through material about the ship, including its cargo manifest. The tool reportedly combined publicly available information with classified signals intelligence, then got the cargo wrong, flagging it as parts for a nuclear weapons program. As TechCrunch reported, the analyst then used the same tool again to turn those findings into a polished summary, which was passed through command channels.

TechCrunch, citing CNN, said the intelligence was shared while the US was at war with Iran, and that this spring military aircraft were already flying when officials realized the cargo identification was false. US forces had readied an interception with air support, and the operation was stopped at the last minute. One of CNN's sources described the episode as one that nearly started a war, Ars Technica noted. Neither outlet identified the chatbot involved.

A military moving fast on AI

The account lands while the Defense Department is pushing to spread generative AI across its work. Ars Technica pointed to several recent steps:

• In January, the department published an AI acceleration strategy meant to open data across its IT and mission systems to AI tools.
• Last December it picked Google's Gemini for Government as the base of its internal GenAI.mil platform, and last month it added Grok for Government as another option.
• In June, a Pentagon representative told Congress that 1.5 million personnel had used its generative AI tools, and that the tools help produce reports Congress requires.

TechCrunch noted that the Pentagon has presented AI as a way to speed up the kill chain so commanders can act faster. The outlet observed that the same speed can let a fabricated output move up the chain before anyone questions it. A 2023 State Department declaration on military AI said people must stay accountable for such systems through a clear command structure.

Jake Steckler, a research scholar at GovAI and a US Army veteran, told TechCrunch that decisions which could lead to force, including intelligence analysis, carry "life and death consequences." He argued the lesson is to add safeguards rather than drop the tools, and warned that chasing adoption speed above everything else could erode service members' trust and slow adoption in the end.