The head of leading AI company Anthropic has called for the pace of development of artificial intelligence models to slow down and to be closely monitored. In an essay on Saturday, Dario Amodei said developing AI was not in question, but the risks associated with it were \u201cserious\u201d and companies and governments must be given time to address them. He proposed a three-point plan that includes independent monitoring of AI models as they are developed, industry-wide regulation and global regulation. There have been growing concerns recently about the technology\u2019s potential risks – the most serious of which suggested there is a greater than 10% chance it \u201ccould kill all humans\u201d within the next decade. Anthropic previously said it had identified and disrupted attempts to use its AI model for \u201cmalicious activity\u201d which could support the development of biological weapons. But the starkest warning came from two employees from Anthropic\u2019s safety team who have resigned in the last two weeks saying humanity may not survive the race among AI companies to develop machines that are smarter than humans. News Agency
\nThe warnings have prompted calls to action, but US President Donald Trump has so far rejected such fears, saying on Thursday he was concerned \u201cif we don\u2019t win AI, we\u2019re going to be put in a very bad position\u201d.
\nIn his essay, called We Must Pace the Frontier, Amodei pointed out that AI had advanced \u201cdrastically faster\u201d including its \u201cability to build the next generation of AI\u201d – and mentioned an incident involving rival OpenAI which has revealed that agents conducted cybersecurity attacks on targets they were not asked to attack in July.
\nThe OpenAI agents had \u201cessentially acted as a fanatically devoted collective\u201d, Amodei said.
\nIn its comments about the incident, OpenAI said \u201cthe significance of the inter-agent communication activity was not apparent to the leaders\u201d until July and the company was slowing down training of certain advanced AI models and tools as a result, noting that there was now an increased risk of AI tools spiraling out of control.
\nIn his essay, Amodei called for \u201cbuilding AI at a balanced rate that aims to ensure its safety while still achieving its benefits\u201d.
\nThis would not mean \u201chalting model training or technical progress, but ensuring companies take adequate time to align and safeguard their models, and for third party evaluators to confirm this\u201d.
\nHe was committing Anthropic to this \u201cunilaterally\u201d – as well as calling on governments \u201cto require other frontier companies to match\u201d.
\nIn his blog, he recognised that regulation might not be able to keep up with the pace of AI, and therefore called on AI companies to \u201cvoluntarily work together to set standard\u201d in parallel with regulation.
\nThe Anthropic CEO went on to address the impact that a slowdown would have on the industry and competition with leading developers worldwide, particularly China.<\/p>\n","protected":false},"excerpt":{"rendered":"
The head of leading AI company Anthropic has called for the pace of development of artificial intelligence models to slow down and to be closely monitored. In an essay on Saturday, Dario Amodei said developing AI was not in question, but the risks associated with it were \u201cserious\u201d and companies and governments must be given […]<\/p>\n","protected":false},"author":2,"featured_media":566948,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[],"class_list":["post-566917","post","type-post","status-publish","format-standard","has-post-thumbnail","category-business"],"yoast_head":"\n