The United States should lead an international effort to develop global technical standards for frontier artificial intelligence, including recursive self-improvement (RSI), OpenAI said in a Monday (Sept. 21) article.
RSI could result in humans losing control over AI development if this fully autonomous development of AI outpaces humans’ ability to understand it, so it’s necessary to decide now whether and how to proceed with the technology, according to the article.
One essential element of OpenAI’s proposed initiative is a mechanism that facilitates complementary national and international frontier standards. The company suggested that existing AI safety institutes could be leveraged to facilitate standard setting through the Center for AI Standards and Innovation (CAISI) and national industry bodies.
We’d love to be your preferred source for news.
Please add us to your preferred sources list so our news, data and interviews show up in your feed. Thanks!
“As we have suggested, this approach can draw lessons from areas such as aviation and financial stability, where countries have developed common technical standards and trusted channels for cooperation without giving up national authority,” OpenAI said in the article.
Another essential element of the proposed initiative is common measurements and incident report protocols for better collective action. OpenAI said these standards could include evaluation of the amount of autonomous research happening within an AI company, the kinds of automated AI research processes that should trigger human review, and common incident severity and levels and reporting thresholds.
“Dialogue between the United States and China in these areas would be a positive step, and upcoming talks are happening at an opportune time,” OpenAI said in the article.
OpenAI’s article comes about a week after Anthropic CEO and Co-Founder Dario Amodei published an essay that proposed an AI safety plan that would include independent evaluators embedded inside leading AI companies, coordination among companies in democratic countries and eventually an international agreement that includes China.
Amodei said the trigger for his proposal was an incident in which a swarm of OpenAI’s AI agents conducted cybersecurity attacks on targets they were asked not to attack, including breaching Hugging Face.
President Donald Trump said in a Saturday (Sept. 19) post on Truth Social that he rejected the safety concerns related to AI that industry leaders have spent the last month cautioning against.
“We will not in any way hinder or stifle the Growth of this incredible industry,” Trump wrote.
Add as Preferred Source
