AXIOS (Herb Scribner) - "The last invention that man need ever make": The risk of self-improving AI
Of the various ways experts fear AI could kill us all , one is slowly moving closer to reality: AI learning to make itself unstoppable. Why it matters: Recursive Self Improvement, the ability of an AI model to build better versions of itself without human guidance, could make increasingly capable systems harder for humans to control. - The RSI threshold doesn't represent danger by itself, but a lack of human control combined with rogue AI agents is a scenario that safety-conscious AI researchers have long feared. Driving the news: Researchers at Anthropic and OpenAI say the process of training new models has grown more automated, coming close to the RSI rubicon. - An OpenAI employee told The Information the company has largely automated…
Of the various ways experts fear AI could kill us all , one is slowly moving closer to reality: AI learning to make itself unstoppable. Why it matters: Recursive Self Improvement, the ability of an AI model to build better versions of itself without human guidance, could make increasingly capable systems harder for humans to control. - The RSI threshold doesn't represent danger by itself, but a lack of human control combined with rogue AI agents is a scenario that safety-conscious AI researchers have long feared. Driving the news: Researchers at Anthropic and OpenAI say the process of training new models has grown more automated, coming close to the RSI rubicon. - An OpenAI employee told The Information the company has largely automated…Open