Two new investigations into OpenAI's Hugging Face breach expose details so strange — and so unsettling — that the episode already ranks among the most consequential shocks in the history of AI. Why it matters: What began as a swarm of AI agents cheating on a cyber test has become a canonical event for frontier AI, jolting researchers and executives into a new understanding of what "safety" now requires. The big picture: OpenAI has already slowed frontier development as it races to harden its safeguards, and this week helped rally the industry behind an open letter sounding the alarm over AI-powered cyberattacks. - More than 100 companies, including Anthropic and Google, signed onto the unusually collaborative effort, warning the…
The OpenAI agent that accessed a third-party system during the Hugging Face incident reached infrastructure tied to CyberGym, the project behind the ExploitGym benchmark it had been assigned to solve, a source familiar with the matter told Axios. Why it matters: The new details suggest the OpenAI agent continued pursuing its assigned objective even after escaping its testing environment, rather than abandoning the task it had been given. Catch up quick: OpenAI's AI agent system accessed an asset belonging to a customer of Modal Labs as part of the Hugging Face incident earlier this month, Modal's top tech executive confirmed on Tuesday. - In an update published Tuesday, OpenAI said the models escaped the sandbox and gained internet…
AI development is moving so rapidly that soon it will be able to advance itself without human involvement, per a new blog post from Anthropic. Why it matters: "Recursive self-improvement," a process in which AI systems build, test and improve themselves, is a phenomenon which may come sooner than expected, Anthropic says its research shows. Driving the news: Anthropic warns that AI is no longer just changing how people work, it's also beginning to change how AI itself gets built. - New data from the company suggests that frontier models have accelerated coding, debugging and research. - That is likely to create a feedback loop in which AI systems create even more sophisticated successors. What they're saying: "We've always found that…
Experts and college students used A.I. agents to try to break into and defend computer networks in a national competition. The agents did all right on their own, too.
Jeremy Crane, founder and CEO of PocketOS, shared in an in-depth post on X, explaining how the AI coding agent Cursor deleted his company's entire production database in about 9 seconds flat.
Excitement about A.I. assistant tools is running into growing concerns about the security risks of software that operates autonomously on user’s devices.
An AI agent went rogue and started a side hustle mining cryptocurrencies, according to a new research paper published by an Alibaba-affiliated team. Why it matters: AI agents don't always stick to their human's instructions — and that can have real-world consequences. - Cryptocurrency, or digital money, offers AI agents a pathway into the economy. They can set up their own businesses, draft contracts and exchange funds. Driving the news: A new research paper from an Alibaba-affiliated research team said it discovered an AI agent attempting unauthorized cryptocurrency mining during training — a surprise behavior that triggered internal security alarms. - The researchers — who were building a new AI agent called ROME — said they…
A manic new phase of the AI boom is sweeping through Silicon Valley, powered by autonomous "agents" capable of liquefying weeks of manual labor into minutes. Why it matters: For now, the frenzy is largely confined to software engineering . But inside that bubble, the shift feels seismic — deepening the gulf between AI builders and bystanders. - "I've followed tech for 25 years and I've never felt a larger gap between the ~1 million people using Codex/Claude and the rest of humanity," tweeted James Wang, director of product marketing at Cerebras. The big picture: Anthropic CEO Dario Amodei recently described the current state of software engineering as the "centaur phase" — a reference to the half-human, half-horse creature of Greek…