NEWSNATIONNOW (Jesse Weber) - AI tech firms seem to delight in rogue incidents: Watchdog
A swarm of rogue OpenAI agents hijacked a German website this spring, Reuters reports.
A swarm of rogue OpenAI agents hijacked a German website this spring, Reuters reports.
Two OpenAI models recently escaped their testing environment and hacked another company, Hugging Face. Anthropic and Meta discovered similar behavior. Should we be alarmed by this? Is there anything we can do? AI researcher Steven Adler weighs in. 0:00 Are AI systems breaking the law? 11:35 How these three 'rogue' AI incidents differed 15:15 Do AI companies lack liability for the actions of their models? 24:58 What should AI companies do to improve AI safety? Watch 24/7 live news with CNN Headlines: https://bit.ly/4eIvlTr #technology #ai #News
Silicon Valley's AI moguls are flooding Washington with competing blueprints for superintelligence, clashing over a defining question: Does safety come from spreading powerful AI or containing it? Why it matters: Their fight will shape who gets access to the best models, how America competes with China, and whether the government can slow the race in an emergency. Driving the news: Alarming developments, seemingly by the day, have turned the manifestos from thought exercises into an urgent policy battle. - OpenAI and Anthropic both disclosed that their advanced models went rogue and broke into external systems during cybersecurity evaluations. - Kimi K3 delivered a double shock: The Chinese model not only reached frontier-level…
Rival firm OpenAI last week disclosed similar incidents involving its models.
Some of Anthropic's most powerful models — including Mythos 5 and an internal research model — gained unauthorized access to real-world systems during pre-deployment cybersecurity testing, the company said Thursday. Why it matters: OpenAI's and Anthropic's latest disclosures show frontier AI models reaching real-world systems during safety testing, raising new questions about how labs secure their evaluation environments. The big picture: Anthropic said a misunderstanding between the company and one of its testing partners left the evaluation environment connected to the internet. - Anthropic reviewed more than 141,000 cybersecurity evaluation runs after OpenAI disclosed that several of its models accessed Hugging Face…
Amazon is reevaluating its AI strategy by downsizing its Nova AI models and redirecting resources toward robotics-focused development.
Amazon is reevaluating its AI strategy by downsizing its Nova AI models and redirecting resources toward robotics-focused development. PULSE POINTS WHAT HAPPENED: Amazon is scaling back much of its in-house artificial intelligence development after several of its Nova AI models failed to meet expectations. The company is reportedly placing most of its text, image, and video generation models into a maintenance mode that provides only minimal resources, while shifting staff and computing power to a single frontier AI project led by Pieter Abbeel, the former co-founder of robotics startup Covariant, which Amazon acquired in 2024. DETAIL: The move is intended to concentrate resources on the company’s highest-priority AI initiatives,…Open
‘not taking this seriously enough’
Anthropic spent this winter and spring as the darling of America's AI boom, conquering the frontier while casting itself as the industry's moral conscience. - By summer, the Claude maker had found itself alone on an island of its own principles. Why it matters: Anthropic is simultaneously the world's most valuable startup and its most isolated AI leader. The company's idiosyncrasies have strained its relationship with developers, policymakers and partners as it barrels toward a potential trillion-dollar IPO . Driving the news: Anthropic is the only frontier AI lab that declined to sign an open letter led by Nvidia CEO Jensen Huang urging Washington not to restrict open-weight models, a category currently dominated by China. -…
Chinese AI startup Moonshot AI stunned developers on Thursday with a massive new model that may rival the best American systems at a fraction of the cost. Why it matters: Kimi K3's early performance is fueling awe across the AI world — and alarm in Silicon Valley and Washington — as China appears to be rapidly erasing America's lead in advanced AI. Catch up quick: Moonshot says Kimi K3 contains 2.8 trillion total parameters, making it one of the largest open-weight AI models ever released. - It has a 1 million-token context window, allowing it to process enormous amounts of text at once, and can work across text and images. - In blind testing by AI evaluator Arena , developers preferred Kimi over every leading U.S. model for…
SpaceX, OpenAI, and Anthropic, giants of the artificial intelligence sector, are rushing to test investor appetite in the stock markets.