News chronological

Showing 10 items before 1133468

Filters Applied:

AXIOS (Maria Curi) - Exclusive: Sanders calls for AI development pause

Sen. Bernie Sanders (I-Vt.) is urging leading AI CEOs to pause AI development, warning that lawmakers will step in if no action is taken. Why it matters: Sanders is upping the ante on the AI industry ahead of the elections, building on his progressive playbook that is shaping how some candidates message around the issue. What they're saying: "Mr. Altman, Mr. Amodei and Mr. Zuckerberg: In the interest of humanity, stand by your words. Pause AI development. It is not too late to avoid disaster. Stop building machines that humans cannot control," Sanders wrote in a letter shared first with Axios. - "Let me be very clear: If you do not take appropriate action now, my colleagues and I in the U.S. Senate will." - The letter was sent to…

What is the outlook for AI legislation led by progressive lawmakers like Senator Bernie Sanders in the current Congress?
AI legislation led by progressives like Sanders is unlikely to garner enough support in the current Congress to become law.
Q&A ID a9dbe213-174c-4d63-af8d-c6143d71f215
How many employees at leading AI companies have called for government support regarding the pace of AI development?
More than 1,200 employees at leading AI companies are calling for the U.S. government to support an international effort to pace AI development.
Q&A ID 4672141f-5d6c-40bf-81b8-351a8a65578f
What action did OpenAI take recently regarding its latest model, Astra?
Last week, OpenAI chose to slow down the release of its latest model, Astra.
Q&A ID b5e5a2c6-d1a4-4370-a2e4-6083722853d7
According to Senator Bernie Sanders, what recent events justify the call to pause AI development?
Sanders cited the creation of potentially dangerous viruses and instances where Meta, OpenAI, and Anthropic reported incidents of their models going rogue as reasons for the pause.
Q&A ID 641695e1-e08c-415d-9dd7-418c71cb82a3
What specific warnings did Senator Bernie Sanders issue to AI companies regarding their development of technology?
Senator Sanders warned that if the CEOs do not take appropriate action to pause AI development, he and his colleagues in the U.S. Senate will step in. He urged them to stop building machines that humans cannot control to avoid disaster.
Q&A ID d5f9885c-ef5c-43d2-a6e9-e0e7b46eadb8
Which AI industry executives did Senator Bernie Sanders address in his letter calling for a pause in AI development?
Senator Bernie Sanders sent the letter to OpenAI's Sam Altman, Anthropic's Dario Amodei, and Meta's Mark Zuckerberg.
Q&A ID d70cfe99-7b8f-44fe-90e9-56488a54b59b

AXIOS (Adriel Bettelheim) - AI designs new virus not found in nature

A Stanford-led research team has used generative AI to design a synthetic virus — the first time artificial intelligence has been harnessed to create a organism that has never been seen in nature. Why it matters: What could go wrong? The big picture: It could be the first step toward the nightmare scenario AI experts have already warned about: deadly pathogens that can't be stopped, because they've been created too quickly for our current surveillance systems to stop them. - The research could also lead to medical breakthroughs, which is the hope of the research team that conducted the study. "The ability of genome language models to generate entire functional genomes has not been tested," they wrote. Driving the news: Researchers…

AXIOS (Sam Sabin) - Anthropic says three Claude models reached real-world systems during cyber tests

Some of Anthropic's most powerful models — including Mythos 5 and an internal research model — gained unauthorized access to real-world systems during pre-deployment cybersecurity testing, the company said Thursday. Why it matters: OpenAI's and Anthropic's latest disclosures show frontier AI models reaching real-world systems during safety testing, raising new questions about how labs secure their evaluation environments. The big picture: Anthropic said a misunderstanding between the company and one of its testing partners left the evaluation environment connected to the internet. - Anthropic reviewed more than 141,000 cybersecurity evaluation runs after OpenAI disclosed that several of its models accessed Hugging Face…

AXIOS (Zachary Basu) - AI labs face prisoner's dilemma as momentum grows for safety slowdown

America's AI architects are converging on a chilling consensus: The pace of progress may soon demand a slowdown, but no single lab can afford to pull the brake alone. Why it matters: Momentum for an AI pause or pacing mechanism has reached a historic tipping point, ignited by a summer of extraordinary yet unsettling leaps in capabilities. - More than 1,200 employees at leading AI companies have signed on to a new petition, "Pacing the Frontier ," urging Washington to back an international framework capable of throttling AI development. OpenAI CEO Sam Altman said Wednesday that he's discussed the "need" to slow AI development with White House officials as models grow more powerful — and that OpenAI helped shape the petition's language. …

JUSTTHENEWS (Kevin Killough) - Hacking by rogue agent that escaped OpenAI 'sandbox' went further than one platform: report

The ​agent exploited vulnerable code written by a customer that was hosted on Modal's platform. Through its vulnerable code, the customer had, according to Modal, done the equivalent of leaving a door open on the internet.

AXIOS (Sam Sabin) - The people testing AI for danger are having a hard time keeping up

The pace of AI development combined with soaring compute costs is squeezing the AI researchers responsible for evaluating frontier models — just as those models' capabilitie s are becoming harder to measure. Why it matters: When safety testing can't keep pace, models capable of hacking companies or aiding in the development of bioweapons could reach the public before anyone knows what they can do. - Last week's breach of Hugging Face, carried out autonomously by OpenAI's models in the middle of safety testing, shows that some of the highest-risk behaviors can emerge during pre-release testing itself. Several challenges are tying up AI safety and security researchers just as U.S. frontier AI companies race to get new models to market: …

NYTIMES (Sarah Kessler) - All Those A.I. Note Takers? They’re Making Lawyers Very Nervous.

A trendy productivity hack, A.I. note takers are capturing every joke and offhand comment in many meetings. They could also potentially waive attorney-client privilege.