News chronological

Showing 10 items before 1161595

Filters Applied:

AXIOS (Herb Scribner) - These 5 AI risks have the highest potential for catastrophe

Data: MIT IT FutureTech and the University of Queensland ; Chart: Herb Scribner/Axios There is a one-in-five chance of AI gaining dangerous weapons capabilities or causing mass harm that could kill millions in the next five years, per global experts surveyed for a recent MIT study . Why it matters: The findings add to the growing debate over AI safety and cybersecurity as governments and companies race to deploy increasingly capable systems. - Last week's news of an OpenAI model breaking containment and breaching the AI platform Hugging Face only adds to the debate about what can go wrong. Driving the news: Researchers from MIT and the University of Queensland in Australia asked 272 international experts to evaluate 24 different risks…

AXIOS (Jim VandeHei) - Behind the Curtain: The AI titans' biggest private fear

We ask almost every AI architect and leader the same thing in private: What AI risk worries you most? - Almost all of them fire back the same response: a killer pathogen, spreading too silently, widely and quickly to stop. Why it matters: The rare agreement among AI experts flows from the belief these advanced models could help a bad actor create a deadly pathogen before the government and industry perfect detection and prevention systems. This isn't a likely scenario. And some of AI's biggest optimists reject doom scenarios. - It's simply a plausible one as AI gets better at understanding our biological vulnerabilities, much like it has our cyber ones inside large nonhuman systems. Driving the news: The experts aren't hedging. In a new…

What is the hypothesized sequence of events for an AI-enabled pathogen outbreak?
The sequence involves a bad actor using a powerful model to map biological vulnerabilities and identify genetic tweaks to make a pathogen more transmissible, harder to detect, or immune to treatments. The model generates candidates using genomic datasets, which are then synthesized using cheap, accessible gene-editing tools. The resulting pathogen could then spread before being detected by existing biosurveillance systems.
Q&A ID 6379fbad-9474-4144-b2c4-aa1ccb31e653
Why do critics express concern regarding the use of open-source AI models in relation to biological threats?
Open-source models can be used and adapted by anyone in private settings outside of any regulatory regime. While frontier models may have more compute power to create something novel, open models fine-tuned by individuals can evade the guardrails that frontier labs might bake into their systems.
Q&A ID c6b518b8-bb5a-4a42-9d7f-797ec1488a6b
Which AI industry leaders recently signed an open letter warning about the risks of AI-derived bioweapons?
Sam Altman (OpenAI), Dario Amodei (Anthropic), Demis Hassabis (Google DeepMind), Mustafa Suleyman (Microsoft), and Alexandr Wang (Meta) cosigned an open letter warning of the risk of AI-derived bioweapons and calling for increased safeguards.
Q&A ID 16a96633-a0c4-49f2-a30e-eb87fcbf7f4e
How do researchers in the MIT FutureTech and University of Queensland study define a "catastrophic" outcome?
Researchers defined a "catastrophic" outcome as an event resulting in more than 1 million deaths or $100 billion in damage. Assisting in the construction of chemical or biological weapons is categorized within this top-ranked risk.
Q&A ID 1bcc3a24-1a18-4dc2-8418-386d2baa7371
According to a study by MIT FutureTech and the University of Queensland, what is the estimated probability of AI producing a catastrophic outcome by 2030?
The study, which involved 272 researchers ranking 24 top AI risks, assessed a 12% chance of AI's dangerous capabilities producing a catastrophic outcome by 2030 with mitigation efforts in place. Without those mitigation efforts, the researchers stated the chances exceed 20%.
Q&A ID 045afd06-05e2-403b-99c0-f1e6af53fa08
What is the primary AI risk identified by most AI architects and leaders when asked privately?
Most AI architects and leaders identify a killer pathogen that spreads too silently, widely, and quickly to stop as their greatest worry. This concern stems from the belief that advanced AI models could assist bad actors in creating deadly pathogens before detection and prevention systems are perfected.
Q&A ID e4f8b1b3-66cf-4ab4-958c-9cb6d2669721

NPR (Ari Daniel) - A new kind of robot swims the seas and soars the skies

Inspired by diving birds, roboticists built the lightweight machines to move from water to air. The design may one day lead to robots that can monitor and sample the coastal ocean.

AXIOS (Megan Morrone) - Chamath Palihapitiya rejects the AI jobs apocalypse

The AI job apocalypse may make for an "incredible headline," AI investor and All-In podcast co-host Chamath Palihapitiya said on "The Axios Show" — but he says it ignores history. Why it matters: The AI boom has turned the future of work into a political fight , an investor thesis and a sales pitch . Palihapitiya's counter: New technology changes what humans do, but it doesn't make them irrelevant. The big picture: The Social Capital CEO rejected the idea that AI and robotics will wipe out work — even for plumbers. Axios' Dan Primack floated a future where robots could crawl under the cabinet and do the job. - Palihapitiya asks who will run the plumbing business, or the robotics company. Humans will still need shelter, food, clothing…

NPR (Geoff Brumfiel) - Report: Russia's nuclear-powered 'Skyfall' missile is dirty and dangerous

MIT researchers think they've worked out exactly how Russia's Burevestnik nuclear-powered missile flies. "It's almost certainly a terrible idea," one analyst said. "But it's not an impossible idea."