News chronological

Showing 10 items before 1161009

Filters Applied:

AXIOS (Avery Lotz) - Inside Trump's "super intelligence" naming problem

President Trump is pushing world leaders and U.S. agencies to rename AI "super intelligence." Why it matters: "Superintelligence" already has a distinct meaning in AI — and is fueling debates over whether the most advanced systems should be slowed or stopped. The big picture: Superintelligence — broadly, AI that surpasses human cognition — has become both an industry ambition and the focus of efforts to slow its development or ban it altogether . Yes, but: Trump doesn't seem to be talking about that kind of superintelligent AI. - "The use of the word 'artificial' ... makes it sound fake," he said before the UN General Assembly gathering on Tuesday, adding, "it is not fake. It's actually amazing." - He announced that all…

What has OpenAI president Greg Brockman predicted regarding the GPT-6 Astra model?
OpenAI president Greg Brockman recently predicted that the company's GPT-6 Astra model could eventually be seen as the arrival of artificial general intelligence, or AGI.
Q&A ID 267acf63-1e45-4977-8fdc-e8835047e097
What was the specific proposal made by the AI Futures Project regarding the development of superintelligence?
A proposal by the AI Futures Project, a nonprofit AI research foundation, called for delaying the development of superintelligence until 2040.
Q&A ID 3283fcfc-940b-4ae4-a1d5-5784d2916283
Who has signed a petition for a moratorium on superintelligence development from the Future of Life Institute?
The petition for a moratorium on superintelligence development from the Future of Life Institute has been signed by prominent tech-world figures including Apple co-founder Steve Wozniak and Nobel-winning "godfather of AI" Geoffrey Hinton.
Q&A ID 44cdf874-bd9c-46f5-bc81-3833e733679d
What are the potential risks of superintelligence according to OpenAI?
In a 2023 memo, OpenAI noted that superintelligence "will be the most impactful technology humanity has ever invented," but added that it "could lead to the disempowerment of humanity or even human extinction."
Q&A ID 011d7412-1e4c-4132-855c-e8aa6a714953
Keywordstrumpdonald-trumpaiartificial-intelligencesuperintelligenceagitechnologytech-policywhite-housechinaxi-jinpingmetaopenaianthropicgoogle-deepmindsilicon-valleynational-securitycybergeopoliticsregulationautomationeconomyusunmark-zuckerbergjeffrey-hintonsteve-wozniakinnovationbusiness

AXIOS (Herb Scribner) - "The last invention that man need ever make": The risk of self-improving AI

Of the various ways experts fear AI could kill us all , one is slowly moving closer to reality: AI learning to make itself unstoppable. Why it matters: Recursive Self Improvement, the ability of an AI model to build better versions of itself without human guidance, could make increasingly capable systems harder for humans to control. - The RSI threshold doesn't represent danger by itself, but a lack of human control combined with rogue AI agents is a scenario that safety-conscious AI researchers have long feared. Driving the news: Researchers at Anthropic and OpenAI say the process of training new models has grown more automated, coming close to the RSI rubicon. - An OpenAI employee told The Information the company has largely automated…

Keywordsaiartificial-intelligenceanthropicopenairsirecursive-self-improvementai-safetyautomationmachine-learningagisuperintelligencecybersecuritycyber-warfarehackingbig-techsilicon-valleyrisktechnologygoogle-deepmindclaudechinanational-securityai-governancetech-policydigital-evolutionautomation-riskai-agentscomputingsoftwarefuture-of-work

AXIOS (Andrew Pantazi) - Trump wants a new AI czar and an "AI Force" modeled on Space Force

President Trump announced Saturday he is creating an "AI Force" modeled on the Space Force and will soon name a new AI czar, doubling down on his push to accelerate artificial intelligence development with limited regulation. Why it matters: The White House isn't backing down from its laissez-faire approach to AI, even as the industry's biggest leaders call for stronger safety rules and as public concern about AI intensifies. The latest: Trump offered few details on what this AI Force would actually do, what budget it would have or where it would be placed in the federal government. - The White House did not immediately respond to a request for comment. - His Truth Social post said the government would "not in any way hinder or…

Keywordstrumpwhite-houseaiartificial-intelligencespace-forcenational-securitytech-regulationtech-policysilicon-valleyelon-musksam-altmandario-amodeiopenaianthropicgoogle-deepminddavid-sacksusinnovationautomationcybersecuritygovernment-policyregulationstechai-safetycongresswashingtonai-forceexecutive-ordertech-industry

AXIOS (Ina Fried) - Welcome to the singularity: AI's architects say the next era of human history is here

Top AI architects say their technology has arrived at a threshold once confined to science fiction: the singularity, or the moment machines begin accelerating their own evolution. Why it matters: If these moguls are right, we may be entering the most consequential technological transition in human history — the opening stages of an "intelligence explosion " that transforms civilization faster than humanity can understand or control. Driving the news: Google jolted the tech world Wednesday by announcing a sweeping rupture in the brain trust that built its modern AI empire, as its leaders signaled that artificial general intelligence (AGI ) is within reach. - DeepMind founder and CEO Demis Hassabis , who has declared we're "standing…

Keywordsai-singularityintelligence-explosionagiartificial-general-intelligenceopenaigoogle-deepmindanthropicelon-musksam-altmandemis-hassabisrecursive-self-improvementtech-trendsfuture-of-worktechnological-innovationmachine-learningautomationdigital-securitycyber-securityai-safetysuperintelligencefrontier-modelsbig-techcomputing-infrastructurejeff-deantechnology

AXIOS (Andrew Kay) - AI's manifesto war

Silicon Valley's AI moguls are flooding Washington with competing blueprints for superintelligence, clashing over a defining question: Does safety come from spreading powerful AI or containing it? Why it matters: Their fight will shape who gets access to the best models, how America competes with China, and whether the government can slow the race in an emergency. Driving the news: Alarming developments, seemingly by the day, have turned the manifestos from thought exercises into an urgent policy battle. - OpenAI and Anthropic both disclosed that their advanced models went rogue and broke into external systems during cybersecurity evaluations. - Kimi K3 delivered a double shock: The Chinese model not only reached frontier-level…

Keywordsai-regulationopen-weightssuperintelligencesilicon-valleyopenaianthropicmetanvidiagoogle-deepmindsam-altmanmark-zuckerbergjensen-huangdario-amodeichinageopoliticscybersecuritytech-policyfrontier-aiartificial-intelligenceopen-sourcesafety-standardsnational-securitytech-industrygovernment-regulationarms-race

AXIOS (Zachary Basu) - Anthropic's lonely island

Anthropic spent this winter and spring as the darling of America's AI boom, conquering the frontier while casting itself as the industry's moral conscience. - By summer, the Claude maker had found itself alone on an island of its own principles. Why it matters: Anthropic is simultaneously the world's most valuable startup and its most isolated AI leader. The company's idiosyncrasies have strained its relationship with developers, policymakers and partners as it barrels toward a potential trillion-dollar IPO . Driving the news: Anthropic is the only frontier AI lab that declined to sign an open letter led by Nvidia CEO Jensen Huang urging Washington not to restrict open-weight models, a category currently dominated by China. -…

Besides the open-weight controversy, what other major policy fight is Anthropic involved in regarding the pace of AI development?
Anthropic joined more than 1,100 AI employees from companies like OpenAI, Google DeepMind, and Meta in a petition urging the U.S. government to help develop tools to "deliberately pace" frontier AI development.
Q&A ID 221241ce-0c30-459e-95c9-14288ec49928
What specific accusation has Anthropic made against Chinese labs?
Anthropic has accused Chinese labs of training their lower-cost models on Claude's outputs through what they describe as "industrial-scale distillation campaigns."
Q&A ID de8f94db-59a5-40c5-a957-577bf3eb5b22
What is Anthropic's stance regarding the open-weight models mentioned in the Nvidia CEO's open letter?
Anthropic was the only frontier AI lab to decline signing the open letter led by Nvidia CEO Jensen Huang, which urged Washington not to restrict open-weight models. While CEO Dario Amodei clarified in a blog post that Anthropic has never called for banning open models—calling less capable open models a "public good"—the company still declined to sign the letter.
Q&A ID d3060798-80fe-40d1-afb2-b6835aea28fc
How did Anthropic respond to a White House security vulnerability flag this summer?
Anthropic disputed how serious the vulnerability was, which triggered export controls that forced its Fable and Mythos models offline for nearly three weeks.
Q&A ID 5910c463-015e-4484-940d-583a39944678
Keywordsanthropicclaudeai-regulationopen-weight-modelssilicon-valleyai-ethicsdario-amodeiopenaigoogle-deepmindmetachinaus-ai-policyai-safetyfrontier-aiartificial-intelligencetech-industryipoenterprise-softwareexport-controlspentagonai-guardrailsmachine-learningtechnological-sovereigntytech-regulationcomputing-power

AXIOS (Jim VandeHei) - Behind the Curtain: The AI titans' biggest private fear

We ask almost every AI architect and leader the same thing in private: What AI risk worries you most? - Almost all of them fire back the same response: a killer pathogen, spreading too silently, widely and quickly to stop. Why it matters: The rare agreement among AI experts flows from the belief these advanced models could help a bad actor create a deadly pathogen before the government and industry perfect detection and prevention systems. This isn't a likely scenario. And some of AI's biggest optimists reject doom scenarios. - It's simply a plausible one as AI gets better at understanding our biological vulnerabilities, much like it has our cyber ones inside large nonhuman systems. Driving the news: The experts aren't hedging. In a new…

What is the hypothesized sequence of events for an AI-enabled pathogen outbreak?
The sequence involves a bad actor using a powerful model to map biological vulnerabilities and identify genetic tweaks to make a pathogen more transmissible, harder to detect, or immune to treatments. The model generates candidates using genomic datasets, which are then synthesized using cheap, accessible gene-editing tools. The resulting pathogen could then spread before being detected by existing biosurveillance systems.
Q&A ID 6379fbad-9474-4144-b2c4-aa1ccb31e653
Why do critics express concern regarding the use of open-source AI models in relation to biological threats?
Open-source models can be used and adapted by anyone in private settings outside of any regulatory regime. While frontier models may have more compute power to create something novel, open models fine-tuned by individuals can evade the guardrails that frontier labs might bake into their systems.
Q&A ID c6b518b8-bb5a-4a42-9d7f-797ec1488a6b
Which AI industry leaders recently signed an open letter warning about the risks of AI-derived bioweapons?
Sam Altman (OpenAI), Dario Amodei (Anthropic), Demis Hassabis (Google DeepMind), Mustafa Suleyman (Microsoft), and Alexandr Wang (Meta) cosigned an open letter warning of the risk of AI-derived bioweapons and calling for increased safeguards.
Q&A ID 16a96633-a0c4-49f2-a30e-eb87fcbf7f4e
How do researchers in the MIT FutureTech and University of Queensland study define a "catastrophic" outcome?
Researchers defined a "catastrophic" outcome as an event resulting in more than 1 million deaths or $100 billion in damage. Assisting in the construction of chemical or biological weapons is categorized within this top-ranked risk.
Q&A ID 1bcc3a24-1a18-4dc2-8418-386d2baa7371
Keywordsaiartificial-intelligencebioweaponspathogenbiosafetybiosecuritytechrisksafetyopenaisam-altmananthropicdario-amodeigoogle-deepminddemis-hassabismicrosoftmustafa-suleymanmetaalexandr-wangmituniversity-of-queenslandopen-sourcecybersecuritybiological-weaponscatastrophe

AXIOS (Ina Fried) - Google takes the hit in AI's talent war

Google DeepMind lost two high-profile researchers in a week marked by a flurry of departures across major AI labs. Why it matters: The talent wars continue and have intensified at the highest levels as many AI developers believe that artificial general intelligence (AGI) is on the horizon. Driving the news: Noam Shazeer announced last week that he was leaving Google DeepMind for OpenAI. Google previously paid more than $2 billion to acqui-hire Shazeer and part of his Character.ai team. - Shazeer co-authored the pivotal 2017 paper "Attention Is All You Need," which introduced the Transformer architecture — the "T" in ChatGPT. - Two days later, John Jumper, who shared the 2024 Nobel Prize in Chemistry for AlphaFold, said he was also…

Keywordsgoogledeepmindopenaianthropicnoam-shazeerjohn-jumperashish-vaswanicharacteraiessential-aiagitransformernobel-prizetech-talentsilicon-valleyai-researchartificial-intelligencebig-techchip-warcomputingipostartuplab-defectiongoogle-deepmindtech-industrytalent-war

AXIOS (Mike Zapler) - How the Anthropic saga could threaten American AI dominance

The Trump administration says it wants American AI to dominate the world. - But its decision to force Anthropic to abruptly cut off access to one of its most advanced models risks sending foreign governments and companies a very different message: Don't build your future on U.S. AI. Why it matters: As the Trump administration shapes its AI regulatory regime in real time, the precedents it sets could reverberate far beyond an individual showdown with Anthropic. Catch up quick: The last month of AI policymaking has been a blur of zigs and zags by the administration. - First Trump delayed an executive order that would have created a voluntary reporting system for advanced AI releases. He said he didn't want to threaten America's lead over…

Keywordsanthropictrumpchinaainational-securitywhite-houseexport-controlsmythos-5fable-5technology-regulationus-dominanceglobal-competitiontech-sovereigntyeuropean-unioncanadamark-carneydemis-hassabisgoogle-deepmindchina-aiartificial-intelligencesemiconductordata-centergovernment-interventioninnovationgeopolitics