Showing posts with label AI risks. Show all posts
Showing posts with label AI risks. Show all posts

Wednesday, October 28, 2026

Anthropic IPO filing warns some risks may be uninsurable. AI coverage will be issue for every company; CNBC, October 28, 2026

Kevin Williams, CNBC; Anthropic IPO filing warns some risks may be uninsurable. AI coverage will be issue for every company

"Anthropic’s IPO filing includes many words covering many risks, from IP theft to security incidents, data loss, climate change, rogue agents and all the way to an existential crisis for humanity. Embedded in all of the risk language are basic questions about insurance: What’s going to be covered? Is it even possible to provide a policy for all of the ways that AI could go wrong? Anthropic, even with more cash than almost any company in America, couldn’t answer that question with confidence."

Monday, October 12, 2026

 , The Guardian ; AI less regulated than milk, Microsoft president says in warning over safety

"Artificial intelligence is less regulated than milk and washing machines, the president of Microsoft has said, as the tech industry warns over the safety of AI.

Brad Smith said there should be more safety rules to govern the technology including a legal obligation to a “victim” if their system was breached by rogue AI agents.

He told the BBC: “Right now, your washing machine is subject to more safety rules than AI. Every carton of milk that you see in the grocery store is subject to safety rules and inspection.”

There are growing calls from experts, politicians and regulators for tougher rules to control AI, as well as warnings from Anthropic, Google DeepMind and OpenAI that the pace of the technology’s development should slow.

Smith said AI could be a “tool and a weapon” that should be regulated urgently.

Companies needed “emergency brakes”, also known as “kill switches”, to pause or slow down AI if it grew out of control, he told the BBC."

Thursday, October 8, 2026

Peter Thiel's new Antichrist warnings; Politico Decoded, October 8, 2026

 CALDER MCHUGH,  BRENDAN BORDELON,  CHRISTINE MUI and  SAM SUTTON , Politico Decoded; Peter Thiel's new Antichrist warnings

"Tech billionaire Peter Thiel is sharpening his warnings about the Antichrist — which he sees as a force that could harm technological development — according to exclusive recordings obtained by Calder. His new comments come as AI races ahead and public concern over its risks grow.

Thiel began a closed four-part lecture series in Nashville last week, returning to a theme he explored in San Francisco last year before taking similar talks to Paris and Rome. Nashville is emerging as a hub for the tech right.

Decoded obtained recordings of his first two Nashville lectures, delivered on Sept. 28 and Oct. 5, and compared them to exclusive transcripts of his San Francisco talks. The structure is largely unchanged, and Thiel invokes religion to argue that regulation of the AI industry is evil — a notion that has taken hold among key factions of Silicon Valley investors."

Thursday, September 17, 2026

Tuesday, August 18, 2026

She told no one about her agony except ChatGPT. What her death reveals about AI risks; NPR, August 18, 2026

 , NPR; She told no one about her agony except ChatGPT. What her death reveals about AI risks 

"What Reiley didn't know then was that her daughter had been sharing all her inner struggles with an artificial intelligence chatbot: a ChatGPT therapist named Harry. She learned this months later when her daughter's best friend visited Ithaca and asked to see her laptop, and "found this trove, this months-long trove of communication with this chat bot," says Reiley, who has shared the nearly 1,800-page long interaction with NPR.

Rapid adoption, unknown risks

Rottenberg was among a growing number of Americans turning to general use chatbots like ChatGPT and Claude for mental health support, even though they are not marketed or regulated as a healthcare technology. One recent survey by the Bipartisan Policy Center found that 3 in 10 adults use digital tools for mental health, including chatbots. Another 2026 study in JAMA Pediatrics found that as many as 1 in 5 teens and young adults do the same."

Monday, January 26, 2026

Behind the Curtain: Anthropic's warning to the world; Axios, January 26, 2026

 Jim VandeHei, Mike Allen, Axios; Behind the Curtain: Anthropic's warning to the world

"Anthropic CEO Dario Amodei, the architect of the most powerful and popular AI system for global business, is warning of the imminent "real danger" that super-human intelligence will cause civilization-level damage absent smart, speedy intervention.

  • In a 38-page essay, shared with us in advance of Monday's publication, Amodei writes: "I believe we are entering a rite of passage, both turbulent and inevitable, which will test who we are as a species."

  • "Humanity is about to be handed almost unimaginable power, and it is deeply unclear whether our social, political, and technological systems possess the maturity to wield it."

Why it matters: Amodei's company has built among the most advanced LLM systems in the world. 


  • Anthropic's new Claude Opus 4.5 and coding and Cowork tools are the talk of Silicon Valley and America's C-suites. 

  • AI is doing 90% of the computer programming to build Anthropic's products, including its own AI.

Amodei, one of the most vocal moguls about AI risk, worries deeply that government, tech companies and the public are vastly underestimating what could go wrong. His memo — a sequel to his famous 2024 essay, "Machines of Loving Grace: How AI Could Transform the World for the Better" — was written to jar others, provoke a public debate and detail the risks.


  • Amodei insists he's optimistic that humans will navigate this transition — but only if AI leaders and government are candid with people and take the threats more seriously than they do today.

Amodei's concerns flow from his strong belief that within a year or two, we will face the stark reality of what he calls a "country of geniuses in a datacenter.""

Thursday, October 17, 2024

Californians want controls on AI. Why did Gavin Newsom veto an AI safety bill?; The Guardian, October 16, 2024

 Garrison Lovely, The Guardian; Californians want controls on AI. Why did Gavin Newsom veto an AI safety bill? 

"I’m writing a book on the economics and politics of AI and have analyzed years of nationwide polling on the topic. The findings are pretty consistent: people worry about risks from AI, favor regulations, and don’t trust companies to police themselves. Incredibly, these findings tend to hold true for both Republicans and Democrats.

So why would Newsom buck the popular bill?

Well, the bill was fiercely resisted by most of the AI industry, including Google, Meta and OpenAI. The US has let the industry self-regulate, and these companies desperately don’t want that to change – whatever sounds their leaders make to the contrary...

The top three names on the congressional letter – Zoe Lofgren, Anna Eshoo, and Ro Khanna – have collectively taken more than $4m in political contributions from the industry, accounting for nearly half of their lifetime top-20 contributors. Google was their biggest donor by far, with nearly $1m in total.

The death knell probably came from the former House speaker Nancy Pelosi, who published her own statement against the bill, citing the congressional letter and Li’s Fortune op-ed.

In 2021, reporters discovered that Lofgren’s daughter is a lawyer for Google, which prompted a watchdog to ask Pelosi to negotiate her recusal from antitrust oversight roles.

Who came to Lofgren’s defense? Eshoo and Khanna.

Three years later, Lofgren remains in these roles, which have helped her block efforts to rein in big tech – against the will of even her Silicon Valley constituents.

Pelosi’s 2023 financial disclosure shows that her husband owned between $16m and $80m in stocks and options in Amazon, Google, Microsoft and Nvidia...

Sunny Gandhi of the youth tech advocacy group Encode Justice, which co-sponsored the bill, told me: “When you tell the average person that tech giants are creating the most powerful tools in human history but resist simple measures to prevent catastrophic harm, their reaction isn’t just disbelief – it’s outrage. This isn’t just a policy disagreement; it’s a moral chasm between Silicon Valley and Main Street.”

Newsom just told us which of these he values more."