Stay informed

AI Alignment Forum (AF)

Hub for researchers to discuss ideas related to ensuring that transformatively powerful AIs are aligned with human values. Discussion ranges from technical models of agency to the strategic landscape, and everything in between.

Type

Forum

LessWrong (LW)

Online forum dedicated to improving human reasoning, containing a lot of AI safety content. AI Alignment Forum posts are cross-posted here so anyone, not just approved researchers, can engage with the research.

Type

Forum

Dwarkesh Podcast

Well-researched interviews with influential intellectuals going in-depth on AI, technology, and their broader societal implications. Hosted by Dwarkesh Patel.

Type

Podcast

Robert Miles AI Safety

Visually-rich explanations of AI safety concepts – highlighting risks, clarifying advanced topics, and advocating for responsible development.

Type

YouTube channel

Rational Animations

Animated videos aiming to foster good thinking, promote altruistic causes, and help ensure humanity's future goes well – particularly regarding AI safety.

Type

YouTube channel

AI Explained

YouTuber discussing the latest AI developments as they happen, offering clear explanations and in-depth analysis of important research and events.

Type

YouTube channel

AISafety.com Reading Group

Fortnightly meetings beginning with a presentation summarizing a recent AI safety paper or article, followed by group discussion. The presentations are posted to YouTube.

Type

YouTube channel

The Inside View

Interviews with AI safety researchers, explainers, fictional stories of concrete threat models, and paper walk-throughs.

Type

YouTube channel

Siliconversations

YouTube channel explaining (among other things) AI safety concepts through entertaining stickman videos.

Type

YouTube channel

AI X-risk Research Podcast (AXRP)

Interviews with technical AI safety researchers about their research, aiming to get a sense of why it was written and how it might reduce existential risk from AI.

Type

Podcast

AI Safety Events & Training

Weekly summaries of newly-announced events and training programs in the AI safety space – both online and in-person.

Type

Newsletter

Don't Worry about the Vase

Blog by Zvi Mowshowitz on various topics including AI, generally with detailed analysis, personal insights, and a rationalist perspective.

Type

Blog

AGI Safety Core

A followable list of accounts on Twitter/X belonging to AI thinkers and organizations that discuss AI safety.

Type

Twitter/X list

AI Policy

A followable Twitter/X list of thoughtful people working on policy to reduce risks and secure benefits from AI.

Type

Twitter/X list

Effective Altruism Forum (EA Forum)

Online forum where individuals dedicated to doing the most good converge to share research, debate ideas, and collaboratively develop strategies for addressing the world’s most pressing challenges – including AI safety.

Type

Forum

Deadly by Default

A primer on existential risk from AI on the Homo Sabiens blog. Lays out the case for concern from start to finish, in language that a smart high-schooler could follow.

Type

Article

The Compendium

Living document aiming to present a coherent worldview explaining the race to AGI and extinction risks and what to do about them – in a way that is accessible to non-technical readers.

Type

Article

Astral Codex Ten (ACX)

Blog covering many topics, including reasoning, science, psychiatry, medicine, ethics, genetics, AI, economics, and politics. Includes book summaries and commentary on AI safety.

Type

Blog

Import AI

Weekly summaries of developments in AI research (including governance) written by Jack Clark, co-founder of Anthropic.

Type

Newsletter

AI Safety in China

Newsletter from Concordia AI, a Beijing-based social enterprise, providing updates on AI safety developments in China.

Type

Newsletter

AI Safety Newsletter

Newsletter from the Center for AI Safety (CAIS) published every few weeks discussing developments in AI and AI safety. No technical background required.

Type

Newsletter

policy.ai

Monthly newsletter by the Centre for Security and Emerging Technology (CSET) covering AI, emerging technology, and security policy.

Type

Newsletter

The EU AI Act Newsletter

Fortnightly newsletter by the Future of Life Institute (FLI) summarizing and analyzing the latest developments surrounding the EU AI law.

Type

Newsletter

The AI Evaluation Substack

A monthly digest of the latest developments, research trends, and key initiatives in the realm of AI evaluation.

Type

Newsletter

ML Safety Newsletter

Monthly-ish newsletter informing readers about the latest research developments in ML safety, focussing on topics such as adversarial robustness, interpretability, and control. Co-written by Dan Hendrycks.

Type

Newsletter

ChinAI

The people with the most knowledge and insight on AI development in China may well be Chinese people themselves who are sharing their insights in Chinese. Jeff Ding provides weekly translations of their writings.

Type

Newsletter

Cold Takes

Blog about transformative AI, futurism, research, ethics, philanthropy etc. by Holden Karnofsky. Includes the "most important century" series, which argues that the 21st century could be the most important ever for humanity.

Type

Blog

Bounded Regret

Blog on AI safety by Jacob Steinhardt, a UC Berkeley statistics professor, analysing risks, forecasting future breakthroughs, and discussing alignment strategies.

Type

Blog

The AI Revolution

Pair of articles by Tim Urban on the website Wait But Why using engaging, accessible explanations and illustrations to explore AI’s potential evolution toward superintelligence and its existential risks for humanity.

Type

Article

If Anyone Builds It, Everyone Dies – Eliezer Yudkowsky & Nate Soares (2025)

Grounded, no-nonsense primer on why building artificial superintelligence using current techniques will predictably lead to human extinction. Currently available for pre-order.

Type

Book

Superintelligence – Nick Bostrom (2014)

Explores how superintelligence could be created and what its features and motivations might be. It argues that, if created, it would be difficult to control and could take over the world in order to accomplish its goals.

Type

Book

The AI Does Not Hate You / The Rationalist's Guide to the Galaxy – Tom Chivers (2019)

Entertaining and accessible outline of the core ideas around AI existential risk, along with an exploration of the community and culture of AI safety researchers.

Type

Book

Uncontrollable – Darren McKee (2023)

Layman’s introduction to AI existential risk, covering how powerful AI systems might become, why superhuman AI might be dangerous, and what we can do to prevent AI from killing billions.

Type

Book

The Precipice – Toby Ord (2020)

Argues that humanity's future is imperiled by modern existential threats – ranging from nuclear weapons and climate change to engineered pathogens and AI – and that coordinated global action is essential to ensure our survival.

Type

Book

Life 3.0 – Max Tegmark (2017)

Explores how advanced AI could fundamentally reshape human civilisation – offering transformative opportunities while also posing profound risks – and argues that we must carefully guide its development.

Type

Book

AI – Roman Yampolskiy (2024)

Argues that because advanced AI is intrinsically unexplainable, unpredictable, and uncontrollable, we currently lack any means to guarantee its alignment – making its development a profound risk for civilisation.

Type

Book

Introduction to AI Safety, Ethics and Society – Dan Hendrycks (2024)

Textbook covering the basics of modern AI, the technical challenges of AI safety, collective action problems, and the challenges of governing AI.

Type

Book

Human Compatible – Stuart Russell (2019)

Explains the problem of making powerful AI compatible with humans. The book discusses potential solutions with an emphasis on the approaches from Stuart Russell's lab, the Center for Human-Compatible AI (CHAI).

Type

Book

The Alignment Problem – Brian Christian (2020)

Comprehensive overview of the challenges that come with attempting to align AI systems, from the perspective of a machine learning researcher.

Type

Book

Chip War – Chris Miller (2022)

An account of the decades-long battle to control what has emerged as the world's most critical resource – microchip technology – with the United States and China increasingly in conflict.

Type

Book

Doom Debates

Channel hosted by Liron Shapira featuring in-depth debates, explainers, and live Q&A sessions, focused on AI existential risk and other implications of superintelligence.

Type

YouTube channel

Dr Waku

Computer science PhD and AI research scientist talking about how AI will likely affect all of us and society as a whole, plus interviews with experts.

Type

YouTube channel

FAR․AI

FAR.AI's channel posts talks given by AI safety experts at various events, covering topics ranging from mechanistic interpretability to evals and governance.

Type

YouTube channel

AI Safety Takes

Blog by AI safety researcher Daniel Paleka curating and succinctly analyzing the latest research and news in AI safety. Posts about every two months.

Type

Blog

Miles's Substack

Blog from ex-OpenAI (now independent) AI policy researcher Miles Brundage on the rapid evolution of AI and the urgent need for thoughtful governance.

Type

Blog

The Power Law

Top forecaster Peter Wildeford forecasts our fast-paced future and discusses AI, national security, innovation, emerging technology, and the powers – real and metaphorical – that shape the world.

Type

Blog

Obsolete

Publication by freelance journalist Garrison Lovely about the intersection of capitalism, geopolitics, and AI. Posts around twice a month.

Type

Blog

Forecasting AI Futures

Forecasting blog for AI safety relevant predictions, written by Alvin Ånestrand. Explores potential scenarios and makes predictions to inform strategies for reducing AI risks.

Type

Blog

The 80,000 Hours Podcast

Interviews with people working on the world’s most pressing problems (especially AI safety), including advice on how you can use your career to help solve them.

Type

Podcast

Future of Life Institute Podcast

In-depth interviews with existential risk researchers, policy experts, philosophers, and a range of other influential thinkers.

Type

Podcast

AI Prospects

Blog by Eric Drexler on AI prospects and their surprising implications for technology, economics, environmental concerns, and military affairs.

Type

Blog

For Humanity

Podcast by John Sherman, a Peabody and Emmy Award-winning former investigative journalist, aiming to speak to regular, non-tech people about the existential threat AGI poses to humanity.

Type

Podcast

The Cognitive Revolution

Biweekly podcast where host Nathan Labenz interviews AI innovators and thinkers, diving into the transformative impact AI will likely have in the near future.

Type

Podcast

The AI Policy Podcast

Podcast from the Center for Strategic & International Studies (CSIS) discussing AI regulation, innovation, national security, and geopolitics.

Type

Podcast

LessWrong podcast

Audio narrations of top LessWrong posts, including all curated posts and posts with at least 125 karma.

Type

Podcast

EA Forum podcast

Audio narrations from the Effective Altruism Forum, including all curated posts and posts with at least 125 karma.

Type

Podcast

Existential risk from artificial intelligence

Wikipedia article providing a broad overview of the idea that advanced AI could pose an existential threat to humanity, covering key arguments about superintelligence, alignment challenges, and potential mitigation strategies.

Type

Article

Preventing an AI-related catastrophe

Article from 80,000 Hours analyzing the existential threat posed by advanced AI and encouraging readers to consider a career in AI safety to address the problem.

Type

Article

Transformer

Weekly briefing and occasional analyses of what matters in AI and AI policy. Written by Shakeel Hashim, ex-news editor at The Economist.

Type

Newsletter

AI Safety Playlist

A carefully curated and regularly updated YouTube playlist to help people gain an understanding of what's going on with AI.

Type

YouTube channel