Projects

Alignment Research Dataset

Regularly scrapes all major sources of alignment data for use by the AI Safety Chatbot and other projects. Currently needs someone to maintain it. Search "alignment research dataset" on Hugging Face for details.

Contact

Olivier Coutu

coutu.olivier@gmail.com

Status

Active

AI Safety Quest

Volunteer organization helping new people navigate the AI safety ecosystem, connect with like-minded people, and find projects that are a good fit for their skills. Seeking a webmaster, social media manager, and volunteer recruiter. Website: aisafety.quest

Contact

AI Safety Quest

hello@aisafety.quest

Status

Active

AI Safety Project

An open source website aimed at highlighting the key risks and challenges associated with AI development, and to share potential solutions. Contributions and suggestions welcome! Website: dunchead.github.io/ai-safety

Contact

Duncan Rickelton

duncanrickelton@yahoo.co.uk

Status

Active

AI Safety Research Map

An interactive tree-like map of AI safety research designed to make the research landscape more navigable. Looking for writers, programmers, and people to give feedback. Website: airesearchmaps.com

Contact

Myles Heller

mylesheller@icloud.com

Status

Active

Network of High Impact Spaces

Create multiple off-grid coliving and coworking spaces in reasonably secure, low-cost places around the world that are relatively resilient to global catastrophes. Coordinate with Centre for Enabling EA Learning & Research (CEEALAR) and Bunker in Paradise.

Contact

Center for Existential Safety

hello@existentialsafety.org

Status

Seeking owner

Comprehensive AI Risk Understanding Assessment

Create a comprehensive test of a person's understanding of AI risks. Include brief (30 second), moderate (3-10 minute), and thorough (11-30 minute) versions. See Clearer Thinking Artificial Intelligence Quiz and Clearer Thinking Long-Term Future Quiz.

Contact

Center for Existential Safety

hello@existentialsafety.org

Status

Seeking owner

Directory of AI safety research teams

This would help researchers find collaborators and provide inspiration for more people to start teams. It could be as simple as a spreadsheet, although keeping it up to date would be important.

Contact

Olamide Florence Adeoye

florenceoade@gmail.com

Status

Active

Existential Safety Quantified Expertise Ranking

Create a “Lifetime Contribution” metric defining the number of hours someone has invested in existential/catastrophic risk reduction. This would serve as a rough objective proxy for the person’s foresight, agency, and altruism.

Contact

Center for Existential Safety

hello@existentialsafety.org

Status

Seeking owner

“Most Likely Ways to Die” Campaign

Create a research-based website that ranks the most likely ways an average person living today will die. Rogue AI and AI-developed bioweapons would likely be at the top, with more well-known causes lower. Coordinate with How We Die.

Contact

Center for Existential Safety

hello@existentialsafety.org

Status

Seeking owner

Enhancing the AI safety ecosystem via debates

Our epistemics and mutual understanding could be improved with regular debates/adversarial collaborations between alignment researchers who disagree on particular topics. We need a platform to facilitate this.

Contact

Matthew Baggins

bagginsmatthew@gmail.com

Status

Seeking owner

Existential Risk Awareness Realization Guide

Research the stages of understanding of existential risk awareness, then publish broadly. Coordinate with CFAR and Upgradable for rationality development insights.

Contact

Center for Existential Safety

hello@existentialsafety.org

Status

Seeking owner

Collective Action for Existential Safety (CAES)

An initiative aiming to catalyze collective action to ensure humanity survives this decade, serving all existential safety advocates globally. Looking for: co-founders, dedicated volunteers, and feedback on the main and associated sites. Website: existentialsafety.org

Contact

Collective Action for Existential Safety

hello@existentialsafety.org

Status

Active

Stampede Discord Bot

Stampede is an Elixir chatbot framework that can serve multiple servers and services simultaneously. It's now time to start making the plugins which Robert Miles Discord members will be using daily, and the project is in need of a new dev to take over.

Contact

Matt Wilson

ProducerMatt42@gmail.com

Status

Active

Existential Risk from AI Calculator

Develop existing quantitative models of existential risks in a professional, public-facing website so they are easy enough for the general public and policymakers to use, then publish broadly. Coordinate with Existential Risks from AI.

Contact

Center for Existential Safety

hello@existentialsafety.org

Status

Seeking owner

PhD pairing platform

Many people are seeking PhD opportunities or supervisors to guide their work, and there are presumably also supervisors seeking PhD students. Creating a dedicated platform for PhD pairing could facilitate them finding each other and have a cascading impact.

Contact

Madhusudhan Pathak

myspycompanyid@gmail.com

Status

Seeking owner

AISafety.com

Website (this one!) serving as the hub for resources for the AI safety community. Seeking assistance with user testing and research, promotion, SEO, and non-CSS development. Website: aisafety.com

Contact

Bryce Robertson

bryceerobertson@gmail.com

Status

Active

Third Opinion

Nonprofit seeking volunteers to help them run their social media, ideally with a background in AI journalism, a strong grasp of AI concepts, and an interest in discussions involving AI professionals addressing critical public concerns. Website: third-opinion.org

Contact

OAISIS

collaborate@oais.is

Status

Active

Unified AI Safety feed

A feed for AI safety content, personalized to optimise for intellectual growth. Seeking volunteers with expertise in web frontends or recommender engines, or designers with expertise in UX design and user reviews, to build the feed better and sooner.

Contact

John Beshir

john@beshir.org

Status

Active

Politicians on AI Safety (PAIS)

A nonpartisan website tracking political candidates’ AI policy stances across three categories: mundane, geopolitical, and existential risks. Seeking help with both web development and research. Website: politiciansonaisafety.org

Contact

Liam Robins

liamhrobins@gmail.com

Status

Paused

AI-Plans

Ranked and scored contributable compendium of alignment plans and their problems. Currently seeking volunteers to submit alignment plans and participate in critique-athons, as well as a designer to improve the site. Website: ai-plans.com

Contact

Kabir Kumar

kabir03999@gmail.com

Status

Active

Givewiki

Crowdsourced charity evaluator, helping people find or promote the best AI safety projects (as well as projects in other cause areas). Currently seeking volunteers to help market and grow the platform.

Contact

Givewiki

hi@givewiki.org

Status

Active

Alignment transcription service

Some approaches to solving alignment involve teaching ML systems about alignment and getting assistance from them. It may be useful to capture conversations between researchers and use them to expand our dataset of alignment content to train models on. 

Contact

Bryce Robertson

bryceerobertson@gmail.com

Status

Paused

AlignmentSearch

Conversational agent informed by the Alignment Research Dataset. This project served as a foundation for the AISafety.info chatbot, which is built and maintained by Rob Miles's volunteer team.

Contact

AI Alignment McGill

alignmentmcgill@gmail.com

Status

Active

Global AI Moratorium

A project to raise awareness of existential risk from AI and push governments to address it by implementing a global moratorium on large AI training runs until alignment is solved. Website: moratorium.ai

Contact

Mikhail Samin

ms@contact.ms

Status

Active

AI safety quotes

Create a list of quotes by notable people supporting AI safety, easily searchable to be used for different situations. This has been suggested by multiple AI safety communications people. See pauseai.info/quotes for something similar.

Contact

Agustín Covarrubias

agus@aisuc.dev

Status

Seeking owner

An international network for AI safety

Found an organization similar to ENAIS that tracks and connects people and organizations doing valuable work in AI safety. Could share a database with ENAIS but use more international branding. Might connect many national organizations. 

Contact

Bryce Robertson

bryceerobertson@gmail.com

Status

Seeking owner

A guide to living frugally, optimized for the AI safety field

The more frugally people live, the more independent they are from requiring a day job. In addition, the same amount of grantmaker money could support a larger number of individuals, enabling us to do more research per dollar.

Contact

Beatricz Emmanuel

beatricz.emmanuel@gmail.com

Status

Active

AISafety.info

Intended to be a single point of access for learning about AI safety, created by Rob Miles's volunteer team. Currently seeking volunteers to write/edit content and help implement the ongoing redesign. Website: aisafety.info

Contact

Algon

algon33.ar@googlemail.com

Status

Active

EA Gather

An always-active virtual coworking environment and social space – especially valuable for networking and collaboration. Seeking volunteers to be present on the platform and introduce new people to the space as they arrive.

Contact

Sasha Cooper

jinksy@gmail.com

Status

Active

Facilitate people transitioning from capabilities research to safety research

Increasing the ratio of AI safety to AI capabilities researchers seems like a core way to reduce existential risk from AI. Given their experience, helping capabilities researchers switch to AI safety could be especially effective.

Contact

Bryce Robertson

bryceerobertson@gmail.com

Status

Seeking owner

AI safety PhD cohorts

Collect and connect everyone interested in AI safety who is applying for a PhD each year. Put them in a Slack/Discord together and facilitate the effort to look into different programs and share information with each other. 

Contact

Bryce Robertson

bryceerobertson@gmail.com

Status

Seeking owner

Reading What We Can

Collects public materials (mostly books and longform meta papers) on various topics related to AI safety and makes it easy for individuals to read through them as part of a challenge. Seeking volunteers to improve the project. Website: readingwhatwecan.com

Contact

Esben Kran

esben@apartresearch.com

Status

Active