Unprompted Unfaithful Chain of Thought Dataset Project

11th edition of AI Safety Camp

Cost-efficiently support new careers and new organisations in AI Safety.

More Detailed Cyber Kill Chain For AI Control Evaluation

Extending an AI control evaluation to include vulnerability discovery, weaponization, and payload creation

LLM Approximation to Pass@K

SafePlanBench: evaluating a Guaranteed Safe AI Approach for LLM-based Agents

Seeking funding to develop and evaluate a new benchmark for systematically assesing safety of LLM-based agents

Coalition for a Baruch Plan for AI

Catalyzing a uniquely bold, timely and effective treaty-making process for AI

Pilot for new benchmark by Epoch AI

For tracking and predicting future AI progress to AGI

Help me to attend a spring school on AI that I am coorganising

Travel/Accommodation support for a lead coorganiser of the Ethos+Tékhnē spring school

AI Safety & Security workshop with Adversarial Simulation labs

Workshop focused on AI Security attacks and defense use-cases through a Capture-the-flag style Adversarial simulation labs.

Shallow review of cost-effectivness of technical AI safety orgs

Do ACE-style cost-effectivness analysis of technical AI safety orgs.

Arkose

AI safety outreach to experienced machine learning professionals

Act I: Exploring emergent behavior from multi-AI, multi-human interaction

Community exploring and predicting potential risks and opportunities arising from a future that involves many independently controlled AI systems

Finishing The SB-1047 Documentary

How California became ground zero in the global debate over who gets to shape humanity's most powerful technology

Mechanistic Interpretability research for unfaithful chain-of-thought (1 month)

Iván and Jett are seeking funding to research unfaithful chain-of-thought, under Arthur Conmy's mentorship, for a month before the start of MATS.

AI safety fieldbuilding in Warsaw, Poland (funding for 1 semester)

Reach the university that trained close to 20% of OpenAI early employees

80,000 Hours

We provide research and support to help people move into careers that effectively tackle the world’s most pressing problems.

Lightcone Infrastructure

Funding for LessWrong.com, the AI Alignment Forum, Lighthaven and other Lightcone Projects

PIBBSS - General Programs funding or specific funding

Fund unique approaches to research, field diversification, and scouting of novel ideas by experienced researchers supported by PIBBSS research team

Horizon Events 2025

Non-profit facilitating progress in AI safety R&D through events

Apart Research: Research and Talent Acceleration

Support the growth of an international AI safety research and talent program