📢

Draft report on existential risk from power-seeking AI

📅 2021
public awareness
⚪ Common
#ai #instrumental convergence

📖 Description

I've written a draft report evaluating a version of the overall case for existential risk from misaligned AI, and taking an initial stab at quantifying the risk from this version of the threat. I've made the draft viewable as a public google doc [here](https://docs.google.com/document/d/1smaI1lagHHcrhoi6ohdq3TYIZv0eNWWZMPEy8C8byYg/edit#) (Edit: arXiv version [here](https://arxiv.org/abs/2206.13353), video presentation [here](https://harvard.zoom.us/rec/play/kZc6rR2Ynx6z_J4rmmJUaq12-AcVDZLlY9eniU5ZKioodJm_yJORyy9UiLI8zFRuQvfLDAYO3j5TPciD.WSBvvCvXIto0mF4w?continueMode=true&_x_zm_rtaid=4hUT6sI8R4GPtHZS-tZBXg.1651957013327.8c9781863a967470f7270aa15ef4c1f4&_x_zm_rhtaid=917), human-narrated audio version [here](https://joecarlsmithaudio.buzzsprout.com/2034731/12113681-is-power-seeking-ai-an-existential-risk)). Feedback would be welcome.

📊 Game Impacts

Variable Change Condition
Research +5 Always
Vibey Doom +2 Always

💭 Reactions

🔬 Safety Researcher Reaction: ⚠️ Placeholder - Needs Real Quote
"Interesting perspective on safety challenges"
📰 Media Reaction: ⚠️ Placeholder - Needs Real Quote
"Discussed in AI safety community"
💡 Found a Real Quote? Suggest it here

🔗 Sources

🏷️ Event Metadata

Think this event's metadata could be improved? Suggest changes to category, rarity, tags, game impacts, or p(doom) effects.

📁 Category Public Awareness → Suggest different category
⭐ Rarity ⚪ Common → Suggest different rarity
🏷️ Tags (2) ai, instrumental convergence → Suggest tag changes
📊 Game Impacts (2) 2 variable changes → Suggest impact changes
☢️ p(Doom) Impact No direct impact → Suggest p(doom) change
📝 General Metadata Year, description, reactions → Comprehensive review

🤝 Found an Issue?

This event data is sourced from the pdoom-data repository. If you notice errors or want to suggest improvements:

GitHub Issue (Preferred) 📧 Email (No GitHub)
← Back to All Events