🔬

Pessimism About Unknown Unknowns Inspires Conservatism

📅 2020
technical research breakthrough
⚪ Common
#ai #conservatism (ai)

📖 Description

[This](https://mkcohen-hosted-files.s3-us-west-1.amazonaws.com/Pessimism_alignmentforum.pdf) [EDIT: [final version](https://proceedings.mlr.press/v125/cohen20a/cohen20a.pdf), [presentation](https://www.learningtheory.org/colt2020/virtual/papers/paper_221.html)] is a design for a conservative agent that I worked on with Marcus Hutter. Conservative agents are reluctant to make unprecedented things happen. The agent also approaches at least human-level reward acquisition.

📊 Game Impacts

Variable Change Condition
Research +15 Always
Vibey Doom +2 Always
Ethics Risk -5 Always

💭 Reactions

🔬 Safety Researcher Reaction: ⚠️ Placeholder - Needs Real Quote
"Useful research for the community"
📰 Media Reaction: ⚠️ Placeholder - Needs Real Quote
"Discussed in AI safety community"
💡 Found a Real Quote? Suggest it here

🔗 Sources

🏷️ Event Metadata

Think this event's metadata could be improved? Suggest changes to category, rarity, tags, game impacts, or p(doom) effects.

📁 Category Technical Research Breakthrough → Suggest different category
⭐ Rarity ⚪ Common → Suggest different rarity
🏷️ Tags (2) ai, conservatism (ai) → Suggest tag changes
📊 Game Impacts (3) 3 variable changes → Suggest impact changes
☢️ p(Doom) Impact No direct impact → Suggest p(doom) change
📝 General Metadata Year, description, reactions → Comprehensive review

🤝 Found an Issue?

This event data is sourced from the pdoom-data repository. If you notice errors or want to suggest improvements:

GitHub Issue (Preferred) 📧 Email (No GitHub)
← Back to All Events