📜

The Solomonoff Prior is Malign

📅 2020
policy development
⚪ Common
#ai #distillation & pedagogy #inner alignment #priors #solomonoff induction

📖 Description

This argument came to my attention from [this post](https://ordinaryideas.wordpress.com/2016/11/30/what-does-the-universal-prior-actually-look-like/) by Paul Christiano. I also found [this clarification](https://www.lesswrong.com/posts/jP3vRbtvDtBtgvkeb/clarifying-consequentialists-in-the-solomonoff-prior) helpful. I found [these counter-arguments](https://www.lesswrong.com/posts/Ecxevhvx85Y4eyFcu/weak-arguments-against-the-universal-prior-being-malign) stimulating and have included some discussion of them.

📊 Game Impacts

Variable Change Condition
Research +10 Always

💭 Reactions

🔬 Safety Researcher Reaction: ⚠️ Placeholder - Needs Real Quote
"Provides general AI context"
📰 Media Reaction: ⚠️ Placeholder - Needs Real Quote
"Discussed in AI safety community"
💡 Found a Real Quote? Suggest it here

🔗 Sources

🏷️ Event Metadata

Think this event's metadata could be improved? Suggest changes to category, rarity, tags, game impacts, or p(doom) effects.

📁 Category Policy Development → Suggest different category
⭐ Rarity ⚪ Common → Suggest different rarity
🏷️ Tags (5) ai, distillation & pedagogy, inner alignment, priors, solomonoff induction → Suggest tag changes
📊 Game Impacts (1) 1 variable changes → Suggest impact changes
☢️ p(Doom) Impact No direct impact → Suggest p(doom) change
📝 General Metadata Year, description, reactions → Comprehensive review

🤝 Found an Issue?

This event data is sourced from the pdoom-data repository. If you notice errors or want to suggest improvements:

GitHub Issue (Preferred) 📧 Email (No GitHub)
← Back to All Events