📢

A simple example of conditional orthogonality in finite factored sets

📅 2021
public awareness
⚪ Common
#ai #finite factored sets #rationality

📖 Description

Recently, MIRI researcher Scott Garrabrant has [publicized his work on finite factored sets](https://www.lesswrong.com/s/kxs3eeEti9ouwWFzr/p/N5Jm6Nj4HkNKySA5Z). It allegedly offers a way to understand agency and causality in a set-up like the [causal graphs championed by Judea Pearl](https://en.wikipedia.org/wiki/Causal_graph). Unfortunately, the [definition of conditional orthogonality](https://www.lesswrong.com/s/kxs3eeEti9ouwWFzr/p/N5Jm6Nj4HkNKySA5Z#2b__Conditional_Orthogonality) is very confusing. I'm not aware of any public examples of people demonstrating that they understand it, but I didn't really understand it until an hour ago, and I've heard others say that it went above their heads. So, I'd like to give an example of it here.

📊 Game Impacts

Variable Change Condition
Research +10 Always
Vibey Doom +2 Always
Ethics Risk -5 Always

💭 Reactions

🔬 Safety Researcher Reaction: ⚠️ Placeholder - Needs Real Quote
"Adds to our knowledge base"
📰 Media Reaction: ⚠️ Placeholder - Needs Real Quote
"Discussed in AI safety community"
💡 Found a Real Quote? Suggest it here

🔗 Sources

🏷️ Event Metadata

Think this event's metadata could be improved? Suggest changes to category, rarity, tags, game impacts, or p(doom) effects.

📁 Category Public Awareness → Suggest different category
⭐ Rarity ⚪ Common → Suggest different rarity
🏷️ Tags (3) ai, finite factored sets, rationality → Suggest tag changes
📊 Game Impacts (3) 3 variable changes → Suggest impact changes
☢️ p(Doom) Impact No direct impact → Suggest p(doom) change
📝 General Metadata Year, description, reactions → Comprehensive review

🤝 Found an Issue?

This event data is sourced from the pdoom-data repository. If you notice errors or want to suggest improvements:

GitHub Issue (Preferred) 📧 Email (No GitHub)
← Back to All Events