📜

Truthful LMs as a warm-up for aligned AGI

📅 2022

policy development

🔵 Rare

#ai #ai risk #gpt #honesty #language models #machine learning (ml) #outer alignment #truth, semantics, & meaning

📖 Description

*This post is heavily informed by prior work, most notably that of Owain Evans, Owen Cotton-Barratt and others (*[*Truthful AI*](https://www.alignmentforum.org/posts/aBixCPqSnTsPsTJBQ/truthful-ai-developing-and-governing-ai-that-does-not-lie)*), Beth Barnes (*[*Risks from AI persuasion*](https://www.alignmentforum.org/posts/5cWtwATHL6KyzChck/risks-from-ai-persuasion)*), Paul Christiano (unpublished) and Dario Amodei (unpublished), but was written by me and is not necessarily endorsed by those people. I am also very grateful to Paul Christiano, Leo Gao, Beth Barnes, William Saunders, Owain Evans, Owen Cotton-Barratt, Holly Mandel and Daniel Ziegler for invaluable feedback.*

📊 Game Impacts

Variable	Change	Condition
Research	+5	Always
Vibey Doom	+5	Always
Ethics Risk	-5	Always

💭 Reactions

🔬 Safety Researcher Reaction: ⚠️ Placeholder - Needs Real Quote
"This is a significant contribution to alignment research"

📰 Media Reaction: ⚠️ Placeholder - Needs Real Quote
"Discussed in AI safety community"

💡 Found a Real Quote? Suggest it here

🔗 Sources

[1] https://www.alignmentforum.org/posts/jWkqACmDes6SoAiyE/truthful-lms-as-a-warm-up-for-aligned-agi

🏷️ Event Metadata

Think this event's metadata could be improved? Suggest changes to category, rarity, tags, game impacts, or p(doom) effects.

📁 Category Policy Development → Suggest different category

⭐ Rarity 🔵 Rare → Suggest different rarity

🏷️ Tags (8) ai, ai risk, gpt, honesty, language models, machine learning (ml), outer alignment, truth, semantics, & meaning → Suggest tag changes

📊 Game Impacts (3) 3 variable changes → Suggest impact changes

☢️ p(Doom) Impact No direct impact → Suggest p(doom) change

📝 General Metadata Year, description, reactions → Comprehensive review

🤝 Found an Issue?

This event data is sourced from the pdoom-data repository. If you notice errors or want to suggest improvements:

GitHub Issue (Preferred) 📧 Email (No GitHub)

← Back to All Events