Brainstorm of things that could force an AI team to burn their lead

📖 Description

| | | --- | | **Comments:** The following is a list (very lightly edited with help from Rob Bensinger) I wrote in July 2017, at Nick Beckstead's request, as part of a conversation we were having at the time. From my current vantage point, it strikes me as narrow and obviously generated by one person, listing the first things that came to mind on a particular day.I worry that it's easy to read the list below as saying that this narrow slice, all clustered in one portion of the neighborhood, is a very big slice of the space of possible ways an AGI group may have to burn down its lead.This is one of my models for how people wind up with really weird pictures of MIRI beliefs. I generate three examples that are clustered together because I'm bad at generating varied examples on the fly, while hoping that people can generalize to see the broader space these are sampled from; then people think I've got a fetish for the particular corner of the space spanned by the first few ideas that pop...

📊 Game Impacts

💭 Reactions

🔗 Sources

• [1] https://www.alignmentforum.org/posts/p3s8RvkcyTwzu27ps/brainstorm-of-things-that-could-force-an-ai-team-to-burn