Solving Probability and Statistics Problems by Program Synthesis
π Description
Solving Probability and Statistics Problems by Program Synthesis Leonard Tang Harvard University MathematicsElizabeth Ke MIT MathematicsNikhil Singh MIT Media Lab Nakul Verma Columbia University Computer Science DepartmentIddo Drori MIT EECS Abstract We solve university level probability and statis- tics questions by program synthesis using OpenAI?s Codex, a Transformer trained on text and ?ne-tuned on code. We transform course problems from MIT?s 18.05 Introduc- tion to Probability and Statistics and Harvard?s STAT110 Probability into programming tasks. We then execute the generated code to get a solution. Since these course questions are grounded in probability, we often aim to have Codex generate probabilistic programs that simulate a large number of probabilistic depen- dencies to compute its solution. Our approach requires prompt engineering to transform the question from its original form to an explicit, tractable form that results in a correct program and solution. To estimat...
π Game Impacts
Not verified in gameWhich variables this event was proposed to move, and in which direction. The magnitudes are held in the corpus but are not shown here, because they have not been verified against the shipped game. They come from pdoom-data. They describe what an event was proposed to do, not what the shipped game does with it. Most events in the corpus are flavour: they are shown for colour and do not move any game variable. Only a small minority reach the systems below, and several of the variables listed here are not read by the game at all yet. Treat this table as a design proposal under review, not as a measurement of play. Corrections and arguments are welcome — the suggestion links at the foot of this page go straight to the data repo.
| Variable | Direction | Condition |
|---|---|---|
| Research | proposed: up | Always |
| Papers | proposed: up | Always |
| Vibey Doom | proposed: up | Always |
π Reactions
"Advances our understanding of AI safety"
"Academic research release"
π Sources
π€ Found an Issue?
This event data is sourced from the pdoom-data repository. If you notice errors or want to suggest improvements:
GitHub Issue (Preferred) π§ Email (No GitHub)