Commissioned for this museum · after Wei et al., 2022
The Long Way Round
English·2022·15 lines·501 bytes
Answer the question below.
Before answering, work through it in steps. Put each step on its own
line. Do not skip a step because it seems obvious, and where a step
rests on an assumption, name the assumption on that line.
When the steps are finished, write a line beginning "Answer:" and put
the answer there and nowhere else.
If the steps do not reach an answer, write "Answer: the steps do not
settle this" and say which one failed. Do not fill the gap by guessing.
---
Question: {{ question }}Curator’s note
An instruction to take longer, which is a strange thing to ask a machine and turns out to be the point.
A model produces its answer one piece at a time, and each piece is conditioned on the pieces before it. Asking for the steps first is therefore not a request for an explanation of an answer already decided. It changes what the answer is conditioned on, because the steps are written before the answer and the answer reads them.
That is why the request has to come before the question and not after. "Explain your reasoning" asked at the end produces a justification of whatever was said first, which is a different and much less useful thing.
Two of the four instructions are about honesty rather than reasoning. "Name the assumption on that line" makes visible the places where a step is resting on something unstated, which is where the wrong answers live. And the last paragraph gives failure somewhere to go: without a sanctioned way to say the steps did not settle it, the only available move is to produce something that looks like an answer.
Wei and colleagues named this in 2022 and the phrase that spread from it — think step by step — is the least interesting part. The technique is not an incantation. It is putting the work before the conclusion and then holding the conclusion to it.