Aziz et al. Paper Summaries • 59 implied HN points • 20 Mar 24
- Step Back Prompting helps models think about big ideas before answering questions. This method shows better results than other prompting techniques.
- Even with Step Back Prompting, models still find it tricky to put all their reasoning together. Many errors come from the final reasoning step which can be complicated.
- Not every question works well with Step Back Prompting. Some questions need quick, specific answers instead of a longer thought process.