Chain-of-Draft: Reasoning with 80% Less Inference Time

TL;DR;

The paper introduces Chain-of-Draft (CoD), a new prompting strategy that uses short, dense drafts for each reasoning step, achieving 91% accuracy on GSM8k with ~80% fewer tokens than Chain-of-Thought (CoT).