Skip to main content

Overview

How do we remove irrelevant information from the prompt? The S2A (System 2 Attention) technique auto-refines a prompt by asking the model to rewrite the prompt to include only relevant information. We implement this in two steps:
  1. Ask the model to rewrite the prompt
  2. Pass the rewritten prompt back to the model

Example

References

  1. System 2 Attention (is something you might need too)