RE2 (prompt repetition) is a simple technique that significantly improves LLM performance by duplicating the input prompt. This workaround addresses causal masking in transformer architectures, where models can't see the end of a prompt while processing the beginning. By pasting the prompt twice, the second copy can attend to Show more