Prompt Engineering is an empirical science and the effect of prompt engineering methods can vary a lot among models. This post only focuses on prompt engineering for autoregressive language models, so nothing with Cloze tests, image generation or multimodality models. At its core, the goal of Prompt engineering is about alignment and model steerability.

18m read timeFrom lilianweng.github.io
Post cover image
Table of contents
Basic Prompting #Instruction Prompting #Self-Consistency Sampling #Chain-of-Thought (CoT) #Automatic Prompt Design #Augmented Language Models #Citation #References #

Sort: