This playbook by Varun Godbole and Ellie Pavlick provides strategies and best practices for effectively prompting post-trained large language models (LLMs). It covers the concepts of pre-training vs. post-training, considerations for creating prompts, the importance of human annotation, and how to iterate on system instructions. The guide also emphasizes the empirical nature of prompt engineering and offers insights into making instructions clear and concise for better model performance.
Table of contents
Table of ContentsWho is this document for?Why a tuning playbook?Background: Pre-training vs. Post-trainingConsiderations for PromptingA rudimentary “style guide” for promptsProcedure for iterating on new system instructionsSome thoughts on when LLMs are usefulMore ResourcesAcknowledgements3 Comments
Sort: