The Engineering behind ChatGPT Andrej Karpathy was one of the founding members of OpenAI and the director of AI at Tesla. He gave a fantastic talk at the Microsoft Build conference delving into how chatGPT was trained Step 1 - Training the Base LLM (ex. GPT-3, LLaMA) Step 2 - Supervised Fine Tuning.
Sort: