This article discusses the supervised fine-tuning of the Microsoft Phi2 model for the Text2SQL task. It covers data preparation, loading the dataset, preparing input, loading the pre-trained model, setting up a data collator, model training, model evaluation, and concludes with potential areas for improvement.

5m read timeFrom blog.gopenai.com
Post cover image
Table of contents
Load DatasetPrepare InputLoad Pre-Train ModelSetup DataCollatorModel TrainingModel EvaluationGitHub - djagatiya/Text2SQLConclusion

Sort: