Unsloth is an open-source library that offers 80% faster and 50% less memory local QLoRA finetuning. It supports NVIDIA GPUs and provides installation instructions for Conda and Pip. It also provides performance comparisons on Tesla T4 GPUs.
Table of contents
Installation Instructions - CondaInstallation Instructions - PipAlpaca ExampleFuture Milestones and limitationsPerformance comparisons on 1 Tesla T4 GPU:Performance comparisons on 2 Tesla T4 GPUs via DDP:TroubleshootingSort: