Unsloth is an open-source library that offers 80% faster and 50% less memory local QLoRA finetuning. It supports NVIDIA GPUs and provides installation instructions for Conda and Pip. It also provides performance comparisons on Tesla T4 GPUs.

3m read timeFrom github.com
Post cover image
Table of contents
Installation Instructions - CondaInstallation Instructions - PipAlpaca ExampleFuture Milestones and limitationsPerformance comparisons on 1 Tesla T4 GPU:Performance comparisons on 2 Tesla T4 GPUs via DDP:Troubleshooting

Sort: