Run an AI cluster at home using exo, a software that unifies everyday devices into a powerful GPU. It supports LLaMA and other popular models, and uses a peer-to-peer connection without a master-worker architecture. Install it from source with Python>=3.12.0 and access models via a ChatGPT-compatible API endpoint.
Table of contents
Get InvolvedFeaturesInstallationDocumentationDebuggingInference EnginesNetworking ModulesKnown Issues5 Comments
Sort: