Mozilla Llamafile has been integrated into Supabase Edge Functions, enabling AI inference to be run locally without installation. The integration supports an OpenAI API compatible server for easy deployment and can be executed using Supabase's functions-js or the OpenAI Deno SDK. The post provides a guide for setting up and deploying Llamafile and Supabase Edge Functions both locally and to a server.
Table of contents
Getting started #Call Llamafile with functions-js #Call Llamafile with the OpenAI Deno SDK #Serve your functions locally #Deploying a Llamafile #Deploying your Supabase Edge Functions #Get access to Supabase Hosted LLMs #More Supabase Resources #Sort: