TinyAgent is a small language model (SLM) that can perform complex reasoning and function calling. It can be deployed locally at the edge, reducing the need for cloud connectivity and ensuring privacy. TinyAgent achieves improved function calling performance through fine-tuning on a specialized dataset and the use of Tool RAG

14m read timeFrom bair.berkeley.edu
Post cover image
Table of contents
Teaching LLMs to do Function CallingDataset GenerationFine-tuning for Improved Function Calling ReasoningEfficient Inference with Tool RAGFast Edge Deployment with QuantizationPutting it all togetherAcknowledgements

Sort: