Large Language Models (LLMs) have shown significant improvements in ensuring compliance in medical marketing and sales calls. Salus AI improved LLM accuracy from 80% to 95-100% using five key techniques: prompt engineering and design, pre-processing input text for speaker separation, implementing Retrieval-Augmented Generation
Table of contents
IntroductionText-SplittingEmbeddingsVector StoresRetrieversOverall Findings: Our use of Retrieval-Augmented Generation (RAG) had for the most part a small effect on prompt performance, likely due to diminishing returns after significant model improvements prior to its use. However, we did reduce LLM compute costs by up to 80%.1 Comment
Sort: