To integrate LLMs with APIs, there is a need for the LLM equivalent of view models and the backend for frontend pattern. This discusses it in the context of Semantic Kernel.

Johnny Reilly is a software engineer, blogger, and technology enthusiast known for his insights into software development, web technologies, and personal productivity. Readers can learn about coding best practices, web development frameworks, and career growth strategies. With blog posts, tutorials, and motivational content, Johnny Reilly inspires and educates readers on their journey to becoming successful developers.

John Reilly

Integrating APIs with LLMs can be challenging due to issues with Swagger / Open API integration. View models and the Backend for Frontend (BFF) Pattern can help in managing the information exposed to LLMs and ensuring appropriate answers.

Large Language Models, Open API, View Models and the Backend for Frontend Pattern

Swagger / Open API and Semantic Kernel ​

The problem with Swagger / Open API and LLMs ​

View models and the BFFs to the rescue ​

"But integrating with APIs is a lot of work!" ​