This article explains how to use LM Studio to run AI models locally and use them in a Java application with Spring AI and Spring Boot.

Piotr Minkowski TechBlog

A step-by-step guide to running local AI models with LM Studio and integrating them into a Java Spring Boot application using Spring AI. Covers downloading and running the DeepSeek-V2-Lite-Chat model in MLX format on macOS, configuring Spring AI with LM Studio's OpenAI-compatible API server, and a key gotcha: LM Studio doesn't support HTTP/2, requiring a manual override of Spring's RestClient to force HTTP/1.1. Also demonstrates using LM Studio's Anthropic-compatible API endpoint, including enabling the 'thinking' mechanism via AnthropicChatOptions.

Local AI Models with LM Studio and Spring AI

Integrate Spring AI with the Model on LM Studio