This article will explain how to create a locally-runningchatbot that interacts with a pre-trained LLM model using Spring Boot 3 and Java 17+.

Java Revisited's resource offers insights, tutorials, and resources for Java developers and enthusiasts. Readers can learn about Java programming, JVM internals, and enterprise Java technologies. With articles, tutorials, and code examples, Java Revisited provides  guidance and expertise for mastering the Java language and ecosystem.

Javarevisited

Learn how to create a locally-running chatbot using a pre-trained LLM model with Java and Spring Boot. The tutorial guides you through using the llama.cpp library ported to Java and setting up necessary components like the model and prompt, as well as handling the chatbot's main service. Detailed code snippets are provided for a comprehensive understanding.

Creating Locally-Running LLM Chatbot using Java and Spring Boot

<p>I highly recommend using Spring AI for this kind of task. It comes with a pretty neat support for Ollama which in my opinion is the easiest way to get a LLM running locally. In the current Snapshot Version you can even make use of Tool Calling.</p>
