If you asked a lawyer whether ChatGPT could do his job, he would laugh you out of the room. The tool is often useful, but can’t handle legal questions end to end. It makes up sources, its reasoning can be flawed, and it may overlook key aspects of the law.
We decided to tackle this problem at Hotseat. After iterating multiple times, implementing advanced agentic workflows, and testing with dozens of lawyer, we’re certain that the product has glaring limitations and it won’t replace any jobs soon.

Hacker News is a community-driven platform for sharing and discussing technology news, startups, and programming-related topics. Through user submissions and comments, Hacker News offers insights into emerging technology trends, industry developments, and entrepreneurial ventures. Readers can participate in discussions, share their insights, and stay informed about the latest advancements in technology and innovation.

Hacker News

Learn how to implement a system that can perform advanced reasoning over very long legal documents by using LLMs. Discover the process of breaking down a legal question into subtasks, answering each subquestion independently, and aggregating the findings into a single response. Understand the limitations of using GPT-4 for legal questions and the potential for building a more accurate and relevant AI for PDFs app.

Answering Legal Questions with LLMs