A development team replaced Kafka with gRPC for synchronous service communication in their loan servicing platform after experiencing issues with debugging, latency, and operational complexity. While keeping Kafka for appropriate use cases like audit logs and fan-out patterns, they found gRPC provided better performance (70-80% latency reduction), easier debugging, and simpler infrastructure management for request-response interactions. The key lesson was using each tool for its intended purpose rather than forcing one solution everywhere.
Table of contents
Why We Replaced Kafka with gRPC for Service CommunicationHow We Ended Up Over-Kafka’dReal Example: Where Kafka Made Things Shit…The Moment of ClarityExploring gRPCWhat We Replaced (and What We Didn’t)Moved to gRPC:Kept Kafka for:Operational Benefits of Switching to gRPCWhat We LearnedFinal Words7 Comments
Sort: