Baeldung·2yApache Kafka Tutorial Series
This tutorial series covers essential topics about Apache Kafka, including its basics, how to integrate it with Spring Boot, configuring Kafka SSL, and setting up Kafka using Docker. It also explores Kafka consumer groups, retry mechanisms, and message ordering strategies, providing practical guidance for both newcomers and experienced developers.
Dev Genius·2yKafka Demo Project: Part 1. Producers
This post introduces a step-by-step guide to a Kafka demo project using Java and Spring Boot. It covers setting up a Kafka cluster on Confluent Cloud, configuring the Confluent Schema Registry, and creating a Producer application to send messages to Kafka topics. Essential configurations for the 'application.properties' and 'application.yml' files, as well as Maven dependencies, are also discussed. The post concludes with an example of sending a POST request to the producer and exploring cluster configurations using Kafka's Admin API.
codeHeim·2y#44 Golang - Mastering Kafka with Golang: A Beginner's Guide
Learn how to use Apache Kafka with Golang by building a coffee order and brewing system. The guide covers setting up a Kafka producer to send coffee orders and a consumer to process these orders. It uses the Sarama library for Kafka integration, demonstrating how to handle HTTP requests, serialize data to JSON, and manage Kafka messages in a Golang application.
Hacker News·2yBuilding and scaling Notion’s data lake
Notion's data has grown 10x in three years, necessitating the creation and scaling of a dedicated data lake. Their initial architecture involved a complex sharded Postgres infrastructure but faced challenges with operability, speed, and cost. To manage these issues, they developed an in-house data lake using AWS S3 for storage and Apache Spark for processing, coupled with a Kafka-based ingestion system using Debezium CDC connectors. This scalable setup improved data ingestion times, reduced costs, and supported their AI and analytical needs. The data lake supports update-heavy block data and allows complex data transformations, making it efficient for both small and large-scale data operations.
Just Java·2yHexagonal architecture with Spring Boot demo
A developer has created a sample project that incorporates Spring Boot, Hexagonal Architecture, Kafka, Testcontainers, OpenAPI, and additional technologies. This project is hosted on GitHub and is open for contributions to enhance its features.