Uber Moves In-House Search Indexing to Pull-Based Ingestion in OpenSearch

Uber migrated its search indexing system to OpenSearch using a pull-based ingestion framework instead of push-based writes. The new architecture has shards pull data from Kafka/Kinesis streams, providing better backpressure handling, reliability during traffic spikes, and simplified recovery. The system supports multi-region Show more