A team at Pepkor NexTech running Debezium with Oracle LogMiner for 4 years shares how they resolved severe CDC replication lag in a large ERP environment. Evening batch jobs caused LogMiner fetch queries to take over 95 minutes due to a nightly truncate-and-load script generating ~476 million redo operations on tables not even in the capture list. By collaborating with the source database team, they replaced the truncate-and-load pattern with Oracle External Tables and a MERGE-based PL/SQL procedure using ROW_NUMBER deduplication. This reduced log volume to only true deltas, cutting maximum query time from 95 minutes to ~12 minutes and average evening query time to ~2.26 minutes. The key lesson: LogMiner performance is tightly coupled to source database behavior, and resolving persistent CDC lag often requires cross-team collaboration on data loading patterns.
Sort: