Building custom processors for Snowflake OpenFlow (NiFi-based) requires handling authentication, pagination, incremental sync, and rate limiting systematically. The guide walks through creating a ContactsPlusSource processor that polls REST APIs with OAuth 2.0, cursor pagination, watermark-based incremental sync, and retry
Table of contents
Design the Processor like a ProductThere is An Order To The ImplementationPut it together in onTriggerThe Real Example: ContactsPlusSourceGet Augusto Rosa’s stories in your inboxCreate the version fileCreate the package initConfigure pyproject.tomlVersioningPackaging and deploymentTroubleshootingSort: