Senior Data Engineer - Snowflake OpenFlow

We are looking for a Senior Data Engineer to implement and validate change data capture from AWS Aurora PostgreSQL into Snowflake. You will help build metadata-driven integration frameworks, support schema adoption in the Medallion architecture, and contribute to performance, reliability, and governance across the data flow.

Responsibilities:

• Configure and operate Snowflake OpenFlow from Aurora PostgreSQL to Snowflake.
• Tune and troubleshoot Aurora PostgreSQL for logical replication.
• Provision infrastructure using Terraform and AWS IAM with least-privilege access controls.
• Run structured proof-of-concept tests for large tables, high-volume CDC concurrency, and outage recovery scenarios.
• Document outcomes of proof-of-concept testing and validation activities.
• Monitor replication health using Snowflake native observability and Amazon CloudWatch.
• Define success criteria with stakeholders for replication and ingestion validation.
• Support Snowflake-side setup for managed ingestion, including warehouse grants, schedules, and reconciliation checks.
• Apply security and governance practices appropriate to a regulated financial and member services context.
• Perform schema DBT and Snowflake native pipeline renewal while preserving business and data continuity.
• Execute performance and cost improvements.
• Follow agreed teardown procedures to remove replication and access artifacts.

Requirements:

• Technology stack: Snowflake OpenFlow, AWS Aurora PostgreSQL, Snowflake, Terraform, AWS IAM, DBT, SQL, Amazon CloudWatch, GitHub, Apache NiFi, Airflow, Python, Amazon EKS, Kubernetes.
• Hands-on experience with Snowflake, OpenFlow, or Apache NiFi.
• Strong experience with PostgreSQL or Aurora, including logical replication, WAL slots, and access control.
• Experience with Terraform on AWS, including networking security groups, IAM, and role pass-through for managed services.
• Experience with DBT for data transformations.
• Proficiency in SQL for transformations, validation, and reconciliation.
• Working knowledge of Snowflake, including warehouse roles and loading patterns.
• Understanding of CDC and ELT fundamentals.
• Experience with data quality validation and reconciliation practices.
• Strong communication skills for Agile cross-team collaboration in distributed teams.
• Experience with GitHub.

Nice to have:

• Experience with PostgreSQL sources and Snowflake targets using OpenFlow NiFi or similar services.
• Experience with Python or similar languages for checks automation and reporting.
• Experience with Snowflake OpenFlow or similar managed CDC offerings.
• Experience with Airflow or equivalent tools for production orchestration.
• Experience in financial services or similar regulated domains.
• Experience with cloud cost estimation for replication at scale.
• Experience with Amazon EKS or Kubernetes for monitoring and issue resolution in the OpenFlow or NiFi environment.
• Experience with Cursor or Claude.
• Experience with specification-driven development.

Skills

Apache NiFi, Aurora, Aurora PostgreSQL, CDC, NiFi, OpenFlow, PostgreSQL, Snowflake, Snowflake OpenFlow, WAL slots, change data capture, logical replication