[Remote] Senior Data Platform Engineer

Note: The job is a remote job and is open to candidates in USA. Ideaon is hiring a Senior Data Platform Engineer to operate and extend a near-real-time streaming data platform. The role focuses on streaming pipelines, data transformation, PHI governance, AWS infrastructure, and collaboration on data contracts and access needs.

Responsibilities

• Own Production Platform: Run a near real-time streaming data platform, owning latency/throughput SLOs and on-call incident response
• Build Streaming Pipelines: Extend pipelines ingesting CDC events from operational databases and SaaS sources
• Transform with Flink: Use Java and Flink SQL to perform cross-stream joins and enrich data into canonical entities
• Ensure PHI Governance: Implement classification, row/column controls, and access policies (e.g., ABAC) for sensitive data
• Provision as Code: Define AWS infrastructure (MSK, Glue, S3) using CDK with CI/CD for all data pipelines
• Partner Across Teams: Collaborate with upstream producers and downstream consumers on data contracts and access needs

Skills

• 6+ years operating production data systems, with deep expertise in Apache Kafka and Kafka Connect
• Production experience with a stateful stream processor in Java
• Expert-level SQL and Python, plus an AI-forward engineering mindset using agentic dev tools
• Apache Flink
• Health insurance domain knowledge, including HIPAA and governing access to PHI

Company Overview

Company H1B Sponsorship