Senior Data Engineer

By joining our team as a Senior Data Engineer, you will help maintain and expand our core data infrastructure and support the creation of custom data integrations with external partners. You'll contribute to timely completion of team objectives and monitoring/troubleshooting the ongoing support of team operations. Your work will support the foundation on which our company develops useful data products.

Responsibilities:

• Working closely with the data engineering manager, technical lead, and another data engineer to complete objectives aligned with internal roadmaps and business objectives.
• Continually improve the existing modern data warehouse/core orchestration architecture to support the business needs and build reliable and robust data integrations with external partners.
• Working with internal and external technical partners to plan, build, and deploy custom data integrations.
• Monitor pipeline performance, troubleshoot issues, and escalate them as needed.
• Provide appropriate data infrastructure technical support in alignment with established service level agreements (SLAs).
• Become intimately familiar with HIPAA, GDPR, and other applicable regulatory frameworks and how they influence our architecture and development decisions.

Requirements:

• Have 3-6+ years of hands-on data engineering experience, ideally in a relevant industry working on regulated data.
• Clear verbal and written communication.
• Track record of effective execution and attention to detail, especially around security.
• Deep practical experience with AWS (Redshift, Athena, RDS (Postgres), S3 MSK, Glue, Lake Formation, etc. ), Kafka, Apache Iceberg, and data orchestration tools such as Terraform, Prefect, and dbt.
• Experience with Python, SQL, back-end development, and shell scripting.
• Strong technical knowledge in data modeling, data replication, and database design.
• Solid software testing, documentation, and debugging practices in the context of distributed systems.
• Experience working as part of an agile team with modern source control (Git), code review, and CI/CD systems and methodologies.