Senior Data Platform Engineer

Shield Consulting Solutions, Inc. is hiring a Senior Data Platform Engineer to build and maintain reliable, scalable, and observable data workflow orchestration solutions. The role supports data engineering, analytics, and operational use cases and collaborates with data engineers, platform teams, and stakeholders to deliver efficient, secure, production-ready workflows.

Responsibilities

• The Software Engineer shall be responsible for creating and maintaining data workflows and automation pipelines using Apache Airflow
• This role focuses on building reliable, scalable, and observable workflow orchestration solutions that support data engineering, analytics, and operational use cases
• The engineer will collaborate closely with data engineers, platform teams, and stakeholders to ensure workflows are efficient, secure, and production ready

Skills

• Active TS/SCI w/Polygraph REQUIRED
• 5 years of experience as a software engineer
• Bachelor's degree in a technical discipline
• + 2 additional years of experience as a software engineer may be substituted for a degree
• Experience using the Linux CLI and Linux tools
• Experience developing Bash scripts to automate manual processes
• Recent software development experience using Python and Java
• Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows
• Experience using Distributed Big Data processing engines including Apache Spark
• Experience with containerization technologies such as Docker, containerd, and Podman
• Experience with Git Source Control System
• Experience using the Atlassian Tool Suite (JIRA, Confluence)
• Familiar with AWS Cloud Services and Infrastructure

Benefits

• 25 days PTO
• 11 paid holidays
• 100% employer-paid healthcare for employees and dependents – available day 1
• 8% 401(k) employer match – immediate vesting

Company Overview