Data Platform Engineer
Confirmed on the employer's own hiring board on Oct 18, 2026. First seen by Alion on Oct 18, 2026.
Join Shift4 as a Data Platform Engineer and play a crucial role in building, maintaining, and optimizing data pipelines that move data from production systems into our analytics warehouse. This hands-on infrastructure engineering role focuses on pipeline performance, reliability, scalability, resource optimization, cost efficiency, and observability. You will work with Amazon ECS services and SQS queues, ensuring data is delivered accurately, reliably, and on time as our data platform grows.
Missions
- Operar, ajustar y escalar las tuberías de ingestión basadas en ECS/SQS desde Aurora MySQL a Snowflake, incluyendo el dimensionamiento de tareas, la escalabilidad automática y el manejo de errores.
- Definir los SLOs para la frescura y el retraso de los datos, construir alertas y paneles de control, liderar la respuesta a incidentes y el análisis de la causa raíz de las fallas en las tuberías.
- Construir y mantener la infraestructura como código, la automatización de despliegues y CI/CD para los servicios de tuberías.
Profil recherché
- Observability and alerting for pipeline health and lag using Prometheus/Grafana, CloudWatch, Datadog, or the Elastic Stack- Passion for automation, performance, and clean system design
- Deep hands-on AWS experience: ECS/Fargate (task sizing, autoscaling, deployments), SQS (throughput, DLQs, visibility timeouts, batching), S3, IAM, CloudWatch, and Aurora/RDS from the operator side
- 5+ years in platform, infrastructure, or DevOps roles supporting data-intensive systems in production
- Experience operating pipelines into Snowflake from the ingestion side (Snowpipe/COPY, stages, load monitoring)
- Enough Python to read, debug, and instrument worker code
- Proven track record tuning message-driven workloads: consumer concurrency, backpressure, retries, idempotency, throughput versus cost
- Infrastructure as code with Terraform/Ansible, containerization with Docker, and CI/CD pipelines
- CDC tooling (Debezium, AWS DMS) and MySQL Binlog replication
- Elastic Stack or time-series database (Prometheus, InfluxDB) administration
- Message brokers beyond SQS: Apache Kafka/Confluent, RabbitMQ
- Experience in a PCI or otherwise regulated environment
- Payments or fintech domain knowledge