Team Lead of DevOps Team

We’re looking for a DevOps Tech Lead to join a project building a cloud-native data lakehouse platform for a global financial services company.

This is a hands-on leadership role where you’ll own platform infrastructure end-to-end, work closely with client stakeholders, and provide technical guidance to the team.

The platform is built on AWS, Kubernetes, Apache Flink, Spark, Airflow, JupyterHub, and Apache Iceberg. The current phase focuses on deploying and adapting the solution to the client’s AWS environment, integrating with their IaC standards, CI/CD pipelines, identity management, networking, and security controls.

The goal is to deliver an MVP capable of processing high-volume Kafka event streams, supporting tenant workloads, enabling data analysis, and providing full monitoring and alerting.

Working hours: Core working hours align with the Polish time zone. Due to collaboration with global teams, including the US, occasional meetings may take place between 17:00–21:00 CET/CEST. Flexibility to join key project and stakeholder meetings is expected.

⚠️ Successful completion of the client's background screening process is required before joining the project. This may include identity, employment history, and criminal record verification.

Zakres obowiązków

• Leading the deployment of the platform into the client's AWS non-production environment, and coordinating with the client's infrastructure, security and identity teams.
• Building and maintaining Jenkins pipelines for build, image publishing and deployment. This includes dependency ordering, bootstrap and database migration steps, replacing the previous GitOps (ArgoCD) process.
• Integrating platform services (Polaris, Airflow, JupyterHub, Grafana and others) with the client's corporate OIDC identity provider, and mapping directory groups to roles.
• Configuring networking, TLS certificates, workload identities (IRSA), secrets management and KMS encryption.
• Operating and tuning Flink, Spark and Airflow workloads on Kubernetes, and supporting ingestion from Kafka into Iceberg.
• Setting up and maintaining observability: Prometheus, Thanos, Grafana dashboards, Loki logs, and alert routing via Alertmanager.
• Preparing technical designs, deployment documentation and validation evidence, and presenting progress to client stakeholders.
• Planning and prioritising the team's technical work, reviewing code and mentoring engineers.

Wymagania

Tech stack

• AWS
• Python
• EKS
• IAM
• CDK
• Terraform
• Kubernetes
• Docker
• Jenkins
• Prometheus
• Grafana
• Loki
• DevOps
• Cloud platform
• AWS EKS
• Networking
• AWS S3
• KMS
• AWS CDK
• Cloud security
• Kafka
• Iceberg
• Airflow
• Flink
• Spark
• ArgoCD
• Bash script
• Helm