Senior Real-Time Data Engineer

Senior Real-Time Data Engineer

Sports Data & Streaming Platforms | Real-Time Analytics, Event Processing & Data Infrastructure

The Mission

West Code is looking for experienced Data Engineers for technology projects involving real-time data processing, event-driven architectures and high-volume data platforms.

We are particularly interested in engineers who can build reliable streaming infrastructure for environments where data freshness, accuracy, latency and resilience directly impact business decisions.

Depending on the project, you may work on live sports data platforms, real-time analytics, event processing, data ingestion pipelines or systems supporting dynamic pricing and predictive models.

What You’ll Work On

• real-time ingestion and processing of high-volume event data

• streaming pipelines supporting live sports data and analytics

• integration of external data feeds, APIs and event sources

• data normalization, validation and enrichment

• event-driven architectures and distributed data processing

• low-latency data delivery to analytical and predictive systems

• handling late, duplicated, missing or out-of-order events

• real-time and historical data storage solutions

• monitoring, observability and reliability of production data pipelines

• collaboration with Data Scientists, Backend Engineers and domain specialists

Technology

We are particularly interested in engineers working with Python, Apache Kafka, Apache Flink, Spark Structured Streaming and SQL.

Typical environments may also include Redis, PostgreSQL, ClickHouse, AWS, GCP, Kubernetes, Docker, Apache Airflow and modern observability tooling.

Experience with event-time processing, stateful stream processing and distributed systems is particularly valuable.

Must Have

• 5+ years of professional experience in Data Engineering or backend/data platform development

• strong Python and SQL skills

• hands-on experience building production-grade streaming or event-driven data pipelines

• experience with Apache Kafka or comparable messaging technologies

• practical knowledge of Apache Flink, Spark Structured Streaming or similar frameworks

• solid understanding of distributed systems and asynchronous processing

• experience integrating external APIs and data sources

• understanding of data quality, consistency and failure recovery

• experience with cloud infrastructure

• good English

• ability to work with technical and business stakeholders

Strong Advantage

• commercial experience with sports data, betting platforms or sportsbook technology

• live sports event feeds and real-time match data

• odds feeds, market data or dynamic pricing systems

• low-latency or high-throughput data architectures

• real-time trading or financial market data platforms

• event-time processing, windowing and stream state management

• Kafka Streams, Flink or similar streaming technologies

• Redis, ClickHouse or other high-performance data stores

• AWS Kinesis, Google Pub/Sub or managed streaming services

• data pipelines supporting machine learning and predictive models

• experience with data reconciliation, feed reliability and event deduplication

Working Model

• B2B cooperation

• remote or hybrid work depending on the project

• projects involving real-time data, analytics and high-performance platforms

• international engineering teams

• English used on most projects

B2B Rate 150–200 PLN/h + VAT

Final rate depends on technology, seniority, streaming expertise, domain knowledge and project scope.

Why West Code

West Code builds engineering teams around ownership and strong technical delivery, not just individual roles.

We work on complex technology challenges where data engineering, software architecture and business-domain understanding need to come together.

Our approach combines experienced engineers, AI-enabled delivery practices and accountability for the quality of what we build.

We are particularly interested in environments where systems need to process continuous streams of information, respond to changing conditions and remain reliable under demanding production workloads.

If you have strong real-time data engineering experience and enjoy building systems where every event matters, apply and let's talk.

Tech stack

• Python
• Kafka
• Flink
• Event Streaming
• SQL