2,376,863open jobs
148,471companies
291,590added this week
Browse all
Location
In office (Bengaluru)
Seniority
Middle · 5+ years exp

First seen by Alion on Nov 18, 2026. Tesco scores A on the Alion truth index.

Overview
Company
Impact
Profile match
Tesco is a leading British multinational retailer that stands as the largest grocery store chain in the United Kingdom. Headquartered in Welwyn Garden City, England, the company operates thousands of supermarkets, convenience stores, and a major e-commerce platform. It offers a wide variety of products ranging from fresh food and clothing to household items and financial services.

We are looking for an experienced Data Software Engineer (SDE 2) with strong expertise in Python, Scala, Apache Spark and Big Data technologies.


The ideal candidate should have hands-on experience building and designing large-scale distributed data platforms, data lakes and real-time data processing solutions.


You will be responsible for developing scalable data engineering solutions, optimising distributed processing systems, implementing data architecture best practices and taking ownership of end-to-end technical deliverables.


Key Responsibilities:

  • Design, develop and maintain large-scale distributed data platforms and services.
  • Build scalable data ingestion and processing pipelines using Python, Scala and Apache Spark.
  • Develop batch and real-time streaming applications using Spark Streaming and Kafka.
  • Design and implement Data Lake and Medallion Architecture solutions.
  • Optimise Spark jobs, SQL queries and distributed processing workloads for performance and scalability.
  • Implement data validation, data quality and automated testing frameworks.
  • Develop reusable components, frameworks and automation solutions.
  • Drive technical design, architecture decisions and end-to-end delivery.
  • Collaborate with Engineering Managers, Product Managers, TPMs and cross-functional stakeholders.
  • Mentor junior engineers, conduct code reviews and promote software engineering best practices.
  • Work with CI/CD pipelines, DevOps tools and Agile development processes.
  • Participate in production support activities, including 24x7 support on a rotational basis.


Mandatory Skills & Experience:

  • 5-10 years of overall software development / Big Data engineering experience.
  • Strong hands-on experience in Python and advanced Scala programming.
  • Strong understanding of Functional Programming, Case Classes, Complex Data Structures and Algorithms.
  • Experience building large-scale distributed systems and data platforms.
  • Strong experience with Apache Spark, Spark Streaming and SQL.
  • Hands-on experience with Hadoop, Sqoop and Big Data processing frameworks.
  • Experience with Kafka and real-time data streaming.
  • Strong understanding of Data Lakes, Data Warehousing and Medallion Architecture.
  • Experience with data ingestion from diverse sources and file formats.
  • Knowledge of performance optimisation and query tuning.
  • Experience with ORC, Avro, Parquet, JSON and CSV file formats.
  • Good understanding of SOLID principles, DRY principles and software architecture.
  • Experience with unit, integration, system and regression testing.
  • Exposure to DevOps and CI/CD tools such as Jenkins, Maven, GitHub and JFrog/Artifactory.
  • Experience with workflow orchestration tools such as NiFi, Airflow, Oozie, Azkaban or Spark on Kubernetes.
  • Shell scripting and automation experience using Ansible or similar tools.
  • Strong communication, documentation and technical ownership skills.


Good to Have:

  • Experience managing large-scale on-premises Hadoop clusters or cloud-based Big Data platforms.
  • Cloud experience with AWS, Azure or GCP.
  • Experience with Kubernetes, Docker and container technologies.
  • Knowledge of Hive, Cassandra, Dremio and Presto.
  • Exposure to Apache Iceberg, Flink, Apache Arrow and Kafka Connect.
  • Experience with cloud-native storage such as S3 or Ceph.
  • Knowledge of Data Catalog, Data Governance and Data Security.
  • Understanding of GDPR and regulatory compliance.
  • Experience with security and secrets management tools such as HashiCorp Vault, Ansible Vault and Snyk.


Leadership & Collaboration:

  • Experience working in a Technical Lead or Module Lead capacity.
  • Ability to mentor engineers and guide technical implementation.
  • Strong problem-solving and architectural design capabilities.
  • Ability to translate business requirements into high-quality technical solutions.
  • Strong ownership, proactive approach and ability to work across multiple engineering teams.
  • Experience working in Agile Data Engineering environments.


Note:

The role involves 24x7 production support as per the rotational schedule.

Skills

Airflow, Apache Spark, Hadoop, Kafka, Python, Scala, Spark Streaming

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,376,863 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Backend
Similar stack
Same company
Bengaluru
Python Developer 1 hour ago
In office · Full-Time · 4+ years exp · Bachelor's Degree · Noida
Python
JavaScript
TypeScript
SQL
Python
Flask
SQLAlchemy
FastAPI
Django
Asyncio
Celery
Pydantic
Mypy
Databases
PostgreSQL
Redis
pgvector
Pinecone
OpenSearch
AI/ML
LangGraph
Polars
LangChain
Claude
Model Context Protocol
Embeddings
Function Calling
LLM
RAG
OpenAI Agents SDK
OCR
Structured Outputs
DevOps
Rest API
GCP
OpenTelemetry
Azure
CI/CD
Git
AWS
Docker
AWS Step Functions
QA
Pytest
Apply
Fullstack Developer 1 hour ago
In office · 4+ years exp · Bengaluru · Hyderabad
Go
JavaScript
Frontend
React.js
DevOps
gRPC
Apply
In office · 4+ years exp · Bengaluru · Hyderabad
Python
Python
Flask
FastAPI
Apply
Java + Gen AI 1 hour ago
In office · 6+ years exp · Bengaluru
Java
SQL
Java
Spring Boot
Hibernate
Spring MVC
Databases
Apache Kafka
AI/ML
LangGraph
LangChain
Claude
Model Context Protocol
Embeddings
Prompt Engineering
Function Calling
AI Agents
Gemini
LLM
RAG
OpenAI
Semantic Search
LLM Guardrails
Agentic Workflows
Multi-Agent Systems
DevOps
Rest API
GCP
Azure
CI/CD
AWS
Docker
Kubernetes
Apply
In office · 3+ years exp · Pimpri Chinchwad · Pune
DevOps
Windows
SpaceTech
Siemens NX
ANSYS
Apply
Software Engineer II 7 hours ago
In office · Full-Time · Bachelor's Degree · Bengaluru
JavaScript
TypeScript
SQL
C#
C#
.NET
Databases
MS SQL
Frontend
Angular
DevOps
CI/CD
Management
UML
Apply
In office · 4+ years exp · Bengaluru
Python
Go
JavaScript
TypeScript
Node JS
Python
SQLAlchemy
Node JS
Nest.JS
Databases
PostgreSQL
Frontend
Redux
Tailwind CSS
Next.js
Chart.js
React.js
React Query
Apache ECharts
SWR
Recharts
Design
Figma
QA
Playwright
Jest
Apply
≈ $9k – $27k per year (Estimated) · In office · Full-Time · 6+ years exp · Master's Degree · Bengaluru
Apply
In office · Full-Time · Bengaluru
Apply
Manager - Facility 7 hours ago
In office · Full-Time · Bengaluru
Apply
See all jobs
This is one of many
2,376,863 more open roles from verified company boards, updated every day.