{"id":4555257,"url":"https://alion.io/job/tesco-data-sde-2","title":"Data SDE 2","company":{"id":1059,"name":"Tesco","domain":"tesco.com","url":"https://alion.io/company/tesco","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Avature","truth_index":{"grade":"A","score":100,"open_postings":16,"ghost_share":0,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":11,"computed_at":"2026-11-18T05:48:20Z"}},"role":"Backend","role_family":"Backend","seniority":"middle","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Ansible","optional":false},{"name":"Apache Kafka","optional":false},{"name":"Apache NiFi","optional":false},{"name":"Configuration Management","optional":false},{"name":"GitHub","optional":false},{"name":"Hadoop","optional":false},{"name":"Jenkins","optional":false},{"name":"JFrog Artifactory","optional":false},{"name":"Jira","optional":false},{"name":"Kubernetes","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"Spark","optional":false},{"name":"Agile","optional":true},{"name":"Apache Iceberg","optional":true},{"name":"AWS","optional":true},{"name":"Azure","optional":true},{"name":"Cassandra","optional":true},{"name":"Docker","optional":true},{"name":"ETL/ELT","optional":true},{"name":"GCP","optional":true},{"name":"GDPR","optional":true},{"name":"Git","optional":true},{"name":"Snyk","optional":true},{"name":"SQL","optional":true},{"name":"Vault","optional":true}],"status":"live","first_seen_at":"2026-11-18T19:35:30Z","employer_posted_date":null,"last_verified_at":"2026-11-18T19:35:30Z","board_verified":false,"closed_at":null,"days_open":0,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":0},"description":"Mandatory:\nBasic concepts of Data Engineering, ingestion from diverse sources and file formats, Hadoop, Data Warehousing, designing & implementing large-scale distributed data platforms & data lakes\nBuilding distributed platforms or services\nSQL, Spark, query tuning & performance optimization\nGeneral advanced Scala experience (e.g. functional programming, using case classes, complex data structures & algorithms)\nExperience on SOLID & DRY principles and good software architecture & design experience\nLanguages: Python, Scala\nGood experience in Big Data unit, system, integration & regression testing\nDevOps experience in Jenkins, Maven, GitHub, Artifactory/JFrog, CI/CD\nBig Data processing: Hadoop, Sqoop, Spark and Spark Streaming\nHadoop distributions: Cloudera / Hortonworks experience\nData streaming: experience on Kafka and Spark Streaming\nData validation & data quality\nData Lake & Medallion Architecture\nShell scripting & automation using Ansible or related configuration management tools\nAgile processes & tools like Jira & Confluence\nCode management tools like Git\nFile formats like ORC, Avro, Parquet, JSON & CSV\nBig Data orchestration: NiFi, Airflow, Spark on Kubernetes, YARN, Oozie, Azkaban\n\nGood to have:\nBuilding and managing large-scale on-prem Hadoop clusters or on cloud\nData Catalog & Data Governance\nCustomer-facing experience\nExperience with a wide range of Big Data tools, databases & frameworks e.g. Kafka Connect, Apache Arrow, Apache Iceberg, Flink\nCloud native storage like Ceph or S3\nCloud Data Engineering (Azure, AWS & GCP)\nSQL & NoSQL DB: Hive, Cassandra, Dremio, Presto\nInfrastructure: hands-on experience on Kubernetes, Docker and related container technologies\nData security & compliance: experience working on GDPR & regulatory frameworks\nSecurity & secrets management like Ansible Vault, Snyk, Git Secrets, HashiCorp Vault\n\nWhat would you do here:\nShould have worked on building large-scale distributed systems\nShould have led a team in a tech lead/module lead role\nShould have good mentorship experience\nShould have good communication and very good documentation skills\nShould show maturity & understand the requirement and convert to high-quality technical requirements\nShould code and design end-to-end data flow and deliver on time\nBe resilient & flexible to work across multiple teams and internal teams\nShould help to implement best practices in Data Architecture and Enterprise Software Development\nShould have extensive experience in working in Agile Data Engineering teams\nWork very closely with Engineering Manager, TPM, Product Manager and stakeholders\nBecome a quick learner and be more proactive in understanding the wider business requirements and linking to the various other concepts in the domain\nHelp implement better solutions independently and faster with better ownership\nHelp automate manual operational tasks and focus on creating reusable assets and propel innovation\nWork very closely with team members and be able to have healthy relationships\nBe innovative and able to come up with ideas and reusable components & frameworks\nShould be ready to support 24x7 as per the rota\nSkills\nAirflow, DWH, Data Engineering, Data Lake, ETL, Hadoop, Kafka, Python, SQL, Scala, Spark","description_format":"text","description_chars":3233,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Retail & Shop Systems","Online Groceries"],"lifecycle":[{"event":"open","at":"2026-11-18T19:35:30Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":11,"reasons":["seen:0","win:early","comp:brand"],"computed_at":"2026-11-18T23:10:59Z"},"pay":null,"html_url":"https://alion.io/job/tesco-data-sde-2","json_url":"https://alion.io/job/tesco-data-sde-2.json","meta":{"generated_at":"2026-11-18T23:10:59Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":4254,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-19T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1059},"rest":"https://alion.io/mcp/rest/get_company?id=1059"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ftesco-data-sde-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ftesco-data-sde-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ftesco-data-sde-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/tesco-data-sde-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ftesco-data-sde-2"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4555257}},{"tool":"search_jobs","arguments":{"company":"tesco.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4555257},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}