{"id":3150325,"url":"https://alion.io/job/hcltech-apache-spark-technical-specialist-scala-python-2","title":"Apache Spark Technical Specialist - Scala, Python","company":{"id":225,"name":"HCLTech","domain":"hcltech.com","url":"https://alion.io/company/hcltech","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"SuccessFactors","truth_index":null},"role":"Backend","role_family":"Backend","seniority":null,"employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Chennai, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"CI/CD","optional":false},{"name":"GCP","optional":false},{"name":"Git","optional":false},{"name":"Google BigQuery","optional":false},{"name":"Kanban","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"Scrum","optional":false},{"name":"SonarQube","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Platform Engineering","optional":true},{"name":"SAS","optional":true}],"status":"live","first_seen_at":"2026-10-23T11:53:27Z","employer_posted_date":"2026-10-23","last_verified_at":"2026-10-29T15:01:30Z","board_verified":true,"closed_at":null,"days_open":6,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":6},"description":"Job Summary\nScala Data Engineer\nLloyds Banking Group is the UK’s largest Retail, Digital and Mobile bank, supporting over 30 million customers. Our products and services touch the lives of millions of people every day, giving us a unique opportunity to Help Britain Prosper. Technology, data and engineering are central to our strategy, with continued investment in cloud, data platforms, artificial intelligence and automation.\nThe Finance Platform has an opportunity within its Data Application Solutions Lab function for an individual to support the delivery of modern data solutions and reporting capabilities across Insurance Finance. Working within a cloud-first environment, you will help build, enhance and support strategic data products that enable critical Finance processes and decision-making.\nOur engineering teams develop data solutions primarily using Scala and Apache Spark on Google Cloud Platform (GCP). We leverage modern cloud-native technologies including BigQuery, DataProc, GCS and automated CI/CD pipelines to deliver scalable and resilient data platforms. Whilst experience in Scala is beneficial, we welcome applications from engineers with strong software engineering fundamentals gained in other languages or technologies who are keen to develop their skills in modern data engineering. Data Engineering experience with problem solving in industry is particularly important.\nYou will begin by contributing to enhancements and support activities across our existing platforms. We work using Agile delivery practices, including Scrum, Kanban, sprint planning, backlog refinement and continuous improvement.\nThis is a hands-on role where you will work closely with Finance, Accounting, Risk and Engineering colleagues to solve complex business problems through practical and scalable data engineering solutions. The role requires strong analytical thinking, problem-solving skills and a passion for delivering high-quality technology outcomes.\nWe are committed to creating an inclusive environment where colleagues can thrive and be themselves. We actively support diversity across all backgrounds and experiences and are proud to offer reasonable adjustments throughout our recruitment process.\nTechnical Proficiencies\nComputer Science, Software Engineering or related degree, or equivalent industry experience.\nExperience developing and supporting data solutions using Apache Spark and distributed processing frameworks.\nExperience developing applications in Scala or another object-oriented/JVM-based programming language.\nStrong understanding of software engineering principles including testing, code quality and maintainability.\nExperience with unit testing frameworks such as Xray or equivalent.\nExperience delivering solutions on Google Cloud Platform (GCP).\nStrong SQL Python skills for data analysis, troubleshooting, optimisation and data profiling.\nExperience working with BigQuery and large-scale analytical datasets.\nFamiliarity with CI/CD and DevOps tooling including Maven, Git, Nexus, SonarQube, Harness and automated deployment pipelines.\nExperience using JIRA and Confluence to manage Agile delivery and technical documentation.\nExperience working within Agile teams using Scrum, sprint planning and iterative delivery practices.\nStrong communication and stakeholder management skills.\nDemonstrable ability to apply practical problem-solving techniques to real-world business and data challenges.\nNice to Have\nExperience with DataProc, Cloud Composer, GCS or other GCP data services.\nExperience within Financial Services, particularly Finance, Insurance, Regulatory Reporting or Risk data domains.\nKnowledge of modern data platform architectures and cloud migration programmes.\nExperience supporting production platforms and investigating data or operational issues.\nExposure to DevOps, platform engineering or infrastructure-as-code practices.\nPrevious experience with SAS, particularly in reporting, analytics or legacy platform support.\nKey Responsibilities\nScala Data Engineer\nLloyds Banking Group is the UK’s largest Retail, Digital and Mobile bank, supporting over 30 million customers. Our products and services touch the lives of millions of people every day, giving us a unique opportunity to Help Britain Prosper. Technology, data and engineering are central to our strategy, with continued investment in cloud, data platforms, artificial intelligence and automation.\nThe Finance Platform has an opportunity within its Data Application Solutions Lab function for an individual to support the delivery of modern data solutions and reporting capabilities across Insurance Finance. Working within a cloud-first environment, you will help build, enhance and support strategic data products that enable critical Finance processes and decision-making.\nOur engineering teams develop data solutions primarily using Scala and Apache Spark on Google Cloud Platform (GCP). We leverage modern cloud-native technologies including BigQuery, DataProc, GCS and automated CI/CD pipelines to deliver scalable and resilient data platforms. Whilst experience in Scala is beneficial, we welcome applications from engineers with strong software engineering fundamentals gained in other languages or technologies who are keen to develop their skills in modern data engineering. Data Engineering experience with problem solving in industry is particularly important.\nYou will begin by contributing to enhancements and support activities across our existing platforms. We work using Agile delivery practices, including Scrum, Kanban, sprint planning, backlog refinement and continuous improvement.\nThis is a hands-on role where you will work closely with Finance, Accounting, Risk and Engineering colleagues to solve complex business problems through practical and scalable data engineering solutions. The role requires strong analytical thinking, problem-solving skills and a passion for delivering high-quality technology outcomes.\nWe are committed to creating an inclusive environment where colleagues can thrive and be themselves. We actively support diversity across all backgrounds and experiences and are proud to offer reasonable adjustments throughout our recruitment process.\nTechnical Proficiencies\nComputer Science, Software Engineering or related degree, or equivalent industry experience.\nExperience developing and supporting data solutions using Apache Spark and distributed processing frameworks.\nExperience developing applications in Scala or another object-oriented/JVM-based programming language.\nStrong understanding of software engineering principles including testing, code quality and maintainability.\nExperience with unit testing frameworks such as Xray or equivalent.\nExperience delivering solutions on Google Cloud Platform (GCP).\nStrong SQL Python skills for data analysis, troubleshooting, optimisation and data profiling.\nExperience working with BigQuery and large-scale analytical datasets.\nFamiliarity with CI/CD and DevOps tooling including Maven, Git, Nexus, SonarQube, Harness and automated deployment pipelines.\nExperience using JIRA and Confluence to manage Agile delivery and technical documentation.\nExperience working within Agile teams using Scrum, sprint planning and iterative delivery practices.\nStrong communication and stakeholder management skills.\nDemonstrable ability to apply practical problem-solving techniques to real-world business and data challenges.\nNice to Have\nExperience with DataProc, Cloud Composer, GCS or other GCP data services.\nExperience within Financial Services, particularly Finance, Insurance, Regulatory Reporting or Risk data domains.\nKnowledge of modern data platform architectures and cloud migration programmes.\nExperience supporting production platforms and investigating data or operational issues.\nExposure to DevOps, platform engineering or infrastructure-as-code practices.\nPrevious experience with SAS, particularly in reporting, analytics or legacy platform support.\nSkill Requirements\nOther Requirements","description_format":"text","description_chars":8016,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","IT Outsourcing & Dedicated Teams","Systems Integrators"],"lifecycle":[{"event":"open","at":"2026-10-23T11:53:27Z"}],"visa":[],"liveness":{"score":88,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.88,"p_room":1,"age_days":5,"expected_fill_days":19,"reasons":["conf:1","velocity","win:early","comp:brand"],"computed_at":"2026-10-29T05:49:05Z"},"pay":null,"html_url":"https://alion.io/job/hcltech-apache-spark-technical-specialist-scala-python-2","json_url":"https://alion.io/job/hcltech-apache-spark-technical-specialist-scala-python-2.json","meta":{"generated_at":"2026-10-29T16:15:55Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":24260,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-30T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":225},"rest":"https://alion.io/mcp/rest/get_company?id=225"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fhcltech-apache-spark-technical-specialist-scala-python-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fhcltech-apache-spark-technical-specialist-scala-python-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fhcltech-apache-spark-technical-specialist-scala-python-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/hcltech-apache-spark-technical-specialist-scala-python-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fhcltech-apache-spark-technical-specialist-scala-python-2"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3150325}},{"tool":"search_jobs","arguments":{"company":"hcltech.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3150325},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}