{"id":1284854,"url":"https://alion.io/job/magnet-hr-tech-digital-lead-engineer","title":"Lead Engineer","company":{"id":2674018,"name":"Magnet HR Tech Digital","domain":"magnethrconsultingservices.com","url":"https://alion.io/company/magnet-hr-tech-digital","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Backend","role_family":"Backend","seniority":"lead","employment_type":null,"work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Mumbai, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":20000,"max_usd":51000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":74},"experience_years_min":4,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Azure","optional":false},{"name":"Azure AKS","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"Databricks","optional":false},{"name":"Docker","optional":false},{"name":"ETL/ELT","optional":false},{"name":"FastAPI","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Rest API","optional":false},{"name":"SQL","optional":false},{"name":"Kubernetes","optional":true},{"name":"Spark","optional":true}],"status":"live","first_seen_at":"2026-08-19T08:06:27Z","employer_posted_date":null,"last_verified_at":"2026-08-19T08:06:27Z","board_verified":false,"closed_at":null,"days_open":68,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":68},"description":"Role Overview : \n\nExperience : 4-8 yrs.\n\nAge Limit : Maximum 35 Years.\n\nLocation : On-Site / Hybrid.\n\nEmployment Type : Full-Time.\n\nWe are seeking a high-performing Lead Engineer (API & Data Engineering) to drive our integration platforms and Lakehouse ecosystem. This role sits at the intersection of modern cloud-native API development and large-scale data engineering. \n\nYou will be responsible for designing and deploying high-performance REST APIs (FastAPI) alongside robust, scalable ETL/ELT data pipelines utilizing Databricks, PySpark, Azure Data Factory (ADF), and AKS/ACA. If you excel at bridging technical architecture with stakeholder management across cross-functional business lines, this role offers direct impact and visibility.\n\nKey Competencies : \n\n- Hands-on Problem Solver : Proven ability to troubleshoot, debug, and optimize complex data pipelines and cloud infrastructure.\n\n- Production Governance : Deep understanding of secure data exchange, authentication protocols, and compliance across multi-tenant systems.\n\n- Agile Leadership : Ability to manage day-to-day delivery autonomously while consulting leadership on high-impact architectural decisions.\n\nKey Responsibilities : \n\nAPI & Microservices Engineering : \n\n- Design, build, and maintain scalable, low-latency REST APIs using FastAPI and Python.\n\n- Implement microservices architecture, secure API endpoints, and optimize runtime performance under high-concurrency workloads.\n\nData Engineering & Lakehouse Management : \n\n- Build and optimize enterprise data pipelines using Databricks (PySpark, SQL) and Azure Data Factory (ADF).\n\n- Perform advanced data modeling, schema design, and query optimization for high-volume analytics.\n\nCloud-Native Deployments & Containerization : \n\n- Package microservices and pipelines using Docker.\n\n- Deploy, manage, and monitor containerized workloads on Azure Kubernetes Service (AKS) and Azure Container Apps (ACA).\n\nStakeholder Management & Technical Governance : \n\n- Independently drive maintenance, bug fixes, operational readiness, and stakeholder interactions.\n\n- Collaborate with internal business verticals (Wheels, Collections, Emerging Business) and external partners (FSS Subsidiaries, Data Vendors) to translate requirements into technical solutions.\n\n- Partner with Engineering Management on major architectural calls, infrastructure investments, and technology roadmaps.\n\nDuties & Responsibilities : \n\n- Design, develop, and maintain API-led integration solutions and data engineering pipelines to support business applications.\n\n- Build and enhance scalable REST APIs using frameworks such as FastAPI, ensuring high performance and reliability.\n\n- Develop and optimize data processing workflows using Databricks (PySpark, SQL) for efficient data transformation and analytics.\n\n- Collaborate with business and technical teams to understand requirements and translate them into robust API and data solutions.\n\n- Implement containerized applications using Docker and deploy/manage services on cloud platforms such as Azure Container Apps (ACA) and AKS.\n\n- Develop and manage data integration workflows using Azure Data Factory (ADF) or equivalent to enable seamless data movement across systems.\n\n- Ensure adherence to best practices in API design, microservices architecture, security, and performance optimization.\n\n- Troubleshoot, debug, and resolve issues related to APIs, data pipelines, and cloud deployments.\n\n- Stay updated with emerging technologies and continuously improve technical skills in API engineering, cloud-native development, and data platforms.\n\n- External Stakeholders : FSS Subsidiary members and Data vendors.\n\n5. Key Challenges : \n\n- Ensuring high performance, scalability, and reliability of REST APIs under varying workload conditions.\n\n- Managing secure API integrations and data exchange across multiple systems with proper authentication and governance.\n\n- Deploying, monitoring, and optimizing containerized applications on Docker, ACA, and AKS environments.\n\n- Handling large-scale data processing and optimization in Databricks (PySpark, SQL) while maintaining efficiency.\n\n- Troubleshooting and maintaining stability across APIs, data pipelines, and cloud-native infrastructure.\n\nSkills : \n\n- Develop scalable and high performance REST APIs using FastAPI.\n\n- Strong hands-on experience with Databricks (PySpark, SQL) for data processing.\n\n- Experience in building and managing data pipelines and integrations.\n\n- Proficiency in SQL for data querying, transformation, and optimization.\n\n- Hands-on experience with Docker and deployment on ACA/AKS environments.\n\n- Ability to develop and manage workflows using Azure Data Factory (ADF) or equivalent.\n\n- Good understanding of database design and data architecture.\n\n- Strong debugging, troubleshooting, and performance tuning skills.\n\n- Python programming for API development and data engineering use cases.\nSkills\nData Engineering, Azure Databricks, PySpark, ETL, Native Cloud, DataLake, SQL, Data Pipeline, Data Integration","description_format":"text","description_chars":5038,"description_truncated":false,"requirements":{"experience_years_min":4,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Professional Services","Human Resources","Recruiting & Staffing"],"lifecycle":[{"event":"open","at":"2026-09-26T04:00:00Z"}],"visa":[],"liveness":{"score":10,"band":"cold","label":"Long shot","p_open":0.4,"p_active":0.691,"p_room":0.36,"age_days":67,"expected_fill_days":41,"reasons":["seen:67","velocity","win:tail","crowd:"],"computed_at":"2026-10-26T05:57:25Z"},"pay":null,"html_url":"https://alion.io/job/magnet-hr-tech-digital-lead-engineer","json_url":"https://alion.io/job/magnet-hr-tech-digital-lead-engineer.json","meta":{"generated_at":"2026-10-26T22:24:16Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":30379,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-27T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2674018},"rest":"https://alion.io/mcp/rest/get_company?id=2674018"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fmagnet-hr-tech-digital-lead-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fmagnet-hr-tech-digital-lead-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fmagnet-hr-tech-digital-lead-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/magnet-hr-tech-digital-lead-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fmagnet-hr-tech-digital-lead-engineer"}]}