{"id":2802048,"url":"https://alion.io/job/tech-mahindra-tech-lead-software-engineer-python-pyspark","title":"Tech Lead - Software Engineer -Python Pyspark","company":{"id":5484,"name":"Tech Mahindra","domain":"techmahindra.com","url":"https://alion.io/company/tech-mahindra","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Career site","truth_index":null},"role":"Backend","role_family":"Backend","seniority":"lead","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Chennai, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":23000,"max_usd":54000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":57},"experience_years_min":10,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"ETL/ELT","optional":false},{"name":"GCP","optional":false},{"name":"Hadoop","optional":false},{"name":"NumPy","optional":false},{"name":"Pandas","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Docker","optional":true},{"name":"Git","optional":true},{"name":"Kubernetes","optional":true},{"name":"Machine Learning","optional":true},{"name":"Power BI","optional":true},{"name":"Tableau","optional":true}],"status":"live","first_seen_at":"2026-10-18T03:00:09Z","employer_posted_date":"2026-10-18","last_verified_at":"2026-10-18T06:19:34Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Job Description\n\nSkill Set :\nPython,pyspark\n\nTotal Experience :\n7.00 to 10.00 Years\n\nNo of Openings :\n1\n\nJob Post Date :\n10/09/2026\n\nJob Expiry Date :\n03/11/2026\n\nDomain :\nIT\n\nLocation :\nCHENNAI [India]\n\nJob Reference No :\n4106650\n\nJob Summary\nJob Title: Data Engineer\nLocation: TechM Chennai ELCOT\nYears of Experience: 7 10 Years\nJob Summary:\nWe are seeking a highly skilled Data Engineer with a strong background in Python to join our dynamic team. The ideal candidate will have 7 10 years of experience in data engineering, with a proven track record of designing, building, and maintaining scalable data pipelines and architectures. You will play a crucial role in transforming raw data into actionable insights, enabling data driven decision making across the organization.\nResponsibilities:\nDesign, develop, and maintain robust data pipelines and ETL processes to support data ingestion and transformation.\nCollaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high quality data solutions.\nImplement data models and architectures that support analytics and reporting needs.\nOptimize data storage and retrieval processes for performance and scalability.\nEnsure data quality and integrity through rigorous testing and validation processes.\nMonitor and troubleshoot data pipeline performance, implementing improvements as necessary.\nDocument data engineering processes, architectures, and best practices for future reference.\nStay updated with industry trends and emerging technologies in data engineering and analytics.\nMandatory Skills:\nStrong proficiency in Python, with experience in data manipulation libraries such as Pandas and NumPy.\nExperience with data warehousing solutions and ETL tools.\nSolid understanding of SQL and experience with relational databases.\nFamiliarity with big data technologies such as Hadoop, Spark, or similar frameworks.\nExperience with cloud platforms (e.g., AWS, Azure, GCP) and their data services.\nStrong analytical and problem solving skills.\nPreferred Skills:\nExperience with data visualization tools (e.g., Tableau, Power BI).\nKnowledge of machine learning concepts and frameworks.\nFamiliarity with containerization technologies (e.g., Docker, Kubernetes).\nExperience with version control systems (e.g., Git).\nStrong communication skills and ability to work collaboratively in a team environment.\nQualifications:\nBachelor's or Master's degree in Computer Science, Information Technology, or a related field.\n7 10 years of experience in data engineering or a related role.\nProven experience in building and maintaining data pipelines and architectures.\nStrong understanding of data modeling, data warehousing, and data governance principles.\nIf you are a passionate Data Engineer with a strong foundation in Python and a desire to work in a fast paced environment, we encourage you to apply and join our innovative team at TechM Chennai ELCOT.","description_format":"text","description_chars":2942,"description_truncated":false,"requirements":{"experience_years_min":10,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","IT Outsourcing & Dedicated Teams","Systems Integrators","Business Process Outsourcing (BPO)"],"lifecycle":[{"event":"open","at":"2026-10-18T03:00:09Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":26,"reasons":["conf:1","win:early","comp:brand"],"computed_at":"2026-10-18T07:39:42Z"},"pay":null,"html_url":"https://alion.io/job/tech-mahindra-tech-lead-software-engineer-python-pyspark","json_url":"https://alion.io/job/tech-mahindra-tech-lead-software-engineer-python-pyspark.json","meta":{"generated_at":"2026-10-18T07:39:42Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":11397,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-19T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":5484},"rest":"https://alion.io/mcp/rest/get_company?id=5484"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ftech-mahindra-tech-lead-software-engineer-python-pyspark"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ftech-mahindra-tech-lead-software-engineer-python-pyspark"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ftech-mahindra-tech-lead-software-engineer-python-pyspark"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/tech-mahindra-tech-lead-software-engineer-python-pyspark\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ftech-mahindra-tech-lead-software-engineer-python-pyspark"}]}