{"id":3102497,"url":"https://alion.io/job/tech-mahindra-python-spark-apache-iceberg-chennai-bangalore-location","title":"Python Spark Apache Iceberg - Chennai/ Bangalore Location","company":{"id":5484,"name":"Tech Mahindra","domain":"techmahindra.com","url":"https://alion.io/company/tech-mahindra","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Career site","truth_index":null},"role":"Backend","role_family":"Backend","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":14500,"max_usd":34000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":168},"experience_years_min":7,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"ETL/ELT","optional":false},{"name":"GCP","optional":false},{"name":"Google BigQuery","optional":false},{"name":"MySQL","optional":false},{"name":"NumPy","optional":false},{"name":"Pandas","optional":false},{"name":"PostgreSQL","optional":false},{"name":"Python","optional":false},{"name":"Snowflake","optional":false},{"name":"SQL","optional":false},{"name":"Talend","optional":false},{"name":"Git","optional":true},{"name":"Hadoop","optional":true},{"name":"Machine Learning","optional":true},{"name":"Power BI","optional":true},{"name":"Spark","optional":true},{"name":"Tableau","optional":true}],"status":"live","first_seen_at":"2026-10-22T17:47:58Z","employer_posted_date":"2026-10-22","last_verified_at":"2026-10-30T00:32:54Z","board_verified":true,"closed_at":null,"days_open":7,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":7},"description":"Job Description\n\nSkill Set :\nPython\n\nTotal Experience :\n4.00 to 10.00 Years\n\nNo of Openings :\n1\n\nJob Post Date :\n02/10/2026\n\nJob Expiry Date :\n31/12/2026\n\nDomain :\nIT\n\nLocation :\nBENGALURU [India]\n\nJob Reference No :\n4110422\n\nJob Summary\nJob Title: Data Engineer\nLocation: TechM Blr ECITY\nYears of Experience: 5 7 Years\nJob Summary:\nWe are seeking a skilled Data Engineer with a strong background in Python to join our dynamic team at TechM. The ideal candidate will have 5 7 years of experience in data engineering, with a proven track record of designing, building, and maintaining scalable data pipelines and architectures. You will play a crucial role in transforming raw data into actionable insights, enabling data driven decision making across the organization.\nResponsibilities:\nDesign, develop, and maintain robust data pipelines to support data ingestion, transformation, and storage.\nCollaborate with data scientists and analysts to understand data requirements and deliver high quality datasets.\nImplement data models and architectures that ensure data integrity, availability, and security.\nOptimize data processing workflows for performance and scalability.\nMonitor and troubleshoot data pipeline issues, ensuring timely resolution.\nDocument data engineering processes, architectures, and best practices.\nStay updated with industry trends and emerging technologies in data engineering.\nMandatory Skills:\nStrong proficiency in Python, with experience in data manipulation libraries such as Pandas and NumPy.\nExperience with data warehousing solutions (e.g., Snowflake, Redshift, BigQuery).\nFamiliarity with ETL tools and frameworks (e.g., Apache Airflow, Talend).\nSolid understanding of SQL and experience with relational databases (e.g., MySQL, PostgreSQL).\nKnowledge of cloud platforms (e.g., AWS, Azure, GCP) and their data services.\nPreferred Skills:\nExperience with big data technologies (e.g., Hadoop, Spark).\nFamiliarity with data visualization tools (e.g., Tableau, Power BI).\nUnderstanding of machine learning concepts and frameworks.\nExperience with version control systems (e.g., Git).\nStrong problem solving skills and attention to detail.\nQualifications:\nBachelor's degree in Computer Science, Engineering, or a related field.\n5 7 years of experience in data engineering or a related role.\nProven ability to work collaboratively in a team environment.\nExcellent communication skills, both verbal and written.\nIf you are passionate about data and have the required skills, we invite you to apply for this exciting opportunity to contribute to our data driven initiatives at TechM.","description_format":"text","description_chars":2605,"description_truncated":false,"requirements":{"experience_years_min":7,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Information Technology","Professional Services","Systems Integrators","Business Process Outsourcing (BPO)"],"lifecycle":[{"event":"open","at":"2026-10-22T17:47:58Z"}],"visa":[],"liveness":{"score":39,"band":"fade","label":"Fading","p_open":1,"p_active":0.706,"p_room":0.55,"age_days":6,"expected_fill_days":5,"reasons":["conf:3","velocity","win:tail","comp:brand"],"computed_at":"2026-10-29T05:49:05Z"},"pay":null,"html_url":"https://alion.io/job/tech-mahindra-python-spark-apache-iceberg-chennai-bangalore-location","json_url":"https://alion.io/job/tech-mahindra-python-spark-apache-iceberg-chennai-bangalore-location.json","meta":{"generated_at":"2026-10-30T04:07:10Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":5566,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-31T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":5484},"rest":"https://alion.io/mcp/rest/get_company?id=5484"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ftech-mahindra-python-spark-apache-iceberg-chennai-bangalore-location"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ftech-mahindra-python-spark-apache-iceberg-chennai-bangalore-location"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ftech-mahindra-python-spark-apache-iceberg-chennai-bangalore-location"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/tech-mahindra-python-spark-apache-iceberg-chennai-bangalore-location\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ftech-mahindra-python-spark-apache-iceberg-chennai-bangalore-location"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3102497}},{"tool":"search_jobs","arguments":{"company":"techmahindra.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3102497},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}