{"id":2769423,"url":"https://alion.io/job/tata-consultancy-services-adf-databricks-pyspark-python-terraform","title":"ADF Databricks Pyspark Python Terraform","company":{"id":222,"name":"Tata Consultancy Services","domain":"tcs.com","url":"https://alion.io/company/tata-consultancy-services","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Career site","truth_index":{"grade":"A","score":100,"open_postings":153,"ghost_share":0,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":2,"computed_at":"2026-10-26T05:57:25Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Hyderabad, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":17500,"max_usd":38000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":75},"experience_years_min":6,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Azure","optional":false},{"name":"Azure Cosmos DB","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"Azure DevOps","optional":false},{"name":"Azure SQL Database","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Git","optional":false},{"name":"PostgreSQL","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Scrum","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false}],"status":"live","first_seen_at":"2026-10-07T13:42:21Z","employer_posted_date":null,"last_verified_at":"2026-10-07T13:42:21Z","board_verified":false,"closed_at":null,"days_open":19,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":19},"description":"TCS Hiring for ADF Databricks Pyspark Python Terraform\n\nExperience Range: - 06 To 09 Years (Mandatory)\n(Note: Candidates below 6 years of IT experience shall not be considered)\nJOB LOCATION: Hyderabad, Pune & Indore\n\nJOB DESCRIPTION\n\nKey Responsibilities:\n\nDesign and develop scalable ETL/ELT pipelines using Azure Data Factory and Azure Databricks.\nDevelop batch and near real-time data processing solutions using PySpark and Python.\nBuild and maintain enterprise data lakes and data warehouse solutions.\nImplement data ingestion frameworks for structured, semi-structured, and unstructured data.\nDevelop reusable data transformation and data quality frameworks.\nProvision and manage Azure infrastructure using Terraform.\nOptimize Databricks jobs, clusters, and Spark workloads for performance and cost efficiency.\nImplement CI/CD pipelines and deployment automation.\nCollaborate with architects, data analysts, and business stakeholders to gather requirements.\nPerform data validation, monitoring, troubleshooting, and production support.\nEnsure compliance with security, governance, and data management standards.\n\nDesired Candidate Profile:\n\nStrong hands-on experience in Azure Databricks, ADF, PySpark, Python, and Terraform.\nExperience building scalable cloud-native data platforms.\nStrong understanding of data lake, data warehouse, and ETL concepts.\nExpertise in Spark performance tuning and optimization.\nExcellent problem-solving and analytical skills.\nExperience working in Agile/Scrum environments.\nStrong communication and stakeholder management skills.\n\nMandatory Technical Skills:\n\n1) Azure Services: Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage Gen2 (ADLS), Azure Key Vault, Azure Monitor, Azure DevOps, Azure SQL Database\n\n2) Programming & Data Engineering: Python, PySpark, SQL, Apache Spark, Data Modeling, ETL/ELT Development, Data Warehousing Concepts\n\n3) Infrastructure as Code: Terraform, Azure Resource Management, Infrastructure Automation\n4) DevOps & Version Control: Azure DevOps, Git, CI/CD Pipelines\n5) Databases: Azure SQL, SQL Server, PostgreSQL, Cosmos DB (Preferred)\n\nMinimum Qualification:\n15 years of Full Time Education\n\nInterested candidates kindly share your updated resume to [HIDDEN TEXT] along with filling the following details to maximize your chances of getting calls from TCS. The details are as follows:\n\nSection 1: Basic Details:\nCandidate Name:\n\nCurrent Location (City):\nPreferred Location (City):\n\nSection 2: Educational Details:\nHighest Regular Full‑Time Qualification\n(Diploma / Graduation / Post Graduation / Others)\n10th Completion Year\n12th / Intermediate Completion Year\nGraduation Completion Year\nPost‑Graduation Completion Year (if applicable)\n\nSection 3: Work Experience:\nCurrent Company Name\nTotal Experience (in years)\nNumber of Companies Worked\nEmployment Timeline\n(Example: Company A – 2021 to Present, Company B – 2019 to 2021)\n\nSection 4: Compensation Details:\n\nCurrent CTC (in LPA)\nExpected CTC (in LPA)\nNotice Period\n(Immediate / 15 Days / 30 Days / 60+ Days)\n\nSection 5: Documentation & Compliance (Yes / No):\n\nValid ID Proof Available (Aadhar & Pan Card): (Yes/No)\nEducational Documents Available: (Yes/No)\nEmployment Documents Available: (Yes/No)\nUAN Number Available: (Yes/No)","description_format":"text","description_chars":3269,"description_truncated":false,"requirements":{"experience_years_min":6,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","IT Outsourcing & Dedicated Teams","Systems Integrators","Management Consulting"],"lifecycle":[{"event":"open","at":"2026-10-17T03:17:59Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 4,185 · green card filings: 2","filings_12m":4185,"filings_prev_12m":8047,"green_card_filings_12m":2,"median_offered_wage_usd":92524,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":87},{"country":"GB","licensed_sponsor":true,"evidence":"Licensed UK visa sponsor (Graduate Trainee, Senior or Specialist Worker, Skilled Worker)","filings_12m":null,"filings_prev_12m":null,"green_card_filings_12m":null,"median_offered_wage_usd":null,"route":"Global Business Mobility: Graduate Trainee; Global Business Mobility: Senior or Specialist Worker; Skilled Worker","cap_exempt":false,"checked_at":"2026-10-24T06:24:00+00:00","sources":["UK Home Office: register of licensed sponsors (workers)"],"filings_for_role_12m":0}],"liveness":{"score":6,"band":"cold","label":"Long shot","p_open":0.85,"p_active":0.209,"p_room":0.35,"age_days":18,"expected_fill_days":2,"reasons":["seen:18","velocity","win:tail","comp:brand"],"computed_at":"2026-10-26T05:57:25Z"},"pay":null,"html_url":"https://alion.io/job/tata-consultancy-services-adf-databricks-pyspark-python-terraform","json_url":"https://alion.io/job/tata-consultancy-services-adf-databricks-pyspark-python-terraform.json","meta":{"generated_at":"2026-10-26T23:44:17Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":32503,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-27T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":222},"rest":"https://alion.io/mcp/rest/get_company?id=222"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ftata-consultancy-services-adf-databricks-pyspark-python-terraform"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ftata-consultancy-services-adf-databricks-pyspark-python-terraform"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ftata-consultancy-services-adf-databricks-pyspark-python-terraform"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/tata-consultancy-services-adf-databricks-pyspark-python-terraform\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ftata-consultancy-services-adf-databricks-pyspark-python-terraform"}]}