{"id":1909131,"url":"https://alion.io/job/hcltech-senior-administrator-python","title":"Senior Administrator - Python","company":{"id":225,"name":"HCLTech","domain":"hcltech.com","url":"https://alion.io/company/hcltech","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"SuccessFactors","truth_index":null},"role":"Backend","role_family":"Backend","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":[],"countries":[],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Amazon S3","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Azure DevOps","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"ETL/ELT","optional":false},{"name":"GCP","optional":false},{"name":"Git","optional":false},{"name":"GitHub","optional":false},{"name":"GitLab","optional":false},{"name":"MySQL","optional":false},{"name":"Oracle","optional":false},{"name":"PostgreSQL","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Scrum","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Machine Learning","optional":true}],"status":"live","first_seen_at":"2026-10-05T13:59:16Z","employer_posted_date":"2026-10-05","last_verified_at":"2026-10-09T22:27:31Z","board_verified":true,"closed_at":null,"days_open":4,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":4},"description":"Job Summary\nPython & Databricks Developer Role Overview We are looking for a skilled Python and Databricks Developer to design, develop, and optimize scalable data engineering and analytics solutions on the Databricks platform. The role involves working closely with data engineers, data scientists, and client stakeholders to build reliable ETL pipelines and support advanced analytics use cases. Key Responsibilities Data Engineering & Development\nDesign, develop, and maintain ETL/ELT pipelines using Python (PySpark) and Databricks\nBuild and optimize Spark jobs for large scale data processing\nDevelop reusable and modular Python code following best practices\nImplement data transformations, aggregations, and validations Databricks Platform\nCreate and manage Databricks notebooks, jobs, and workflows\nOptimize Spark performance (partitioning, caching, joins, memory tuning)\nWork with Delta Lake (Delta tables, ACID transactions, schema evolution)\nManage Databricks clusters and job scheduling Data Integration\nIngest data from multiple sources: o RDBMS (Oracle, SQL Server, MySQL, PostgreSQL) o Cloud storage (ADLS, S3, Blob Storage) o APIs and streaming sources (Kafka/Event Hubs - preferred)\nEnsure data quality, reliability, and consistency Cloud & DevOps\nWork with Azure / AWS / GCP (based on client environment)\nIntegrate pipelines with CI/CD tools (Azure DevOps, GitHub, GitLab)\nUse Git for version control and collaborative development Collaboration & Client Interaction\nCollaborate with business analysts and data scientists to understand requirements\nParticipate in sprint ceremonies (planning, review, retrospectives)\nSupport client demos, sprint reviews, and technical discussions\nTroubleshoot production issues and perform root cause analysis Required Skills & Qualifications Technical Skills\nStrong hands on experience with Python\nSolid experience with Databricks and Apache Spark (PySpark)\nGood understanding of data warehousing concepts\nExperience with Delta Lake\nStrong SQL skills\nExperience working with large datasets and distributed systems Cloud & Tools\nExperience with at least one cloud platform: o Azure (ADF, ADLS, Azure Databricks) - preferred o or AWS (S3, EMR, Glue)\nExperience with CI/CD, Git, and Agile tooling (JIRA, Azure Boards) Soft Skills\nStrong problem solving and analytical skills\nGood communication and documentation skills\nExperience working in Agile/Scrum delivery models\nAbility to work in client facing environments ________________________________________ Good to Have\nExperience with streaming frameworks (Kafka, Spark Structured Streaming)\nFamiliarity with data governance, security, and access controls\nExposure to machine learning workflows on Databricks\nDatabricks or cloud certifications Experience\n8+ years of overall experience in data engineering\n5+ years of hands on Databricks and Python/PySpark experience\nKey Responsibilities\nPython & Databricks Developer Role Overview We are looking for a skilled Python and Databricks Developer to design, develop, and optimize scalable data engineering and analytics solutions on the Databricks platform. The role involves working closely with data engineers, data scientists, and client stakeholders to build reliable ETL pipelines and support advanced analytics use cases. Key Responsibilities Data Engineering & Development\nDesign, develop, and maintain ETL/ELT pipelines using Python (PySpark) and Databricks\nBuild and optimize Spark jobs for large scale data processing\nDevelop reusable and modular Python code following best practices\nImplement data transformations, aggregations, and validations Databricks Platform\nCreate and manage Databricks notebooks, jobs, and workflows\nOptimize Spark performance (partitioning, caching, joins, memory tuning)\nWork with Delta Lake (Delta tables, ACID transactions, schema evolution)\nManage Databricks clusters and job scheduling Data Integration\nIngest data from multiple sources: o RDBMS (Oracle, SQL Server, MySQL, PostgreSQL) o Cloud storage (ADLS, S3, Blob Storage) o APIs and streaming sources (Kafka/Event Hubs - preferred)\nEnsure data quality, reliability, and consistency Cloud & DevOps\nWork with Azure / AWS / GCP (based on client environment)\nIntegrate pipelines with CI/CD tools (Azure DevOps, GitHub, GitLab)\nUse Git for version control and collaborative development Collaboration & Client Interaction\nCollaborate with business analysts and data scientists to understand requirements\nParticipate in sprint ceremonies (planning, review, retrospectives)\nSupport client demos, sprint reviews, and technical discussions\nTroubleshoot production issues and perform root cause analysis Required Skills & Qualifications Technical Skills\nStrong hands on experience with Python\nSolid experience with Databricks and Apache Spark (PySpark)\nGood understanding of data warehousing concepts\nExperience with Delta Lake\nStrong SQL skills\nExperience working with large datasets and distributed systems Cloud & Tools\nExperience with at least one cloud platform: o Azure (ADF, ADLS, Azure Databricks) - preferred o or AWS (S3, EMR, Glue)\nExperience with CI/CD, Git, and Agile tooling (JIRA, Azure Boards) Soft Skills\nStrong problem solving and analytical skills\nGood communication and documentation skills\nExperience working in Agile/Scrum delivery models\nAbility to work in client facing environments Good to Have\nExperience with streaming frameworks (Kafka, Spark Structured Streaming)\nFamiliarity with data governance, security, and access controls\nExposure to machine learning workflows on Databricks\nDatabricks or cloud certifications Experience\n8+ years of overall experience in data engineering\n5+ years of hands on Databricks and Python/PySpark experience\nSkill Requirements\nPython & Databricks Developer Role Overview We are looking for a skilled Python and Databricks Developer to design, develop, and optimize scalable data engineering and analytics solutions on the Databricks platform. The role involves working closely with data engineers, data scientists, and client stakeholders to build reliable ETL pipelines and support advanced analytics use cases. ________________________________________ Key Responsibilities Data Engineering & Development\nDesign, develop, and maintain ETL/ELT pipelines using Python (PySpark) and Databricks\nBuild and optimize Spark jobs for large scale data processing\nDevelop reusable and modular Python code following best practices\nImplement data transformations, aggregations, and validations Databricks Platform\nCreate and manage Databricks notebooks, jobs, and workflows\nOptimize Spark performance (partitioning, caching, joins, memory tuning)\nWork with Delta Lake (Delta tables, ACID transactions, schema evolution)\nManage Databricks clusters and job scheduling Data Integration\nIngest data from multiple sources: o RDBMS (Oracle, SQL Server, MySQL, PostgreSQL) o Cloud storage (ADLS, S3, Blob Storage) o APIs and streaming sources (Kafka/Event Hubs - preferred)\nEnsure data quality, reliability, and consistency Cloud & DevOps\nWork with Azure / AWS / GCP (based on client environment)\nIntegrate pipelines with CI/CD tools (Azure DevOps, GitHub, GitLab)\nUse Git for version control and collaborative development Collaboration & Client Interaction\nCollaborate with business analysts and data scientists to understand requirements\nParticipate in sprint ceremonies (planning, review, retrospectives)\nSupport client demos, sprint reviews, and technical discussions\nTroubleshoot production issues and perform root cause analysis Required Skills & Qualifications Technical Skills\nStrong hands on experience with Python\nSolid experience with Databricks and Apache Spark (PySpark)\nGood understanding of data warehousing concepts\nExperience with Delta Lake\nStrong SQL skills\nExperience working with large datasets and distributed systems Cloud & Tools\nExperience with at least one cloud platform: o Azure (ADF, ADLS, Azure Databricks) - preferred o or AWS (S3, EMR, Glue)\nExperience with CI/CD, Git, and Agile tooling (JIRA, Azure Boards) Soft Skills\nStrong problem solving and analytical skills\nGood communication and documentation skills\nExperience working in Agile/Scrum delivery models\nAbility to work in client facing environments Good to Have\nExperience with streaming frameworks (Kafka, Spark Structured Streaming)\nFamiliarity with data governance, security, and access controls\nExposure to machine learning workflows on Databricks\nDatabricks or cloud certifications Experience\n8+ years of overall experience in data engineering\n5+ years of hands on Databricks and Python/PySpark experience\nOther Requirements\nPython & Databricks Developer Role Overview We are looking for a skilled Python and Databricks Developer to design, develop, and optimize scalable data engineering and analytics solutions on the Databricks platform. The role involves working closely with data engineers, data scientists, and client stakeholders to build reliable ETL pipelines and support advanced analytics use cases. Key Responsibilities Data Engineering & Development\nDesign, develop, and maintain ETL/ELT pipelines using Python (PySpark) and Databricks\nBuild and optimize Spark jobs for large scale data processing\nDevelop reusable and modular Python code following best practices\nImplement data transformations, aggregations, and validations Databricks Platform\nCreate and manage Databricks notebooks, jobs, and workflows\nOptimize Spark performance (partitioning, caching, joins, memory tuning)\nWork with Delta Lake (Delta tables, ACID transactions, schema evolution)\nManage Databricks clusters and job scheduling Data Integration\nIngest data from multiple sources: o RDBMS (Oracle, SQL Server, MySQL, PostgreSQL) o Cloud storage (ADLS, S3, Blob Storage) o APIs and streaming sources (Kafka/Event Hubs - preferred)\nEnsure data quality, reliability, and consistency Cloud & DevOps\nWork with Azure / AWS / GCP (based on client environment)\nIntegrate pipelines with CI/CD tools (Azure DevOps, GitHub, GitLab)\nUse Git for version control and collaborative development Collaboration & Client Interaction\nCollaborate with business analysts and data scientists to understand requirements\nParticipate in sprint ceremonies (planning, review, retrospectives)\nSupport client demos, sprint reviews, and technical discussions\nTroubleshoot production issues and perform root cause analysis Required Skills & Qualifications Technical Skills\nStrong hands on experience with Python\nSolid experience with Databricks and Apache Spark (PySpark)\nGood understanding of data warehousing concepts\nExperience with Delta Lake\nStrong SQL skills\nExperience working with large datasets and distributed systems Cloud & Tools\nExperience with at least one cloud platform: o Azure (ADF, ADLS, Azure Databricks) - preferred o or AWS (S3, EMR, Glue)\nExperience with CI/CD, Git, and Agile tooling (JIRA, Azure Boards) Soft Skills\nStrong problem solving and analytical skills\nGood communication and documentation skills\nExperience working in Agile/Scrum delivery models\nAbility to work in client facing environments Good to Have\nExperience with streaming frameworks (Kafka, Spark Structured Streaming)\nFamiliarity with data governance, security, and access controls\nExposure to machine learning workflows on Databricks\nDatabricks or cloud certifications Experience\n8+ years of overall experience in data engineering\n5+ years of hands on Databricks and Python/PySpark experience","description_format":"text","description_chars":11404,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","IT Outsourcing & Dedicated Teams","Systems Integrators"],"lifecycle":[{"event":"open","at":"2026-10-05T13:59:16Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":3,"expected_fill_days":22,"reasons":["conf:3","velocity","win:early","comp:brand"],"computed_at":"2026-10-09T06:01:00Z"},"pay":null,"html_url":"https://alion.io/job/hcltech-senior-administrator-python","json_url":"https://alion.io/job/hcltech-senior-administrator-python.json","meta":{"generated_at":"2026-10-10T00:22:25Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler","counted_by":"address","units_charged":1,"used_today":549,"day_limit":5000,"remaining_today":4451,"minute_limit":60,"resets_at":"2026-10-11T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":225},"rest":"https://alion.io/mcp/rest/get_company?id=225"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fhcltech-senior-administrator-python"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fhcltech-senior-administrator-python"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fhcltech-senior-administrator-python"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/hcltech-senior-administrator-python\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fhcltech-senior-administrator-python"}]}