{"id":3575241,"url":"https://alion.io/job/anblicks-sr-data-engineer-databricks","title":"Sr. Data Engineer - Databricks","company":{"id":2303504,"name":"Anblicks","domain":"anblicks.com","url":"https://alion.io/company/anblicks","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Keka","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"explicit","locations":["Hyderabad, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":19500,"max_usd":42000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":75},"experience_years_min":6,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Databricks","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Java","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"AWS","optional":true},{"name":"CI/CD","optional":true},{"name":"Delta Lake","optional":true},{"name":"Git","optional":true}],"status":"live","first_seen_at":"2026-10-31T17:38:46Z","employer_posted_date":null,"last_verified_at":"2026-10-31T17:38:46Z","board_verified":false,"closed_at":null,"days_open":1,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":1},"description":"Job Role: Senior Data Engineer – Databricks\n\nLocation: Hyderabad, India (Hybrid)\n\nExperience: 6+ Years\n\nNumber of Positions: 6\n\nRole Overview\n\nAnblicks is looking for experienced Senior Data Engineers to design, build, and optimize scalable data platforms and high-performance ETL/ELT pipelines using Databricks, Apache Spark, Python, Java, and SQL.\n\nThe ideal candidate will have strong hands-on experience in building enterprise-grade data solutions, processing large-scale datasets, optimizing distributed data workloads, and implementing reliable data ingestion and transformation frameworks. The role will involve working closely with data, cloud, analytics, and engineering teams to deliver scalable and high-quality data solutions.\n\nKey Responsibilities\n\nDesign, develop, and maintain scalable ETL/ELT data pipelines using Databricks and Apache Spark.\nBuild robust data ingestion, transformation, processing, and validation frameworks for large-scale datasets.\nDevelop and optimize data processing workloads using Python, Java, Spark, and SQL.\nWork extensively with Databricks to develop scalable data engineering solutions and production-grade pipelines.\nImplement efficient data transformation and storage solutions using modern data engineering practices.\nWrite complex and optimized SQL queries for large-volume data processing and analytics.\nPerform performance tuning and optimization of Spark jobs, SQL queries, pipelines, and data processing workloads.\nImplement data quality checks, validation frameworks, monitoring, logging, and error-handling mechanisms.\nWork with stakeholders, data analysts, architects, and engineering teams to understand requirements and deliver effective data solutions.\nContribute to the design and implementation of cloud-based data platforms and modern data architectures.\nTroubleshoot production issues and ensure the reliability, scalability, and performance of data pipelines.\nFollow data engineering best practices related to security, governance, data quality, and operational excellence.\nMentor junior engineers and contribute to technical standards, reusable frameworks, and engineering best practices.\n\nRequired Qualifications\n\n6 - 10 years of professional experience in software development and/or data engineering, with proven experience delivering production-grade data solutions.\nStrong hands-on experience in Data Engineering and ETL/ELT development.\nStrong experience with Databricks and Apache Spark.\nStrong programming skills in Python and Java.\nAdvanced proficiency in SQL, including query optimization and working with large datasets.\nExperience designing and developing scalable data pipelines and distributed data processing solutions.\nStrong understanding of data warehousing, data modeling, and large-scale data processing.\nHands-on experience with data ingestion, transformation, data quality, and pipeline optimization.\nStrong troubleshooting, debugging, and performance tuning capabilities.\nExperience working in Agile development environments and collaborating with cross-functional teams.\n\nPreferred Qualifications\n\nExperience working with AWS cloud services and cloud-based data platforms.\nExperience with Delta Lake and modern Databricks data engineering capabilities.\nKnowledge of Databricks Workflows, Jobs, notebooks, clusters, and deployment practices.\nExperience with CI/CD, Git, and DevOps practices for data engineering.\nExposure to AdTech, MarTech, Customer Data Platforms (CDP), or customer analytics environments.\nExperience working with high-volume, complex, and diverse datasets.\n\nEducation\n\nBachelor's degree in Computer Science, Computer Engineering, Software Engineering, or a related technical field, or equivalent professional experience.Skills\nJava, Apache Spark, Databricks, Python, Sql","description_format":"text","description_chars":3778,"description_truncated":false,"requirements":{"experience_years_min":6,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"India","iso":"IN","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Machine Learning","Analytics & BI Consulting"],"lifecycle":[{"event":"open","at":"2026-10-31T20:09:45Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":1,"expected_fill_days":28,"reasons":["seen:1","velocity","win:early"],"computed_at":"2026-11-02T06:13:15Z"},"pay":null,"html_url":"https://alion.io/job/anblicks-sr-data-engineer-databricks","json_url":"https://alion.io/job/anblicks-sr-data-engineer-databricks.json","meta":{"generated_at":"2026-11-02T15:24:29Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":21316,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-03T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2303504},"rest":"https://alion.io/mcp/rest/get_company?id=2303504"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fanblicks-sr-data-engineer-databricks"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fanblicks-sr-data-engineer-databricks"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fanblicks-sr-data-engineer-databricks"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/anblicks-sr-data-engineer-databricks\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fanblicks-sr-data-engineer-databricks"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3575241}},{"tool":"search_jobs","arguments":{"company":"anblicks.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3575241},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}