{"id":2786615,"url":"https://alion.io/job/syrencloud-databricks-data-engineer","title":"Databricks Data Engineer","company":{"id":4442673,"name":"Syren","domain":"syrencloud.com","url":"https://alion.io/company/syrencloud","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Keka","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Hyderabad, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":17000,"max_usd":45000,"period":"year","method":"role_country_seniority_unknown","sample_n":141},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"ETL/ELT","optional":false},{"name":"GCP","optional":false},{"name":"Git","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Apache Kafka","optional":true},{"name":"Azure Data Factory","optional":true},{"name":"Terraform","optional":true}],"status":"live","first_seen_at":"2026-08-04T12:58:43Z","employer_posted_date":"2026-08-04","last_verified_at":"2026-10-18T08:12:24Z","board_verified":true,"closed_at":null,"days_open":74,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":74},"description":"Job Title: Databricks Data Engineer\nExperience: 3+\nEmployment Type: Full-Time\nCertification: Databricks Professional-level certification - Mandatory\nJob Overview\nWe are looking for an experienced Databricks Data Engineer with strong hands-on expertise in building scalable data engineering solutions using Databricks, Python, PySpark, Spark SQL, and SQL.\nThe ideal candidate will be responsible for designing and developing data pipelines, implementing Lakehouse architectures, optimizing large-scale data processing workloads, and ensuring data quality, governance, and performance across the data platform.\nCandidates must hold a relevant Databricks Professional-level certification.\nKey Responsibilities\nDesign, develop, and maintain scalable data pipelines using Databricks.\nDevelop ETL/ELT pipelines using Python, PySpark, Spark SQL, and SQL.\nBuild and maintain Lakehouse solutions using Databricks and Delta Lake.\nImplement Bronze, Silver, and Gold layers using Medallion Architecture.\nDevelop and optimize Databricks notebooks, jobs, and workflows.\nProcess and transform large volumes of structured and semi-structured data.\nOptimize Spark workloads for performance, scalability, and cost efficiency.\nImplement data quality checks, validation, error handling, and monitoring.\nWork with Unity Catalog for data governance, access control, and metadata management.\nIntegrate Databricks with cloud storage, databases, APIs, and other enterprise data sources.\nTroubleshoot pipeline failures and resolve performance issues.\nCollaborate with Data Architects, Analysts, Data Scientists, and business stakeholders.\nFollow engineering best practices for version control, CI/CD, testing, documentation, and production deployments.\nMandatory Skills\nStrong hands-on experience with Databricks.\nStrong experience with Python and PySpark.\nStrong knowledge of Spark SQL and SQL.\nExperience developing production-grade ETL/ELT data pipelines.\nExperience with Delta Lake and Lakehouse Architecture.\nUnderstanding of Medallion Architecture.\nExperience working with large-scale data processing using Apache Spark.\nExperience with Databricks Workflows/Jobs.\nKnowledge of data modeling, data quality, and performance optimization.\nExperience with at least one cloud platform: Azure, AWS, or GCP.\nGood understanding of Git/version control and CI/CD practices.\nMandatory Certification\nCandidate must hold a relevant Databricks Professional-level certification.\nFor a Data Engineer requirement, you can make this more specific:\nDatabricks Certified Data Engineer Professional - Mandatory\nCandidates holding only an Associate-level certification should not be considered.\nPreferred Skills\nUnity Catalog\nDatabricks Asset Bundles\nDelta Live Tables / Lakeflow Declarative Pipelines\nDatabricks SQL\nCI/CD for Databricks workloads\nTerraform\nAzure Data Factory / AWS data services / GCP data services\nData governance and security\nStreaming technologies such as Kafka or Spark Structured Streaming\nMigration from legacy/on-premise data platforms to Databricks\nKey Skills\nDatabricks, PySpark, Python, Apache Spark, Spark SQL, SQL, Delta Lake, Lakehouse, Medallion Architecture, Unity Catalog, ETL, ELT, Data Engineering, Databricks Workflows, CI/CD, Cloud Data Engineering","description_format":"text","description_chars":3244,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-10-17T15:35:14Z"}],"visa":[],"liveness":{"score":9,"band":"cold","label":"Long shot","p_open":1,"p_active":0.319,"p_room":0.28,"age_days":74,"expected_fill_days":22,"reasons":["conf:3","win:tail","crowd:"],"computed_at":"2026-10-18T11:30:45Z"},"pay":null,"html_url":"https://alion.io/job/syrencloud-databricks-data-engineer","json_url":"https://alion.io/job/syrencloud-databricks-data-engineer.json","meta":{"generated_at":"2026-10-18T11:30:45Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":17057,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-19T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4442673},"rest":"https://alion.io/mcp/rest/get_company?id=4442673"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsyrencloud-databricks-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsyrencloud-databricks-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsyrencloud-databricks-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/syrencloud-databricks-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsyrencloud-databricks-data-engineer"}]}