{"id":3711959,"url":"https://alion.io/job/airswift-senior-azure-databricks-engineer","title":"Senior Azure Databricks Engineer","company":{"id":2751907,"name":"Airswift","domain":"airswift.com","url":"https://alion.io/company/airswift-com","size_band":"5000+","is_staffing_agency":false,"employer_type":"staffing","is_intermediary":false,"listed_via":null,"ats_vendor":"Schema","truth_index":{"grade":"A","score":91,"open_postings":41,"ghost_share":0,"stale_share":0.146,"repost_share":0,"time_to_fill_p50_days":90,"computed_at":"2026-11-14T05:58:10Z"}},"role":"DevOps","role_family":"DevOps","seniority":"senior","employment_type":"contractor","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Glendale, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"Azure DevOps","optional":false},{"name":"CI/CD","optional":false},{"name":"Data Vault","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Microsoft Entra ID","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Vault","optional":false}],"status":"live","first_seen_at":"2026-10-14T00:00:00Z","employer_posted_date":"2026-11-03","last_verified_at":"2026-11-14T04:21:00Z","board_verified":true,"closed_at":null,"days_open":31,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":31},"description":"Job reference\n1281864\nLocation\nGlendale, Arizona, United States\nSector\nEnergy - Oil & Gas\nFunction\nEngineering & Design\nEmployment type\nContract\nDate published\nOctober 14, 2026\nJob Title: Senior Azure Databricks Engineer\nDuration: 12 months\nSchedule: 5-40 schedule\nLocation: Glendale, AZ\nThis opportunity is focused on designing and implementing scalable enterprise data platform solutions in a modern Azure environment. The role will support enterprise data engineering frameworks across batch, streaming, ELT/ETL, and real-time analytics workloads, with strong emphasis on Azure Databricks, Delta Lake, Unity Catalog, and Azure Data Lake Storage Gen2. This position offers involvement in platform architecture, governance, security, performance optimisation, and migration to a modern Lakehouse architecture.\nRequired Experience:\nAt least 8-10 years of experience designing and implementing enterprise data platforms\nAt least 5 years of hands-on experience with Azure Databricks in enterprise environments\nExperience architecting modern Lakehouse solutions using Azure Databricks and Delta Lake\nExperience administering Azure Databricks workspaces, clusters, Unity Catalog, compute policies, job orchestration, and workspace security\nExperience implementing enterprise data governance including metadata management, data lineage, and fine-grained access controls\nExperience designing enterprise security architectures including RBAC, managed identities, private endpoints, Key Vault integration, encryption, and network security\nExperience implementing enterprise data quality frameworks, monitoring, observability, and operational dashboards\nExperience supporting migration of legacy enterprise data warehouses, ETL solutions, and reporting platforms to Azure Databricks and modern Lakehouse architecture\nExperience providing technical support and troubleshooting for production incidents related to Databricks, Spark workloads, data pipelines, and platform infrastructure\nRequired Skills:\nStrong capability in designing and developing enterprise data engineering frameworks for batch, streaming, ELT/ETL, and real-time analytics workloads\nAdvanced knowledge of Azure Databricks, Delta Lake, Unity Catalog, and Azure Data Lake Storage Gen2\nStrong experience with Apache Spark, including PySpark and Spark SQL development\nStrong SQL programming skills with proficiency in Python and PySpark\nStrong understanding of data modelling techniques including dimensional modelling, Data Vault, medallion architecture, and enterprise data warehouse concepts\nKnowledge of Azure Key Vault, Azure Monitor, Microsoft Entra ID, and Azure networking\nAbility to optimise Databricks workloads through Spark tuning, cluster sizing, workload isolation, caching, partitioning, Delta optimisation, Photon, and cost optimisation practices\nAbility to design enterprise monitoring, logging, dashboards, alerting, and platform health monitoring using Azure Monitor, Log Analytics, Application Insights, and Databricks system tables\nExperience implementing CI/CD pipelines using Azure DevOps, automated testing, release management, and deployment automation\nAbility to develop reusable architecture patterns, reference implementations, development standards, naming conventions, coding standards, operational procedures, and platform documentation\nAbout Airswift:\nAirswift is an international workforce solutions provider within the energy, process and infrastructure industries. Airswift serves as a strategic partner to clients, offering a turnkey workforce solution to capture and deliver the top talent needed to complete successful projects by aligning with unique project needs. With over 1000 employees and 9,000 contractors operating in over 60 countries, Airswift's geographical reach and pool of talent available is unmatched in the industry.\nNot the job you are looking for? Search hundreds more\nSearch Now.","description_format":"text","description_chars":3894,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-11-03T23:39:45Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":31,"expected_fill_days":90,"reasons":["conf:1","velocity","win:early","comp:brand"],"computed_at":"2026-11-14T05:58:10Z"},"pay":null,"html_url":"https://alion.io/job/airswift-senior-azure-databricks-engineer","json_url":"https://alion.io/job/airswift-senior-azure-databricks-engineer.json","meta":{"generated_at":"2026-11-14T18:24:20Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":21848,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-15T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2751907},"rest":"https://alion.io/mcp/rest/get_company?id=2751907"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fairswift-senior-azure-databricks-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fairswift-senior-azure-databricks-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fairswift-senior-azure-databricks-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/airswift-senior-azure-databricks-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fairswift-senior-azure-databricks-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3711959}},{"tool":"search_jobs","arguments":{"company":"airswift.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3711959},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}