{"id":118823,"url":"https://alion.io/job/shield-ai-sr-staff-platformdata-reliability-engineer-databricks-r5537","title":"Sr. Staff Platform/Data Reliability Engineer, Databricks (R5537)","company":{"id":50,"name":"Shield AI","domain":"shield.ai","url":"https://alion.io/company/shield-ai","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Lever","truth_index":{"grade":"B","score":74,"open_postings":83,"ghost_share":0,"stale_share":0.843,"repost_share":0.012,"time_to_fill_p50_days":65,"computed_at":"2026-10-30T05:48:23Z"}},"role":"Data Science","role_family":"Data Science","seniority":"staff","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":[],"countries":[],"hiring_countries":["US"],"hiring_countries_total":1,"salary":{"min":180000,"max":270000,"currency":"USD","period":"year","gross":null,"usd_annual":270000},"salary_estimate":null,"experience_years_min":12,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Incident Management","optional":false},{"name":"Platform Engineering","optional":false},{"name":"SRE","optional":false},{"name":"Delta Lake","optional":true}],"status":"live","first_seen_at":"2026-08-12T06:16:45Z","employer_posted_date":"2026-08-12","last_verified_at":"2026-10-30T23:24:46Z","board_verified":true,"closed_at":null,"days_open":79,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":79},"description":"Job Description:\nThe Sr. Staff Platform / Data Reliability Engineer is responsible for making Databricks a reliable, secure, scalable, and operationally mature platform for enterprise use. This role focuses on the platform itself rather than domain-specific business modeling, ensuring the lakehouse can support multiple domains, regulated data handling, and a growing set of production workloads without becoming fragile, expensive, or hard to govern.\nThis role partners closely with the Senior Staff Data Engineer, who focuses more heavily on ingestion and medallion implementation patterns, and with the existing Cloud & Infrastructure team, which owns cloud accounts, networking, and foundational infrastructure. The Platform / Data Reliability Engineer owns the Databricks operational layer that sits above that foundation: reliability, observability, deployment standards, compute and job policies, and platform enablement patterns for internal users.\nWhat you'll do:\nOwn operational excellence for the Databricks platform, including monitoring, alerting, observability, incident response support, and production runbook patterns for data jobs and platform services. \nDefine and maintain CI/CD and promotion standards for Databricks assets, including workflows, jobs, notebooks, code packages, infrastructure configuration, and environment promotion from dev to prod. \nDesign and maintain platform standards for job orchestration, cluster and compute policies, service principal usage, environment isolation, and production execution reliability. \nEstablish reusable operational templates and enablement patterns for new domains onboarding to Databricks, including logging conventions, job tagging, metadata capture, and support handoff expectations. \nPartner with the Senior Data Engineer to ensure ingestion and medallion patterns are implemented in a way that is observable, recoverable, cost-aware, and secure in production. \nWork with the cloud/infrastructure team to align Databricks configuration and usage patterns with broader enterprise cloud standards, especially where commercial and future government-hosted environments are involved. \nHelp enforce technical controls for data segregation, access boundaries, and operational compliance in a highly regulated environment. \nTrack and improve platform health metrics such as job success rates, incident trends, data pipeline reliability, cost efficiency, and environment drift. \nDocument platform standards, operational expectations, and support models so the Databricks platform can scale beyond a small founding team. \nMentor internal engineers who are growing into platform responsibilities, helping expand Databricks operational knowledge within the team. \nRequired qualifications:\n12+ years of relevant experience in data platform engineering, platform operations, site reliability engineering, or modern cloud data infrastructure. \nHands-on experience with Databricks or a closely related cloud data platform in production environments. \nExperience designing or operating CI/CD, environment promotion, version control, and deployment automation for data platforms and pipelines. \nStrong understanding of platform operations concepts such as observability, monitoring, alerting, incident management, and reliability engineering. \nExperience with compute policy design, workload isolation, service principals, and secure production execution patterns on cloud data platforms. \nAbility to work effectively in a regulated or security-sensitive environment with strong expectations around access control, auditability, and operational discipline. \nStrong collaboration skills and comfort partnering with cloud/infrastructure, security, data engineering, and analytics stakeholders. \nPreferred qualifications:\nDatabricks certification and/or strong demonstrated expertise with Delta Lake, Unity Catalog, Workflows, and Databricks Asset Bundles. \nExperience with infrastructure-as-code and platform automation in enterprise environments. \nExperience supporting commercial and government or otherwise segregated environments with different compliance and access requirements. \nExperience in defense, aerospace, federal, or another regulated industry.","description_format":"text","description_chars":4214,"description_truncated":false,"requirements":{"experience_years_min":12,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"phd","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Military Drones","Defense Manufacturing","Defense AI","Drone AI"],"lifecycle":[{"event":"open","at":"2026-08-12T06:16:45Z"},{"event":"close","at":"2026-10-12T16:29:36Z"},{"event":"reopen","at":"2026-10-13T00:21:21Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 2","filings_12m":2,"filings_prev_12m":2,"green_card_filings_12m":0,"median_offered_wage_usd":132500,"route":null,"cap_exempt":false,"checked_at":"2026-10-29T16:27:21+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":0}],"liveness":{"score":21,"band":"cold","label":"Long shot","p_open":1,"p_active":0.475,"p_room":0.44,"age_days":78,"expected_fill_days":65,"reasons":["conf:0","stale_co","velocity","win:tail","crowd:brand"],"computed_at":"2026-10-30T05:48:23Z"},"pay":{"stated_usd_annual":270000,"is_top_pay":true},"html_url":"https://alion.io/job/shield-ai-sr-staff-platformdata-reliability-engineer-databricks-r5537","json_url":"https://alion.io/job/shield-ai-sr-staff-platformdata-reliability-engineer-databricks-r5537.json","meta":{"generated_at":"2026-10-31T03:17:45Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":4600,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-01T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":50},"rest":"https://alion.io/mcp/rest/get_company?id=50"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fshield-ai-sr-staff-platformdata-reliability-engineer-databricks-r5537"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fshield-ai-sr-staff-platformdata-reliability-engineer-databricks-r5537"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fshield-ai-sr-staff-platformdata-reliability-engineer-databricks-r5537"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/shield-ai-sr-staff-platformdata-reliability-engineer-databricks-r5537\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fshield-ai-sr-staff-platformdata-reliability-engineer-databricks-r5537"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":118823}},{"tool":"search_jobs","arguments":{"company":"shield.ai","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":118823},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}