{"id":1755991,"url":"https://alion.io/job/powerplan-principal-databricks-software-developer","title":"Principal Databricks Software Developer","company":{"id":2219622,"name":"PowerPlan","domain":"powerplan.com","url":"https://alion.io/company/powerplan-com","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"iCIMS","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"lead","employment_type":null,"work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Atlanta, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":118000,"max_usd":231000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":246},"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"Machine Learning","optional":false},{"name":"Platform Engineering","optional":false},{"name":"Shuffle","optional":false}],"status":"live","first_seen_at":"2026-10-03T10:47:41Z","employer_posted_date":"2026-10-03","last_verified_at":"2026-10-04T22:34:30Z","board_verified":true,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":1},"description":"Overview\nWe're looking for a Senior Principal Databricks Platform Engineer to take ownership of the health, reliability, performance, governance, and cost-effectiveness of PowerPlan's Databricks platform - not from the sidelines, but hands-on with the notebooks, pipelines, clusters, and Unity Catalog work that shapes how teams build.\nWithin your first quarter, you'll be designing the standards teams adopt. Within six months, teams will be bringing you their toughest design decisions before they build, not after something breaks. This is a senior, visible role where the problems are real, and your judgment on reliability, performance, and cost will directly shape how PowerPlan runs Databricks going forward.\nWe're in the middle of one of the most significant transformations in our history. Decades of proven functionality are being reimagined on a modern SaaS foundation, while AI becomes central to how we build, deliver, and evolve our products. The next generation of the PowerPlan platform is being designed right now. Join us, and you'll have the opportunity to influence the technology, engineering practices, and capabilities that will shape it for years to come.\nResponsibilities\nSuccess will be measured by how quickly you turn platform risk into an evidence-based picture leadership can act on, and by how often teams start bringing you their toughest design decisions before they build.\nAudit the platform's highest-priority assets - clusters, jobs, pipelines, notebooks, and access controls - and deliver an evidence-backed picture of the biggest risks within 30 days.\nOwn the design of critical Databricks standards - compute policies, Spark configuration, notebook and pipeline patterns, and Unity Catalog governance - and get teams to actually adopt them.\nServe as the escalation point for complex Databricks failures, performance regressions, and cost anomalies, digging to root cause every time.\nTurn every fix into something reusable - better defaults, templates, reference architectures, and automation instead of one-off patches.\nBecome the person teams check in with before they build, guiding responsible adoption of AI-assisted engineering practices along the way.\nQualifications\n8+ years in data engineering, platform engineering, or related software engineering roles, including 3+ years of deep hands-on Databricks experience.\nProduction experience with Spark internals and performance tuning - shuffle behavior, query planning, adaptive query execution, memory pressure, skew, and partitioning.\nStrong working knowledge of Databricks compute options, cluster policies, instance pools, autoscaling, Photon, and workload right-sizing.\nA track record of reviewing and improving notebooks, jobs, and pipelines built by other people, quickly spotting what's driving runtime, cost, or reliability risk.\nProduction experience with Delta Lake, Structured Streaming, Auto Loader, and data quality practices.\nStrong command of Unity Catalog governance, lineage, permission models, and secure handling of sensitive data.\nExperience designing resilient job orchestration, including dependency management, retries, timeouts, and alerting.\nStrong communication skills, including the judgment to translate technical risk into terms stakeholders can act on.\nBachelor's degree in Computer Science, Engineering, or a related field, or equivalent professional experience.\nPreferred\nDatabricks certification (Certified Data Engineer or Certified Machine Learning Associate).\nExperience with MLOps or feature-store platforms.\nContributions to open-source data engineering tooling.\nPowerPlan is an EOE\nApplicant and Candidate Privacy Notice\nPlease note that this is a hybrid role that involves a combination of onsite work from our corporate office as well as work from home. While we strive to accommodate flexible working arrangements when sensible, there will be times when onsite work is required. This could include scheduled office days, team meetings, client meetings, or special events.","description_format":"text","description_chars":4008,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":true},"security_clearance":false,"languages":[]},"benefits":["Flexible schedule"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Software","Accounting & Tax Software"],"lifecycle":[{"event":"open","at":"2026-10-03T10:47:41Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 2","filings_12m":2,"filings_prev_12m":1,"green_card_filings_12m":0,"median_offered_wage_usd":187500,"route":null,"cap_exempt":false,"checked_at":"2026-10-03T21:08:04+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":0}],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":38,"reasons":["conf:1","win:early"],"computed_at":"2026-10-04T05:45:00Z"},"pay":null,"html_url":"https://alion.io/job/powerplan-principal-databricks-software-developer","json_url":"https://alion.io/job/powerplan-principal-databricks-software-developer.json","meta":{"generated_at":"2026-10-05T00:21:22Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","usage":{"tier":"crawler","counted_by":"address","units_charged":1,"used_today":321,"day_limit":5000,"remaining_today":4679,"minute_limit":60,"resets_at":"2026-10-06T00:00:00Z"}}}