{"id":65898,"url":"https://alion.io/job/doordash-software-engineer-spark-platform","title":"Software Engineer, Spark Platform","company":{"id":3685,"name":"DoorDash","domain":"doordash.com","url":"https://alion.io/company/doordash-usa","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"B","score":81,"open_postings":78,"ghost_share":0,"stale_share":0.564,"repost_share":0.013,"time_to_fill_p50_days":65,"computed_at":"2026-10-20T05:45:00Z"}},"role":"Backend","role_family":"Backend","seniority":"junior","employment_type":null,"work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Francisco, United States","New York, United States","Seattle, United States","Sunnyvale, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":6,"max":25,"currency":"PEN","period":"hour","gross":null,"usd_annual":14000},"salary_estimate":null,"experience_years_min":2,"visa_sponsorship":false,"relocation_package":false,"has_equity":true,"technologies":[{"name":"AWS","optional":false},{"name":"Databricks","optional":false},{"name":"Java","optional":false},{"name":"Kubernetes","optional":false},{"name":"OpenTelemetry","optional":false},{"name":"Prometheus","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"Shuffle","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-07-02T19:22:51Z","employer_posted_date":"2026-10-12","last_verified_at":"2026-10-20T05:01:48Z","board_verified":true,"closed_at":null,"days_open":109,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":109},"description":"About the Team\nThe Spark Platform team owns and operates DoorDash's Apache Spark ecosystem - the execution runtime, remote shuffle service, cluster scheduler, and reliability tooling that powers the company's data, analytics, and ML workloads. We run Spark across the company at significant scale and continue to expand the workloads, capabilities, and consumer base we serve. Orchestrating and operating thousands of Spark cluster deployments is a complex distributed system problem which the team invests heavily in runtime optimization, systems architecture, multi-tenant scheduling, and end-user tooling.\nAbout the Role\nAs a Software Engineer on Spark Platform, you will execute across the surfaces of our in-house Spark deployment that serves the entire company. The work spans Spark runtime upgrades and performance, multi-tenant scheduling and executor bin-packing on Kubernetes, cluster lifecycle automation, and the observability and incident automation that keep the platform sustainable. You will move between layers as the work demands - picking up the next high-leverage problem regardless of where it sits - and partner closely with the rest of the team and with platform consumers across the company.\nYou must be located in San Francisco, Sunnyvale, Seattle, or New York City for this hybrid position. You will report into the Engineering Manager on our Spark Platform team.\nYou're excited about this opportunity because you will…\nBuild and operate an in-house Spark platform that runs at company-wide scale, spanning runtime, scheduler, reliability, and user-facing tooling.\nDrive multi-tenant scheduling, executor bin-packing, and cost-aware placement that let a small team serve dozens of consumer teams.\nOwn pieces of cluster lifecycle automation - provisioning, upgrades, capacity changes, and node-failure handling - at a scale where these stop being manual events.\nBuild the observability and incident automation that make the platform debuggable end-to-end and keep on-call sustainable as the team and the workload grow.\nPartner with senior engineers on shuffle, runtime, and architecture work, and grow into deeper ownership of those areas over time.\nWe're excited about you because…\nB.S., M.S., or PhD in Computer Science or equivalent.\n2+ years of industry experience operating production distributed systems.\nExperience operating Apache Spark at scale on Amazon EMR, Databricks, or an in-house deployment - with a focus on platform operations (runtime upgrades, cluster lifecycle, shuffle, observability, multi-tenant scheduling) rather than authoring individual Spark jobs.\nHands-on experience operating production systems on Kubernetes - controllers, operators, custom resources, and the failure modes that show up in multi-tenant clusters.\nFamiliarity with batch or big-data schedulers (YuniKorn, Volcano, Kueue, or equivalent) and/or with the Spark-on-Kubernetes operator.\nFamiliarity with observability stacks (Prometheus, OpenTelemetry, distributed tracing, structured logging) and with defining SLOs and SLIs that change team behavior.\nComfort working in a cloud environment (AWS preferred) - VPC networking, instance lifecycle, spot/preemptible markets, and autoscaling primitives.\nProfessional experience with Python, Go, Scala, or Java; SQL fluency.\nA bias toward incremental rollout, measurement, and reducing toil.\nYou are located or willing to relocate to the Bay Area, Seattle, or NYC.\nNotice to Applicants for Jobs Located in NYC or Remote Jobs Associated With Office in NYC Only\nWe use Covey as part of our hiring and/or promotional process for jobs in NYC and certain features may qualify it as an AEDT in NYC. As part of the hiring and/or promotion process, we provide Covey with job requirements and candidate submitted applications. We began using Covey Scout for Inbound from August 21, 2023, through December 21, 2023, and resumed using Covey Scout for Inbound again on June 29, 2024.\nThe Covey tool has been reviewed by an independent auditor. Results of the audit may be viewed here: Covey\nCompensation\n\nThe successful candidate's starting pay will fall within the pay range listed below and is determined based on job-related factors including, but not limited to, skills, experience, qualifications, work location, and market conditions. Base salary is localized according to an employee’s work location. Ranges are market-dependent and may be modified in the future.\nIn addition to base salary, the compensation for this role includes opportunities for equity grants. Talk to your recruiter for more information.\nDoorDash cares about you and your overall well-being. That’s why we offer a comprehensive benefits package to all regular employees, which includes a 401(k) plan with employer matching, 16 weeks of paid parental leave, wellness benefits, commuter benefits match, paid time off and paid sick leave in compliance with applicable laws (e.g. Colorado Healthy Families and Workplaces Act). DoorDash also offers medical, dental, and vision benefits, 11 paid holidays, disability and basic life insurance, family-forming assistance, and a mental health program, among others.\nTo learn more about our benefits, visit our careers page here.\nSee below for paid time off details:\nFor salaried roles: flexible paid time off/vacation, plus 80 hours of paid sick time per year.\n For hourly roles: vacation accrued at about 1 hour for every 25.97 hours worked (e.g. about 6.7 hours/month if working 40 hours/week; about 3.4 hours/month if working 20 hours/week), and paid sick time accrued at 1 hour for every 30 hours worked (e.g. about 5.8 hours/month if working 40 hours/week; about 2.9 hours/month if working 20 hours/week).\nThe national base pay ranges for this position within the United States, including Illinois and Colorado.\nI4\n$130,600—$192,000 USD\nI5\n$159,800—$235,000 USD\nI6\n$193,800—$285,000 USD\nAbout DoorDash\nAt DoorDash, our mission to empower local economies shapes how our team members move quickly, learn, and reiterate in order to make impactful decisions that display empathy for our range of users-from Dashers to merchant partners to consumers. We are a technology and logistics company that started by enabling door-to-door delivery, and we are looking for team members who can help us go from a company that is known as the place you order food to a company that people turn to for any and all goods.\nDoorDash is growing rapidly and changing constantly, which gives our team members the opportunity to share their unique perspectives, solve new challenges, and own their careers. We're committed to supporting employees’ happiness, healthiness, and overall well-being by providing comprehensive benefits and perks including premium healthcare, wellness expense reimbursement, paid parental leave and more.\nOur Commitment to Diversity and Inclusion\nWe’re committed to growing and empowering a more inclusive community within our company, industry, and cities. That’s why we hire and cultivate diverse teams of people from all backgrounds, experiences, and perspectives. We believe that true innovation happens when everyone has room at the table and the tools, resources, and opportunity to excel.\nStatement of Non-Discrimination: In keeping with our beliefs and goals, no employee or applicant will face discrimination or harassment based on: race, color, ancestry, national origin, religion, age, gender, marital/domestic partner status, sexual orientation, gender identity or expression, disability status, or veteran status. Above and beyond discrimination and harassment based on “protected categories,” we also strive to prevent other subtler forms of inappropriate behavior (i.e., stereotyping) from ever gaining a foothold in our office. Whether blatant or hidden, barriers to success have no place at DoorDash. We value a diverse workforce - people who identify as women, non-binary or gender non-conforming, LGBTQIA+, American Indian or Native Alaskan, Black or African American, Hispanic or Latinx, Native Hawaiian or Other Pacific Islander, differently-abled, caretakers and parents, and veterans are strongly encouraged to apply. Thank you to the Level Playing Field Institute for this statement of non-discrimination.\nPursuant to the San Francisco Fair Chance Ordinance, Los Angeles Fair Chance Initiative for Hiring Ordinance, and any other state or local hiring regulations, we will consider for employment any qualified applicant, including those with arrest and conviction records, in a manner consistent with the applicable regulation.\nIf you need any accommodations, please inform your recruiting contact upon initial connection.\n\nNotice to Applicants for Jobs Located in NYC or Remote Jobs Associated With Office in NYC Only\nWe used Covey as part of our hiring and/or promotional process for jobs in NYC and certain features may qualify it as an AEDT in NYC. As part of the hiring and/or promotion process, we provided Covey with job requirements and candidate submitted applications. We began using Covey Scout for Inbound from August 21, 2023, through December 21, 2023. We resumed using Covey Scout for Inbound again on June 29, 2024, and ceased using Covey Scout for Inbound on April 30, 2026.\nThe Covey tool has been reviewed by an independent auditor. Results of the audit may be viewed here: https://getcovey.com/nyc-local-law-144.\nBeware of recruitment scams: DoorDash, Deliveroo, and Wolt will never ask you to pay money or share sensitive financial information during hiring - learn more about our legitimate recruiting process at Recruitment Scam Awareness - DoorDash.","description_format":"text","description_chars":9577,"description_truncated":false,"requirements":{"experience_years_min":2,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Equity","Life insurance","Parental leave"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":true,"industries":["Delivery","Marketplaces"],"lifecycle":[{"event":"open","at":"2026-07-02T19:22:51Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 504 · green card filings: 110","filings_12m":504,"filings_prev_12m":584,"green_card_filings_12m":110,"median_offered_wage_usd":172500,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":268}],"liveness":{"score":14,"band":"cold","label":"Long shot","p_open":1,"p_active":0.393,"p_room":0.36,"age_days":109,"expected_fill_days":65,"reasons":["conf:0","stale_co","velocity","win:tail","crowd:junior,brand"],"computed_at":"2026-10-20T05:45:00Z"},"pay":{"stated_usd_annual":14000,"is_top_pay":false},"html_url":"https://alion.io/job/doordash-software-engineer-spark-platform","json_url":"https://alion.io/job/doordash-software-engineer-spark-platform.json","meta":{"generated_at":"2026-10-20T09:13:27Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":10078,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-21T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3685},"rest":"https://alion.io/mcp/rest/get_company?id=3685"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fdoordash-software-engineer-spark-platform"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fdoordash-software-engineer-spark-platform"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fdoordash-software-engineer-spark-platform"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/doordash-software-engineer-spark-platform\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fdoordash-software-engineer-spark-platform"}]}