{"id":1987101,"url":"https://alion.io/job/netapp-principal-software-engineer-data-processing-oss","title":"Principal Software Engineer, Data Processing OSS","company":{"id":58700,"name":"NetApp","domain":"netapp.com","url":"https://alion.io/company/netapp","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Eightfold","truth_index":{"grade":"A","score":90,"open_postings":25,"ghost_share":0,"stale_share":0.4,"repost_share":0,"time_to_fill_p50_days":54,"computed_at":"2026-10-13T05:45:00Z"}},"role":"Backend","role_family":"Backend","seniority":"lead","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Jose, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":227800,"max":338800,"currency":"USD","period":"year","gross":null,"usd_annual":338800},"salary_estimate":null,"experience_years_min":15,"visa_sponsorship":false,"relocation_package":false,"has_equity":true,"technologies":[{"name":"Apache Doris","optional":false},{"name":"C++","optional":false},{"name":"CI/CD","optional":false},{"name":"Flink","optional":false},{"name":"Java","optional":false},{"name":"Linux","optional":false},{"name":"Machine Learning","optional":false},{"name":"Ray","optional":false},{"name":"Spark","optional":false},{"name":"Trino","optional":false}],"status":"live","first_seen_at":"2026-09-18T22:59:56Z","employer_posted_date":"2026-10-06","last_verified_at":"2026-10-13T22:36:35Z","board_verified":true,"closed_at":null,"days_open":25,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":25},"description":"Job Summary\nDataPelago is at the forefront of revolutionizing data processing for traditional analytics and cutting-edge GenAI preprocessing. We are building an innovative data processing engine that is transforming how Apache Spark, Apache Flink, Ray and others operate on diverse, large-scale data. Our team of engineers drive and adopt advances in hardware-accelerated computing, parallel processing of large-scale data, query optimization, distributed systems, compilers, machine learning, and cloud-native computing. We are looking for specialists to join our engineering team and shape the future of accelerated data processing.\nDataPelago Nucleus is a universal data processing engine that is designed to accelerate the processing of diverse data - structured through unstructured - with any parallel processing framework - e.g., Apache Spark - on any infrastructure - including vectorized CPU and GPU. DataPelago Accelerator for Spark (DPA-S), our product based on DataPelago Nucleus, is running large-scale production applications of many globally renowned customers.\nThe Opportunity:\nAs a Senior/Principal Data Processing Engineer - OSS, you will be a key individual contributor in adopting and advancing capabilities of open-source software (OSS) platforms such as Apache Gluten, Velox, Apache Spark, and Apache Flink in the context of DataPelago’s data processing engine. You will enhance functional breadth, performance, scale, and reliability of the DataPelago engine through downstream and upstream contributions. You will have the opportunity to engage with community working on these platforms. This is a unique opportunity to make a significant impact on a category-defining product and work with a talented team of engineers.\nWhat You'll Do:\nArchitect: Influence the architecture of how our data processing engine interfaces with open-source platforms and engines.\nDesign: Lead design of functional and performance enhancements to open-source platforms such as Apache Gluten and Velox and their integration with our data processing engine.\nCore Development: Individually design, implement, test, optimize, and maintain components of the data processing engine.\nInnovation and Differentiation: Analyze technology roadmap of Apache Gluten, Velox, and equivalent platforms and identify opportunities for our engine to enhance technology and product leadership.\nCollaboration: Partner effectively with engineering, product management, open-source community and customer success teams.\nContinuous Improvement: Foster best practices in design and code reviews, testing, CI/CD, and issue resolution to maintain highest product quality, security, efficiency, & productivity.\nWhat You'll Bring\n15+ years of relevant experience, Bachelor's degree in Computer Science, or a related field OR a Master's degree in Computer Science or a related field.\n3+ years of deep technical experience in developing core components of Apache Spark, Apache Flink, Apache Doris, Apache Gluten, Velox, Apache DataFusion, Apache DataFusion Comet, or equivalent platforms designed for large-scale data processing.\n3+ years of deep technical experience in instrumenting, analyzing, and optimizing the performance of data processing engine components on benchmark and customer workloads.\nSound knowledge of the architecture and internal operation of one or more of Apache Spark, Apache Flink, Presto/Trino.\nDemonstrated experience in the design, development, and successful release of high-performance data processing engines for large production deployments.\nExceptional programming skills in C, C++, and Java.\nExtensive development experience in Linux environments.\nStrong analytical and problem-solving skills with a passion for performance optimization.\nCompensation:\nThe target salary range for this position is 227,800 - 338,800 USD. The salary offered will be determined by the candidate's location, qualifications, experience, and education and may be outside of this range. Final compensation packages are competitive and in line with industry standards, reflecting a variety of factors, and include a comprehensive benefits package. This may cover Health Insurance, Life Insurance, Retirement or Pension Plans, Paid Time Off, various Leave options, Performance-Based Incentives, employee stock purchase plan, and/or restricted stocks (RSU’s), with all offerings subject to regional variations and governed by local laws, regulations, and company policies. Benefits may vary by country and region, and further details will be provided as part of the recruitment process.","description_format":"text","description_chars":4565,"description_truncated":false,"requirements":{"experience_years_min":15,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Health insurance","Life insurance","Retirement plans"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Cybersecurity","Natural Resources","Cloud Platforms (IaaS & PaaS)","Digital Storage"],"lifecycle":[{"event":"open","at":"2026-10-07T03:11:58Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 164 · green card filings: 52","filings_12m":164,"filings_prev_12m":207,"green_card_filings_12m":52,"median_offered_wage_usd":157315,"route":null,"cap_exempt":false,"checked_at":"2026-10-03T21:08:04+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":132}],"liveness":{"score":80,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.885,"p_room":0.9,"age_days":24,"expected_fill_days":54,"reasons":["conf:2","velocity","win:mid","comp:brand"],"computed_at":"2026-10-13T05:45:00Z"},"pay":{"stated_usd_annual":338800,"is_top_pay":true},"html_url":"https://alion.io/job/netapp-principal-software-engineer-data-processing-oss","json_url":"https://alion.io/job/netapp-principal-software-engineer-data-processing-oss.json","meta":{"generated_at":"2026-10-13T23:13:27Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":35321,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-14T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":58700},"rest":"https://alion.io/mcp/rest/get_company?id=58700"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fnetapp-principal-software-engineer-data-processing-oss"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fnetapp-principal-software-engineer-data-processing-oss"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fnetapp-principal-software-engineer-data-processing-oss"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/netapp-principal-software-engineer-data-processing-oss\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fnetapp-principal-software-engineer-data-processing-oss"}]}