{"id":661955,"url":"https://alion.io/job/acceldata-staff-software-engineer-open-source-data-platform-odp","title":"Staff Software Engineer - Open Source Data Platform (ODP)","company":{"id":4497,"name":"Acceldata","domain":"acceldata.io","url":"https://alion.io/company/acceldata","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Lever","truth_index":{"grade":"B","score":78,"open_postings":38,"ghost_share":0.289,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":124,"computed_at":"2026-10-16T05:45:00Z"}},"role":"Backend","role_family":"Backend","seniority":"staff","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Kitchener, Canada"],"countries":["CA"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":120000,"max_usd":199000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":35},"experience_years_min":9,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Java","optional":false},{"name":"Kubernetes","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"Apache Hudi","optional":true},{"name":"Apache Iceberg","optional":true},{"name":"Apache Kafka","optional":true},{"name":"Apache NiFi","optional":true},{"name":"AWS","optional":true},{"name":"Azure","optional":true},{"name":"CI/CD","optional":true},{"name":"Delta Lake","optional":true},{"name":"Docker","optional":true},{"name":"Flink","optional":true},{"name":"GCP","optional":true},{"name":"GitHub","optional":true},{"name":"Gradle","optional":true},{"name":"Hadoop","optional":true},{"name":"Linux","optional":true},{"name":"Maven","optional":true},{"name":"Spark","optional":true},{"name":"Trino","optional":true}],"status":"live","first_seen_at":"2026-03-16T02:40:11Z","employer_posted_date":"2026-03-16","last_verified_at":"2026-10-16T09:23:58Z","board_verified":true,"closed_at":null,"days_open":214,"trust":{"level":"ok","repost_count":0,"flags":["company_stale"],"days_open":214},"description":"ABOUT THE ROLE\nWe are seeking a Staff Engineer with at least 9 years of experience in distributed systems or data platform development. In this role, you will be a technical leader responsible for architecting and driving the technical direction of critical components within the Acceldata Open Data Platform (ODP). You will work on solving the most challenging distributed systems problems, contribute to open-source communities, and mentor senior engineers while shaping the future of large-scale data infrastructure.\nYou'll lead high-impact initiatives that directly influence how petabyte-scale data is managed, observed, and optimized across hybrid and cloud ecosystems. You'll collaborate with industry experts, Apache committers, and seasoned engineers who share your passion for distributed systems and open-source innovation.\nWHY JOIN US\nAt Acceldata, you won't just be writing code; you'll be defining the architecture and technical vision for modern data platforms used by some of the world's largest enterprises.\nYour technical decisions will shape mission-critical systems, and your contributions will be visible across the global data ecosystem. If you're ready to take ownership of complex technical challenges and drive innovation at scale, Acceldata is where you belong.\nRESPONSIBILITIES\nOwn the end-to-end architecture of major platform components, driving design decisions that impact scalability, reliability, and performance.\nArchitect and implement next-generation distributed data storage, processing, and query optimization systems.\nPartner with product, engineering leadership, and stakeholders to define technical roadmaps and translate business requirements into scalable solutions.\nLead contributions to Apache projects and open-source communities, establishing Acceldata's presence and technical reputation.\nIdentify and resolve complex performance bottlenecks across distributed systems, optimizing for cost, latency, and throughput.\nMentor and guide Senior Software Engineers, fostering technical excellence and a culture of continuous learning.\nEstablish and enforce coding standards, perform thorough code reviews, and ensure architectural consistency across the platform.\nEvaluate and recommend emerging technologies, tools, and frameworks that align with platform goals.\nLead root cause analysis for critical production issues and drive systemic improvements to prevent recurrence.\nWork across diverse environments: Bare Metals, VM, Kubernetes, and multi-cloud architectures.\nREQUIREMENTS\n9+ years of hands-on software development experience with at least 5 years focused on distributed systems or big data platforms.\nExpert-level proficiency in Java or Scala, with strong Python skills. Experience with systems languages is a plus.\nDeep understanding of distributed computing principles, including consensus algorithms, data partitioning, replication, fault tolerance, and consistency models.\nExtensive hands-on experience with multiple components of the big data stack (Hadoop, Spark, Hive, Trino, Kafka, Flink, NiFi or similar).\nExpert-level Linux proficiency, including kernel tuning, performance analysis, and debugging at the system level.\nStrong experience with Kubernetes, Docker, and cloud platforms (AWS, GCP, or Azure).\nDeep expertise with Maven, Gradle, or SBT; experienced in CI/CD pipelines, GitHub, and artifact management (Nexus).\nProven ability to diagnose and resolve complex issues, including memory leaks, deadlocks, GC tuning, and distributed system failures.\nStrong understanding of architectural patterns for scalable, fault-tolerant distributed systems.\nExcellent written and verbal communication skills; ability to articulate complex technical concepts to diverse audiences, including senior leadership.\nDemonstrated ability to work effectively with cross-functional teams, external contributors, and the open-source community.\nPREFERRED SKILLS\nHistory of significant contributions or committer status in Apache projects (e.g., Spark, Kafka, Hive, Iceberg, Flink, etc.).\nExperience with modern table formats (Apache Iceberg, Delta Lake, Hudi) and data lake architectures.\nExperience developing or optimizing query engines, query planners, or execution frameworks.\nFamiliarity with data governance, security, lineage, and compliance frameworks.\nExperience leading large-scale data platform migrations or Hadoop distribution upgrades.\nPublished technical blogs, papers, or conference presentations on distributed systems topics.\nExperience leading or maintaining open-source projects.","description_format":"text","description_chars":4542,"description_truncated":false,"requirements":{"experience_years_min":9,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Continuous learning"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Data Quality & Observability"],"lifecycle":[{"event":"open","at":"2026-09-10T21:38:03Z"},{"event":"open","at":"2026-09-26T04:29:17Z"}],"visa":[],"liveness":{"score":29,"band":"fade","label":"Fading","p_open":1,"p_active":0.799,"p_room":0.36,"age_days":214,"expected_fill_days":124,"reasons":["conf:1","win:tail","crowd:"],"computed_at":"2026-10-16T05:45:00Z"},"pay":null,"html_url":"https://alion.io/job/acceldata-staff-software-engineer-open-source-data-platform-odp","json_url":"https://alion.io/job/acceldata-staff-software-engineer-open-source-data-platform-odp.json","meta":{"generated_at":"2026-10-16T13:37:32Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":13110,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-17T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4497},"rest":"https://alion.io/mcp/rest/get_company?id=4497"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Facceldata-staff-software-engineer-open-source-data-platform-odp"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Facceldata-staff-software-engineer-open-source-data-platform-odp"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Facceldata-staff-software-engineer-open-source-data-platform-odp"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/acceldata-staff-software-engineer-open-source-data-platform-odp\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Facceldata-staff-software-engineer-open-source-data-platform-odp"}]}