{"id":23857,"url":"https://alion.io/job/arize-ai-senior-ai-product-engineer-backend","title":"Senior AI Product Engineer, Backend","company":{"id":6585,"name":"Arize AI","domain":"arize.com","url":"https://alion.io/company/arize-ai","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"A","score":90,"open_postings":24,"ghost_share":0.083,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":134,"computed_at":"2026-10-19T05:45:15Z"}},"role":"Backend","role_family":"Backend","seniority":"senior","employment_type":null,"work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["United States"],"countries":["US"],"hiring_countries":["US"],"hiring_countries_total":1,"salary":{"min":125000,"max":225000,"currency":"USD","period":"year","gross":null,"usd_annual":225000},"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":true,"technologies":[{"name":"AI Agents","optional":false},{"name":"Arize Phoenix","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"GCP","optional":false},{"name":"Go","optional":false},{"name":"Java","optional":false},{"name":"Kubernetes","optional":false},{"name":"LLM","optional":false},{"name":"Machine Learning","optional":false},{"name":"Prompt Engineering","optional":false},{"name":"Python","optional":false},{"name":"TypeScript","optional":false},{"name":"Apache Kafka","optional":true},{"name":"Prometheus","optional":true}],"status":"live","first_seen_at":"2024-12-10T15:08:32Z","employer_posted_date":"2026-09-23","last_verified_at":"2026-10-19T18:10:32Z","board_verified":true,"closed_at":null,"days_open":678,"trust":{"level":"ghost","repost_count":0,"flags":["stale","company_stale"],"days_open":677},"description":"About Arize\nAI is rapidly transforming the world. As generative AI reshapes industries, teams need powerful ways to monitor, troubleshoot, and optimize their AI systems. That’s where we come in. Arize AI is the leading AI & Agent Engineering observability and evaluation platform, empowering AI engineers to ship high-performing, reliable agents and applications. From first prototype to production scale, Arize AX unifies build, test, and run in a single workspace-so teams can ship faster with confidence.\nWe’re a Series C company backed by top-tier investors, with over $135M in funding and a rapidly growing customer base of 150+ leading enterprises and Fortune 500 companies. Customers like Booking.com, Uber, Siemens, and PepsiCo leverage Arize to deliver AI that works.\nThe Opportunity\nOur Backend Engineering team builds all of the highly scalable distributed services that power Arize’s ML observability platform. While Go is our primary language for these distributed systems, the team also maintains services and tools written in Python, Java, and TypeScript. The expectation and scope of every individual on this team is high, whether it’s finding the most efficient way to compute model evaluation metrics across billions of data points, designing the next generation of our OLAP database architecture, or researching and implementing the latest dimensionality reduction techniques - you will never lack a technical challenge.\nYou will be a part of the core team that drives product innovation at Arize. You will be challenged with understanding how some of the most impactful engineering teams are developing AI and LLM-powered applications, and how to build the right tools to enable them to do their best work. Our product solutions range from clean APIs that magically instrument applications,interactive playgrounds for prompt engineering and agent development, or scaling up real-time evaluation infrastructure to handle millions of annotations per second.\nWhat You’ll Do\nWrite maintainable, scalable, and performant backend code primarily in Go, Java, and Python, with opportunities to work in TypeScript.\nBuild high-volume and highly available analytics systems.\nDesign and build APIs specific to our customers’ Machine Learning and LLM workflows.\nPrototype, optimize, and maintain scalable backend services that power the Arize core platform.\nExtend, and contribute back to, open source OLAP databases and distributed message queue frameworks.\nDevelop and integrate collection tools for robust monitoring of ML and LLM pipelines.\nResearch and implement cutting-edge visualization & dimensionality reduction algorithms in a distributed environment.\nCollaborate with our product, design, and directly with customer engineering teams to enhance and expand our product offerings.\nContribute to the build our own in-house AI Agents\nWhat We’re Looking For\n5+ years of experience working with high-performance backend systems.\nStrong experience writing Go, Python, TypeScript/Node, Java, or similar server programming languages.\nEnthusiasm and interest in the AI and LLM ecosystem, with a desire to learn and stay updated on emerging technologies.\nPrevious work building and operating highly complex SaaS platforms/systems.\nKnowledge of working with public clouds & container orchestration - AWS, GCP, Azure, Kubernetes, etc.\nBonus Points, But Not Required\nExperience with distributed stream processing - Kafka, Gazette, or similar.\nExperience with OLAP systems.\nFamiliarity with system observability tooling like Prometheus.\nWorking knowledge of Machine Learning and/or Data Science.\nFirst-hand experience working with large language models (LLMs) or developing AI products.\nThe estimated annual salary for this role is between $125,000 - $225,000, plus a competitive equity package. Actual compensation is determined based on a variety of job-related factors that may include transferable work experience, skill sets, and qualifications. Total compensation also includes a comprehensive benefits package, including medical, dental, vision, a 401(k) plan, unlimited paid time off, a generous parental leave plan, and additional support for mental health and wellness.\nWhile we are a remote-first company, we have opened offices in New York City and the San Francisco Bay Area, as an option for those in those cities who wish to work in-person. For all other employees, there is a WFH monthly stipend to pay for co-working spaces.\nMore About Arize\nArize’s mission is to make the world’s AI work-and work for people.\nOur founders came together through a shared frustration: while investments in AI are growing rapidly across every industry, organizations face a critical challenge-understanding whether AI is performing and how to improve it at scale.\nLearn more about what we're doing here:\nhttps://techcrunch.com/2025/02/20/arize-ai-hopes-it-has-first-mover-advantage-in-ai-observability/\nhttps://arize.com/blog/arize-ai-raises-70m-series-c-to-build-the-gold-standard-for-ai-evaluation-observability/\nDiversity & Inclusion @ Arize\nOur company's mission is to make AI work and make AI work for the people, we hope to make an impact in bias industry-wide and that's a big motivator for people who work here. We actively hope that individuals contribute to a good culture\nRegularly have chats with industry experts, researchers, and ethicists across the ecosystem to advance the use of responsible AI\nCulturally conscious events such as LGBTQ trivia during pride month\nWe have an active Lady Arizers subgroup","description_format":"text","description_chars":5521,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Equity","Parental leave"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["MLOps","Explainable AI (XAI)","AI Evaluation & Observability"],"lifecycle":[{"event":"open","at":"2024-12-10T15:08:32Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 1","filings_12m":1,"filings_prev_12m":1,"green_card_filings_12m":0,"median_offered_wage_usd":167500,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":1}],"liveness":{"score":8,"band":"cold","label":"Long shot","p_open":1,"p_active":0.3,"p_room":0.28,"age_days":677,"expected_fill_days":134,"reasons":["conf:3","ghost","win:tail","crowd:"],"computed_at":"2026-10-19T05:45:15Z"},"pay":{"stated_usd_annual":225000,"is_top_pay":true},"html_url":"https://alion.io/job/arize-ai-senior-ai-product-engineer-backend","json_url":"https://alion.io/job/arize-ai-senior-ai-product-engineer-backend.json","meta":{"generated_at":"2026-10-19T19:48:30Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":15654,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-20T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":6585},"rest":"https://alion.io/mcp/rest/get_company?id=6585"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Farize-ai-senior-ai-product-engineer-backend"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Farize-ai-senior-ai-product-engineer-backend"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Farize-ai-senior-ai-product-engineer-backend"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/arize-ai-senior-ai-product-engineer-backend\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Farize-ai-senior-ai-product-engineer-backend"}]}