---
title: 'Senior AI Product Engineer, Backend at Arize AI'
canonical: 'https://feeny.ai/job/senior-ai-product-engineer-backend-arize-ai-united-states-q4d0zx63557e'
type: 'job'
last_seen: '2026-09-09'
---

# Senior AI Product Engineer, Backend at Arize AI

- **Company:** Arize AI
- **Location:** United States
- **Work type:** remote
- **Posted:** 2024-12-10
- **Last confirmed live:** 2026-09-09
- **Apply:** https://job-boards.greenhouse.io/arizeai/jobs/5396396004

## Job description

## About Arize

AI is rapidly transforming the world. As generative AI reshapes industries, teams need powerful ways to monitor, troubleshoot, and optimize their AI systems. That’s where we come in. Arize AI is the leading AI & Agent Engineering observability and evaluation platform, empowering AI engineers to ship high-performing, reliable agents and applications. From first prototype to production scale, Arize AX unifies build, test, and run in a single workspace—so teams can ship faster with confidence.

We’re a Series C company backed by top-tier investors, with over $135M in funding and a rapidly growing customer base of 150+ leading enterprises and Fortune 500 companies. Customers like [Booking.com](http://booking.com/), Uber, Siemens, and PepsiCo leverage Arize to deliver AI that works.

The Opportunity

Our Backend Engineering team builds all of the highly scalable distributed services that power Arize’s ML observability platform. While Go is our primary language for these distributed systems, the team also maintains services and tools written in Python, Java, and TypeScript. The expectation and scope of every individual on this team is high, whether it’s finding the most efficient way to compute model evaluation metrics across billions of data points, designing the next generation of our [OLAP database architecture](https://arize.com/adb), or researching and implementing the latest dimensionality reduction techniques – you will never lack a technical challenge.

You will be a part of the core team that drives product innovation at Arize. You will be challenged with understanding how some of the most impactful engineering teams are developing AI and LLM-powered applications, and how to build the right tools to enable them to do their best work. Our product solutions range from clean APIs that [magically instrument](https://docs.arize.com/phoenix/tracing/how-to-tracing/instrumentation) applications,[interactive playgrounds](https://arize.com/docs/ax/prompts/prompt-playground) for prompt engineering and agent development, or scaling up [real-time evaluation infrastructure](https://arize.com/docs/ax/evaluate/online-evals) to handle millions of annotations per second.

## What You’ll Do

- Write maintainable, scalable, and performant backend code primarily in Go, Java, and Python, with opportunities to work in TypeScript.
- Build high-volume and highly available analytics systems.
- Design and build APIs specific to our customers’ Machine Learning and LLM workflows.
- Prototype, optimize, and maintain scalable backend services that power the Arize core platform.
- Extend, and contribute back to, open source OLAP databases and distributed message queue frameworks.
- Develop and integrate collection tools for robust monitoring of ML and LLM pipelines.
- Research and implement cutting-edge visualization & dimensionality reduction algorithms in a distributed environment.
- Collaborate with our product, design, and directly with customer engineering teams to enhance and expand our product offerings.
- Contribute to the build our own in-house AI Agents

## What We’re Looking For

- 5+ years of experience working with high-performance backend systems.
- Strong experience writing Go, Python, TypeScript/Node, Java, or similar server programming languages.
- Enthusiasm and interest in the AI and LLM ecosystem, with a desire to learn and stay updated on emerging technologies.
- Previous work building and operating highly complex SaaS platforms/systems.
- Knowledge of working with public clouds & container orchestration - AWS, GCP, Azure, Kubernetes, etc.

Bonus Points, But Not Required

- Experience with distributed stream processing - Kafka, Gazette, or similar.
- Experience with OLAP systems.
- Familiarity with system observability tooling like Prometheus.
- Working knowledge of Machine Learning and/or Data Science.
- First-hand experience working with large language models (LLMs) or developing AI products.

The estimated annual salary for this role is between $125,000 - $225,000, plus a competitive equity package. Actual compensation is determined based on a variety of job-related factors that may include transferable work experience, skill sets, and qualifications. Total compensation also includes a comprehensive benefits package, including medical, dental, vision, a 401(k) plan, unlimited paid time off, a generous parental leave plan, and additional support for mental health and wellness.

While we are a remote-first company, we have opened offices in New York City and the San Francisco Bay Area, as an option for those in those cities who wish to work in-person. For all other employees, there is a WFH monthly stipend to pay for co-working spaces. More About Arize

Arize’s mission is to make the world’s AI work—and work for people. Our founders came together through a shared frustration: while investments in AI are growing rapidly across every industry, organizations face a critical challenge—understanding whether AI is performing and how to improve it at scale.

Learn more about what we're doing here:

https://techcrunch.com/2025/02/20/arize-ai-hopes-it-has-first-mover-advantage-in-ai-observability/

https://arize.com/blog/arize-ai-raises-70m-series-c-to-build-the-gold-standard-for-ai-evaluation-observability/

Diversity & Inclusion @ Arize

Our company's mission is to make AI work and make AI work for the people, we hope to make an impact in bias industry-wide and that's a big motivator for people who work here. We actively hope that individuals contribute to a good culture

- Regularly have chats with industry experts, researchers, and ethicists across the ecosystem to advance the use of responsible AI
- Culturally conscious events such as LGBTQ trivia during pride month
- We have an active Lady Arizers subgroup

## About Arize AI

## Company Overview
- **One-liner**: Arize AI provides an agent observability, evaluation, and improvement platform that enables AI teams to trace, debug, evaluate, and continuously improve AI agents and applications in production.
- **Entity Type**: Private (Series C)
- **Headquarters**: San Francisco, California, United States
- **Founded**: 2020
- **Founders**: Jason Lopatecki (CEO), Aparna Dhinakaran (CPO)

## Core Business
- Primary industry/industries: AI Observability, AI Evaluation, Machine Learning Operations (MLOps), Generative AI Infrastructure
- Target customers: B2B; AI engineering teams building production AI applications, chatbots, RAG systems, copilots, and autonomous agents. Serves both startups and large enterprises.
- Mission or purpose statement: "Make AI work — and work for the people."

## Products & Services
- **[Phoenix (Open Source)](https://arize.com/phoenix/)**: The leading open-source AI observability and evaluation framework. Developers use it to trace AI applications, run evaluations, investigate failures, and improve quality. Built on OpenInference and OpenTelemetry standards. Run locally or self-hosted. Over 5 million downloads per month.
- **[Arize AX](https://arize.com/ax/)**: The managed AI engineering platform built on open standards. Adds managed infrastructure with a proprietary observability datastore (ADB), advanced agent observability, online evals, and continual improvement workflows for production AI systems.
- **[Alyx](https://arize.com/ax/)**: An AI engineering agent that functions like "Cursor or Claude Code, but for AI engineering." It runs evals, debugs issues, and improves agents autonomously based on a given problem.
- **[ADB (Arize DataBase)](https://arize.com/ax/)**: The industry’s fastest and most scaled observability datastore for GenAI traces. Stores in open formats to connect natively to BigQuery, Databricks, or Snowflake via DataFabric. Processes over 1 trillion spans per month.
- **Integrations**: Works with 40+ models, frameworks, and AI tools including OpenAI, Anthropic, Google, Amazon Bedrock, LangGraph, LangChain, LlamaIndex, CrewAI, OpenAI Agents SDK, DSPy, and more.

## Market Standing
- **Valuation/Market Cap**: Not publicly disclosed
- **Key Metric**: Total Funding – $131 million across three rounds
- **Annual Revenue**: $13 million (per LinkedIn estimate)
- **Notable Investors/Partners**: TCV (led Series B), Foundation Capital (led Seed Round), and additional undisclosed investors in the Series C round. Partners include major cloud providers (Google Cloud, AWS, Azure) and AI frameworks.
- **Growth Signals**: Headcount grew 56.1% YoY to 149 employees. Operates in 13 countries. Processes over 1 trillion spans and 1 billion evals per month. Open-source Phoenix has over 5 million downloads per month. LinkedIn followers grew 50.4% in the last year to 26,740.

## Competitive Advantages
- **Open-source leadership**: Phoenix is the dominant open-source standard for GenAI observability, built on OpenInference and OpenTelemetry — ensuring no proprietary lock-in and broad community adoption.
- **Comprehensive eval framework**: The market’s most comprehensive evaluation framework, running span, trace, and session evals at scale.
- **Agent-native debugging**: End-to-end workflows designed specifically for debugging coding agents (Cursor, Claude Code, OpenCode, etc.) — a differentiated focus as AI agents become mainstream.
- **Massive scale**: The ADB datastore processes over 1 trillion spans per month, providing a performance moat for enterprise customers.
- **Founding team credibility**: The founders created OpenInference, the leading open standard for GenAI observability.

## Strategic Focus
- **Continual learning loop**: Building the infrastructure for "self-improving agents" — enabling AI systems to learn from production signals and improve autonomously.
- **Agent-native development**: Doubling down on tools and workflows purpose-built for agentic AI systems (coding agents, multi-agent systems).
- **Enterprise scale**: Growing the managed platform (Arize AX) to serve large enterprises with compliance needs (SOC 2 Type II, ISO 27001, PCI DSS, HIPAA, GDPR).
- **Global expansion**: Hiring across the US, EMEA, APJ (Singapore, Malaysia, South Korea, Australia/New Zealand), and Latin America (Argentina).

## Why Work Here
- **Culture**: Described as "outsiders and risk-takers" who challenge the status quo. Values include "Bring Solutions" (own problems, fix them), "Do > Say" (execution over meetings), "N+1" (continuous improvement), and being "maniacally empathetic" of users.
- **Remote-first**: Fully remote company with IRL offices in Berkeley and New York. Open roles span the US, EMEA, APJ, and LATAM.
- **Benefits**: Open vacation policy, wellness days, sabbatical leave policy, parental leave at 100% salary, professional development stipend, coworking space allowance, technology/workspace stipend, commuter benefits, generous medical/dental/vision plans, and 401(k) plan.
- **Engineering culture**: "Progress beats process" — emphasis on prototyping over endless debate, shipping over bureaucracy. Engineers are given agency to make a big impact and grow scope of responsibility.
- **Team**: 149 employees across 13 countries. 39 open positions (Engineering, Sales, Solutions Engineering, Product, Security, Marketing).
- **Diversity**: Explicit commitment to recruiting and retaining a diverse workforce, promoting an inclusive environment.

## Sources
1. [arize.com](https://arize.com/)
2. [arize.com/careers](https://arize.com/careers/)
3. [arize.com/about-us](https://arize.com/about-us/)
4. [greenhouse.io](http://job-boards.greenhouse.io/arizeai)
5. [linkedin.com](https://www.linkedin.com/company/arizeai)

## Other roles at Arize AI

- [Education Engineer](https://feeny.ai/job/education-engineer-arize-ai-san-francisco-9zxrkd55xqkq) — San Francisco, CA
- [Documentation Engineer](https://feeny.ai/job/documentation-engineer-arize-ai-san-francisco-hxx4kr0kea9r) — San Francisco, CA
- [Expansion Account Executive  (West)](https://feeny.ai/job/expansion-account-executive-west-arize-ai-remote-msqw837xphab)
- [Talent Community](https://feeny.ai/job/talent-community-arize-ai-remote-j833xwn3sxm5)
- [Enterprise Account Executive, East](https://feeny.ai/job/enterprise-account-executive-east-arize-ai-new-york-jyfy6963d60y) — New York, NY
- [Enterprise Account Executive, EMEA](https://feeny.ai/job/enterprise-account-executive-emea-arize-ai-emea-902b5n34xgrv) — EMEA
- [AI Solutions Manager, Digital Native](https://feeny.ai/job/ai-solutions-manager-digital-native-arize-ai-san-francisco-j2erk7fgxbpj) — San Francisco, CA
- [Forward Deployed AI Engineer, West](https://feeny.ai/job/forward-deployed-ai-engineer-west-arize-ai-san-francisco-jx995yk0wxw2) — San Francisco, CA
- [AI Solutions Manager, East](https://feeny.ai/job/ai-solutions-manager-east-arize-ai-new-york-srq639c59hr8) — New York, NY
- [Enterprise Account Executive, ANZ](https://feeny.ai/job/enterprise-account-executive-anz-arize-ai-australia-new-zealand-h2sxxyg022pw) — Australia / New Zealand