AI Engineer - Instrumentation

The Opportunity

Join Arize AI's Engineering team working on OpenInference – the industry-leading open-source standard for AI observability, LLM and agent instrumentation. You'll be at the forefront of defining how organizations instrument, trace, and observe their AI applications across the entire ecosystem, shaping the future of AI development worldwide. This role puts you at the epicenter of the AI landscape, working directly on the OpenInference repository that powers AI observability for thousands of developers worldwide. You'll synthesize requirements from both the vibrant open-source community and real-world enterprise deployments, translating these diverse needs into practical instrumentation capabilities that drive the future of AI innovation. This is NOT a role for everyone – it demands exceptional technical versatility, deep community engagement, and end-to-end ownership from conception to delivery.

What You’ll Do

• Build new LLM and instrumentation libraries for emerging LLM providers and agent frameworks
• Maintain and enhance existing instrumentation across Python and TypeScript ecosystems, and others (OpenAI, Anthropic, LlamaIndex, CrewAI and many more)
• Drive improvements to semantic conventions and OpenTelemetry standards that define AI observability
• Collaborate with the global developer community through GitHub, Slack, and conferences, as well as Arize PMs and solution architects
• Take complex problems from ideation to completion with full ownership and accountability

What We’re Looking For

• 3-5+ years of software development experience shipping production code
• Expert-level proficiency in both Python and TypeScript
• Community-oriented mindset with genuine passion for collaborative open-source development
• Deep interest in AI/LLM ecosystem with desire to stay current on emerging technologies
• Strong analytical skills to distill requirements from diverse sources and stakeholders

Bonus Points, But Not Required

• Experience building SDK clients, instrumentation libraries, or platform APIs
• Hands-on experience with AI/ML observability or evaluation systems

What Makes This Role Unique?

You'll have direct impact on the AI ecosystem by building instrumentation that powers the next generation of AI applications across thousands of companies. Working at the intersection of open-source community building and enterprise-scale AI deployments, you'll help define industry standards while staying at the forefront of LLM technologies.

The estimated annual salary for this role is between $125,000 - $225,000, plus a competitive equity package. Actual compensation is determined based on a variety of job-related factors that may include transferable work experience, skill sets, and qualifications. Total compensation also includes a comprehensive benefits package, including medical, dental, vision, a 401(k) plan, unlimited paid time off, a generous parental leave plan, and additional support for mental health and wellness.

While we are a remote-first company, we have opened offices in New York City and the San Francisco Bay Area, as an option for those in those cities who wish to work in-person. For all other employees, there is a WFH monthly stipend to pay for co-working spaces.