Customer Solutions Architect

About the company

Braintrust is the AI observability platform. By connecting evals and observability in one workflow, Braintrust gives builders the visibility to understand how AI behaves in production and the tools to improve it.

Teams at Notion, Stripe, Zapier, Vercel, and Ramp use Braintrust to compare models, test prompts, and catch regressions — turning production data into better AI with every release.

About the Role

We're looking for a Customer Solutions Architect to join our Field Engineering team. This is a deeply technical, customer-facing role focused on helping teams deploy and operate Braintrust in production environments. 

You’ll work with platform, DevOps, and ML infrastructure teams at leading AI-forward organizations to ensure Braintrust is running reliably — whether in our managed cloud or in their own environments. Braintrust is used to evaluate and monitor LLM-powered applications, and you’ll play a critical role in enabling those evaluation workflows by ensuring the underlying infrastructure is sound. You’ll support deployments, troubleshoot issues across layers, and guide best practices for scale, security, and maintainability.

This role blends solution design, proactive support, and infrastructure guidance — ideal for someone who enjoys solving real-world problems with code, systems knowledge, and deep customer empathy.

What You’ll Do

Customer Enablement & Support

• Act as a trusted advisor to customers deploying and scaling Braintrust in production environments.

• Lead onboarding and implementation engagements, including assisting with setup of customer-hosted infrastructure, configuration of observability pipelines, evaluation workflows, and integrations with third-party tools.

• Help debug customer issues across layers (e.g., SDKs, cloud infrastructure, model outputs), coordinating with product and engineering when needed.

• Own proactive health checks, upgrade support, and reliability best practices for customers running self-hosted deployments.

Solution Design & Implementation

• Design and document end-to-end customer evaluation pipelines using Braintrust SDKs and APIs.

• Build technical artifacts (scripts, templates, notebooks) that accelerate onboarding and our ability to support customers, or demonstrate platform capabilities.

• Consult on architectural decisions, including LLM evaluation, prompt versioning, or how to structure evals for reliability and reproducibility.

Internal & Cross-functional Collaboration

• Translate real-world usage and customer friction into actionable feedback for our product and engineering teams.

• Partner with sales, support, and engineering to ensure seamless handoffs from pre-sales to post-sales and back.

• Contribute to internal runbooks, implementation guides, and technical documentation.

What We’re Looking For

• Strong interest in AI technology

• Experience in customer-facing technical roles (e.g., Solutions Architect, Forward Deployed Engineer, Escalation Engineer, Technical Account Manager).

• Fluency in Python or TypeScript and comfort debugging code, APIs, and infrastructure.

• Strong grasp of DevOps infrastructure and cloud architecture, including technologies like Docker, Terraform, Kubernetes, and major clouds (AWS, GCP, Azure)

• Ability to explain technical concepts clearly to both engineers and non-technical stakeholders.

• Comfortable working autonomously in a fast-paced, startup environment.

Nice to Have

• Experience with self-hosted or hybrid SaaS deployments.

• Familiarity with LLM/AI development workflows and common tools in the ecosystem

• Familiarity with Terraform, CI/CD pipelines, and networking/security best practices.

Why Join Braintrust

You’ll be joining a small, senior team solving one of the most important problems in modern AI development—ensuring reliability. We work with cutting-edge AI teams and move fast to deliver value. You’ll have broad ownership, a strong voice in the product, and the opportunity to help define how the world measures AI quality.

Benefits include

• Medical, dental, and vision insurance

• Daily lunch, snacks, and beverages

• Flexible time off

• Competitive salary and equity

• AI Stipend

Equal opportunity

Braintrust is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.