Principal Software Engineer
•Skimmer· 2d
💻 Engineering⏰ Full-time🎯 Lead / Principal🇺🇸 USA
2d ago
Cohere·4 months ago
Who are we?
Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.
We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.
We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.
We are a global technology company co-headquartered in Toronto and San Francisco, with key offices in London, New York City, Montreal, Seoul, Germany and Paris. Join us!
We are seeking a Platform Experience and Developer PM to own how developers and enterprise technical teams build on, integrate with, and operate Cohere's model platform.
This is a high-leverage role sitting at the intersection of three domains:
Managed Services and Models as a Service. Own Cohere's managed service offerings as a product. This is broader than model serving alone. It includes the full range of how enterprises consume and operate Cohere's capabilities, from shared multi-tenant model access to dedicated single-tenant deployments, and from synchronous real-time inference to high-volume asynchronous workloads. You will own the product thinking around deployment models, data residency and regional compliance requirements, self-serve provisioning, and the operational controls that give enterprises confidence in running production workloads on Cohere’s infrastructure.
API and SDK. Own the roadmap for how developers build on Cohere. This means setting the direction for our APIs and SDKs, thinking carefully about interface design and ergonomics, and ensuring we ship developer primitives that are stable, well-documented, and a joy to build with.
Developer Experience and Tooling. Own the surfaces that give developers visibility and control over their integration with Cohere. This includes the API console, credential and access management, usage and cost visibility, request observability, and sandbox and testing environments
Drive the roadmap across managed services, APIs, SDKs, and developer tooling, balancing near-term customer needs with long-term platform investment.
Translate model and infrastructure capabilities into well-designed product surfaces that developers and enterprise operators can rely on.
Engage directly with customers and developers to understand integration challenges, validate priorities, and surface unmet needs.
Define success metrics for platform health and developer experience, and lead initiatives to move them.
Partner with engineering, research, technical writing, and developer relations to ship and document platform improvements.
5+ years of product management experience, with meaningful time spent owning developer-facing or platform-layer products such as APIs, SDKs, developer tools, or technical infrastructure.
Strong technical fluency with API design and SDK development, including an understanding of versioning, backward compatibility, and what makes a developer experience feel polished and reliable.
A track record of thinking about infrastructure as a product, with the ability to translate system-level capabilities into clearly differentiated, customer-facing features.
Experience building or owning developer tooling surfaces such as consoles, dashboards, usage analytics, or observability and debugging tools.
Analytical by default: you define success metrics before you build, instrument thoughtfully, and use data alongside qualitative feedback to make decisions.
Strong collaborator who works well across engineering, design, infrastructure, and GTM teams, and who can communicate technical tradeoffs clearly to a range of stakeholders.
Highly execution-oriented with a bias toward shipping and iterating quickly.
Demonstrated ownership across the full product lifecycle — from problem definition and scoping through launch, iteration, and eventual deprecation or migration.
Experience owning a model serving or inference platform, including familiarity with deployment models such as multi-tenant and dedicated infrastructure.
Exposure to data residency, sovereignty, or regional compliance requirements as they apply to AI or cloud infrastructure products.
Familiarity with asynchronous and high-throughput workload patterns, and the product considerations they introduce around job management, status visibility, and cost attribution.
Familiarity with the AI developer ecosystem and open standards, including orchestration frameworks such as LangChain and LlamaIndex, model serving frameworks such as vLLM, and an awareness of de facto interoperability standards and how they shape developer adoption and integration patterns.
Impact: Shape the developer surface of one of the world's leading enterprise AI platforms, used by developers and enterprises building production AI systems at scale.
Innovation: Work alongside leading researchers and engineers solving complex ML challenges at the frontier of AI.
Growth: Enjoy competitive compensation, equity options, and opportunities for professional development.
Flexibility: Hybrid work model with offices in San Francisco, New York, and Toronto.
Remote or hybrid (San Francisco, New York, Toronto).
A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.
Full health and dental benefits, including a separate budget for mental health.
RRSP matching, 401K, Pension Scheme.
100% Parental Leave top-up for up to 6 months, for either parent.
Annual enrichment benefits:
Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.
Education & learning stipend for conferences, courses, and coaching.
6 weeks of paid vacation (30 working days!)
Budget for traveling to other offices if you are remote, plus an annual company offsite.
Cohere is remote-friendly. We have offices in Toronto, San Francisco, New York City, London, Paris, Montreal, and more coming soon.
For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.
For those not near an office: a co-working benefit so you can work alongside others in your city.
Everyone receives a $500 home office stipend to set up your workspace properly.
If any of the above doesn’t line up exactly with your experience, we still encourage you to apply.
We strive to create an inclusive work environment for all; we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form, and we will work together to meet your needs.
We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn't limit the applications our recruiters may review or consider.