Software Engineer II - MLOps

Toast creates technology to help restaurants and local businesses succeed in a digital world, helping business owners operate, increase sales, engage customers, and keep employees happy.

Now, more than ever, the Toast team is committed to our customers. We’re taking steps to help restaurants navigate these unprecedented times with technology, resources, and community. Our focus is on building the restaurant platform that helps restaurants adapt, take control, and get back to what they do best: building the businesses they love. And because our technology is purpose-built for restaurants, by restaurant people, restaurants can trust that we’ll deliver on their needs for today while investing in experiences that will power their restaurant of the future.

Bready* to make a change?

Toast is looking for a Machine Learning Engineer to join the AI team. The ideal candidate has a solid track record in the product-oriented development and deployment of machine learning models. As a Senior Machine Learning Engineer, you will work with a team of machine learning engineers, data scientists and product managers to build machine learning pipelines and deploy models for product lines.

About this Roll*:

• Work with a team of machine learning engineers and data scientists to develop robust machine learning model pipelines, architect and implement APIs, and create microservices focused on optimizing latency, availability, and overall performance.
• Implement best practices for version control, code review, testing, and documentation, fostering a culture of high-quality software development
• Stay current with the latest tools, technologies, and best practices in machine learning engineering and cloud-based infrastructure, and drive continuous improvement within the team
• Monitor, troubleshoot, and optimize the performance of machine learning models and related infrastructure
• Embrace agile development methodologies, uphold best practices, and seize ongoing learning opportunities.
• Engage in collaborative efforts with cross-functional teams, including product managers and engineers, to ensure the delivery of superior quality products.

Do you have the right ingredients*?

• Bachelor's degree in Computer Science, a related technical discipline, or equivalent hands-on experience.
• A minimum of 2-5 years of industrial experience in deploying machine learning models.
• Experience with the following languages (Java/Kotlin, Pyspark, Python, Scala) and preferably ML frameworks (scikit-learn, Tensorflow, PyTorch)
• Experience with microservice based architecture, preferably with AWS tooling (SageMaker, DynamoDB, Athena or Glue, etc.)
• Experience in software engineering best practices and tools including object-oriented programming, test-driven development, CI/CD, git, shell scripting, task orchestration, MLflow
• Profound knowledge of model deployment, orchestration (Apache airflow), scaling, and managing CPU/GPU resources efficiently.
• Experience with generative AI from concept to production in Prompt Templates Engineering, Lang graph, langchain, langfuse, Deploying Agents, Agentic workflows on MCP Servers and Managing vector DBs.
• Exceptional problem-solving, analytical skills and the ability to tackle complex problems with a critical thinking approach.
• Outstanding communication and interpersonal skills, coupled with a demonstrated ability to work collaboratively within a team environment.
• Foundational knowledge in statistical concepts (e.g. classification, regression, etc) and deep learning algorithms (e.g. CNN, RNN) is desirable

Bonus ingredients*:

• Ability to debug and resolve technical issues across the full stack is a plus.
• Experience in developing and building web applications using HTML, CSS, JavaScript and React is a plus.
• Experience in data engineering and programming frameworks such as Spark and Ray is a strong plus. Understanding feast or feature stores would be a plus.

AI at Toast

At Toast, one of our company values is that we're hungry to build and learn. We believe learning new AI tools empowers us to build for our customers faster, more independently, and with higher quality. We provide these tools across all disciplines, from Engineering and Product to Sales and Support, and are inspired by how our Toasters are already driving real value with them. The people who thrive here are those who embrace changes that let us build more for our customers; it’s a core part of our culture.

Our Total Rewards Philosophy
We strive to provide competitive compensation and benefits programs that help to attract, retain, and motivate the best and brightest people in our industry. Our total rewards package goes beyond great earnings potential and provides the means to a healthy lifestyle with the flexibility to meet Toasters’ changing needs. Learn more about our benefits at https://careers.toasttab.com/toast-benefits.