Quality Engineer- AI Platform Testing

Job Title: Quality Engineer- AI Platform Testing

Location: Bangalore


Experience: 5-7 years


Education: Bachelor’s or Associate’s Degree in Computer Science, Engineering, or a related field

Job Summary:

We are looking for an experienced Quality Engineer with a strong background in software testing processes, automation, test framework development and application testing. The ideal candidate will have expertise in AI based application/platform testing, Model [LLM’s] evaluation testing, RESTful API testing and technical proficiency in python, JavaScript, TypeScript, and related tools.

Key Responsibilities:

•         Create and maintain comprehensive test cases for web applications.

•         Develop and execute smoke, functional, regression, and integration testing processes for software applications.

•         Design, create, and maintain automated test frameworks using tools like RAGA’S/ DeepEval/Lang chain, Postman, VS Code, Cucumber and node.js.

•         Collaborate closely with development and product teams to ensure testing coverage across all stages of development.

•         Identify, record, document thoroughly and track bugs.

•         Perform load and performance testing using tools like JMeter.

•         Manage testing processes using GitHub, JIRA, and other DevOps tools.

•         Contribute to continuous integration/continuous deployment (CI/CD) practices to enhance test automation pipelines.

•         Work with cloud technologies, particularly AWS, to manage testing environments.

Required Skills & Qualifications:

•         6+ years of relevant work experience in software testing, particularly in automation and test framework development.

•         Proficiency in python, JavaScript, TypeScript, Postman, VS Code, Cucumber, and Node.js.

•         Must have experience in Model [LLM’s] evaluation testing, analysing model performance

•         Strong experience in backend testing with exposure to LLM’s using Swagger, postman tools.

•         Must have experience in tools like Kubernetes to check the logs.

•         Must have experience in model evaluation frameworks [for ex: RAGA’S, DeepEval, Lang chain]

•         Familiarity with various testing techniques. Knowledge of quality standards and regulations.

•         Strong understanding of version control systems (GitHub) and project management tools (JIRA).

•         Experience in Agile/Scrum development environments.

•         A detail-oriented approach with excellent problem-solving skills.

Preferred Qualifications:

•         Familiarity with continuous integration and delivery (CI/CD) pipelines using Github actions.

•         Experience or knowledge of machine learning and open-source AI models, Test automation using pytest.

•         Experience testing applications hosted in multiple geographical locations.

•         Familiarity with cloud technologies, especially AWS.