Job Description:
Responsibilities:
● Develop, execute, and maintain automated test scripts to enhance coverage and
efficiency.
● Perform hands-on testing of both front-end and back-end systems to ensure adherence
to quality standards.
● Design and review new features and enhancements, offering insights to optimize
performance and usability.
● Identify, reproduce, and meticulously track bugs, collaborating with developers for timely
resolutions.
● Craft and refine prompts for AI models, particularly large language models, to ensure
they function effectively within their intended applications.
● Analyze LLM outputs for consistency and accuracy, applying rigorous testing
methodologies to validate AI behavior.
● Work alongside data scientists and AI developers to ensure integration and alignment of
LLMs with user needs and product goals.
● Document all phases of the QA process, focusing on automation and LLM testing
strategies.
Preferred Qualifications:
● Bachelor’s degree in Computer Science, Engineering, or related field.
● 1-2 years of QA experience, including significant exposure to automated testing
environments.
● Proficiency with automated testing tools (e.g., Selenium, TestComplete) and frameworks
(e.g., Jest, Mocha).
● Solid understanding of AI and machine learning concepts, with direct experience in
testing LLMs highly desirable.
● Ability to develop clear, comprehensive test plans and cases.
● Familiarity with programming/scripting in Python, JavaScript, or similar languages.
● Exceptional problem-solving skills and meticulous attention to detail.
● Excellent collaborative and communication skills, capable of working effectively in
diverse team settings.