Senior QA Engineer - AI/LLM
at Binance
Posted 6 hours ago
No clicks
- Compensation
- Not specified
- City
- Not specified
- Country
- Not specified
Currency: Not specified
Drive AI/LLM application quality assurance for Binance's LLM-enabled consumer products. Design and execute end-to-end testing strategies covering functionality, data handling, and model behavior. Verify correctness, consistency, stability, and safety of LLM outputs; perform regression testing with model updates, prompt iterations, and data changes. Develop automation tooling and leverage AI technologies to enhance test design, defect analysis, and test case generation.
Responsibilities:
- AI / LLM application quality assurance
- Design and execute end-to-end testing strategies for LLM-based consumer products (functionality, data, model behavior)
- Verify the correctness, consistency, stability, and safety of LLM outputs
- Regression testing and risk assessment for model updates / prompt iterations / data changes
- Automation and tooling capabilities
- Design and develop automated testing and QA tools to improve testing efficiency and coverage
- Use or introduce AI technologies (such as LLM) to enhance test design, defect analysis, and test case generation capabilities
Requirements:
- Bachelor or Master in computer science, computer engineering or related area.
- At least 3+ years of software QA engineering experiences.
- Full cycle testing with test planning and both manual/automation execution.
- Solid Java coding skills, and experienced in automation or QA tools development.
- Good understanding in AI applications and LLM prompt engineering techniques. Experiences in LLM development or eval is a plus.
- Excellent self-driven and ownership with good deliverables.
- Eager to learn, be curious about AI and new technologies of LLM.
- Good communication and collaboration skills.

