AI Quality Assurance Engineer The role of AI Quality Assurance Engineer is a crucial one in the software development process. This position requires expertise in testing and quality assurance to ensure that AI systems meet the desired standards. Key Responsibilities: - Architect and oversee end-to-end test strategies across different layers in the testing pyramid. - Define, evaluate, and monitor model validation criteria, including accuracy threshold, confidence scoring, fallback behaviors, etc. - Drive the automation of QA processes, ensuring robust, scalable processes for data ingestion, extraction, and classification. - Lead the validation integration points between AI components and business logic, identifying risks and ensuring seamless operation. - Own, maintain, and evolve the test infrastructure, specifically the CI/CD quality gates, data generation, and automated validation scripts. - Establish and monitor key quality metrics aligned with the business goals, including turnaround time, confidence scores, and user corrections. - Act as a strategic partner to Product and Engineering, and advocate for quality from design through delivery. Requirements: - Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field experience. - 5+ years in AQA, Software Test Engineering, or related roles, including leadership responsibilities. - Experience in AQA JavaScript. - Solid knowledge of software development life cycle (SDLC), Agile methodologies, and Quality Assurance or Quality Engineering methodologies. - Proven experience building and scaling test automation frameworks. Benefits: - Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps. - Competitive compensation: We match your ever-growing skills, talent, and contributions with competitive USD-based compensation. - A selection of exciting projects: Join projects with modern solutions development and top-tier clients.