As a seasoned test architect, you will oversee the development and implementation of comprehensive test strategies across various layers of the testing pyramid. Your expertise in defining, evaluating, and monitoring model validation criteria will ensure that our AI/ML systems meet the highest standards of accuracy and performance. Key Responsibilities: - Develop and execute end-to-end test plans to validate the quality of our software applications; - Collaborate with cross-functional teams to design and implement robust automation frameworks for data ingestion, extraction, and classification; - Drive the validation of integration points between AI components and business logic to ensure seamless operation and identify potential risks; - Maintain and evolve test infrastructure, including CI/CD quality gates, data generation, and automated validation scripts; - Establish and monitor key quality metrics aligned with business goals, including turnaround time, confidence scores, and user corrections; **Required Skills and Qualifications:** - Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent experience; - 2–3 years of experience in AQA, Software Test Engineering, or related roles, including leadership responsibilities; - Proven experience building and scaling test automation frameworks (e.g., Pytest, Cypress, Selenium); - Strong technical skills in working with REST APIs, data pipelines, backend services, and cloud platforms (e.g., AWS, Azure); - Exceptional attention to detail and a mindset for building robust systems that catch issues early and protect the user experience; **Nice to Have:** - Experience testing AI/ML systems in production environments; - Familiarity with GenAI model evaluation metrics; - Experience setting up proactive monitoring and alerting systems to detect model drift, performance degradation, or workflow failures.