AgileEngine is one of the Inc. 5000 fastest-growingcompanies in the US and a top-3 ranked dev shop according toClutch. We create award-winning custom software solutions that helpcompanies across 15+ industries change the lives of millions. Ifyou like a challenging environment where you’re working with thebest and are encouraged to learn and experiment every day, there’sno better place - guaranteed! :) WHAT YOU WILL DO - Architect andoversee end-to-end test strategies across different layers in thetesting pyramid; - Define, evaluate, and monitor model validationcriteria, including accuracy threshold, confidence scoring,fallback behaviors, etc.; - Drive the automation of QA processes,ensuring robust, scalable processes for data ingestion, extraction,and classification; - Lead the validation integration pointsbetween AI components and business logic, identifying risks andensuring seamless operation; - Own, maintain, and evolve the testinfrastructure, specifically the CI/CD quality gates, datageneration, and automated validation scripts; - Establish andmonitor key quality metrics aligned with the business goals,including turnaround time, confidence scores, and user corrections;- Act as a strategic partner to Product and Engineering, andadvocate for quality from design through delivery; - Keep up withthe latest AI tech and how to best apply the latest advancements tomake the previously impossible possible for our customers; - Senseof ownership, take ownership of code quality through exploratoryand automated tests. MUST HAVES -Bachelor’s degree in ComputerScience, Information Systems, Engineering, or a related fieldexperience; - 5+ years in AQA, Software Test Engineering, orrelated roles, including leadership responsibilities; - Solidknowledge of software development life cycle (SDLC), Agilemethodologies, and Quality Assurance or Quality Engineeringmethodologies; - Proven experience building and scaling testautomation frameworks (e.g. Pytest, Cypress, Selenium, Postman,etc.). Strong technical skills with REST APIs, data, pipelines, andbackend services; - Strong technical background with APIs, CI/CDpipelines, backend services, and cloud environments (AWS, Azure); -Exceptional attention to detail, with a mindset for building robustsystems that catch issues early and protect the customerexperience; - Demonstrated fast, proactive learning skills,especially crucial in the rapidly changing field of AI; NICE TOHAVES -Experience testing AI/ML in production environments; -Experience with GenAI model evaluation metrics; - Experiencesetting up proactive monitoring and alerting systems to catchissues like model drift, performance degradation, or workflowfailures. THE BENEFITS OF JOINING US -Professional growth:Accelerate your professional journey with mentorship, TechTalks,and personalized growth roadmaps. -Competitive compensation: Wematch your ever-growing skills, talent, and contributions withcompetitive USD-based compensation and budgets for education,fitness, and team activities. -A selection of exciting projects:Join projects with modern solutions development and top-tierclients that include Fortune 500 enterprises and leading productbrands. -Flextime: Tailor your schedule for an optimal work-lifebalance, by having the options of working from home and going tothe office – whatever makes you the happiest and most productive.Your application doesn't end here! To unlock the next steps, checkyour email and complete your registration on our Applicant Site.The incomplete registration results in the termination of yourprocess. #J-18808-Ljbffr