AgileEngine is one of the Inc. 5000 fastest-growingcompanies in the US and a top-3 ranked dev shop according toClutch. We create award-winning custom software solutions that helpcompanies across 15+ industries change the lives of millions. Ifyou like a challenging environment where you’re working with thebest and are encouraged to learn and experiment every day, there’sno better place - guaranteed! :) WHAT YOU WILL DO 1. Architect andoversee end-to-end test strategies across different layers in thetesting pyramid; 2. Define, evaluate, and monitor model validationcriteria, including accuracy threshold, confidence scoring,fallback behaviors, etc. 3. Drive the automation of QA processes,ensuring robust, scalable processes for data ingestion, extraction,and classification; 4. Lead the validation integration pointsbetween AI components and business logic, identifying risks andensuring seamless operation; 5. Own, maintain, and evolve the testinfrastructure, specifically the CI/CD quality gates, datageneration, and automated validation scripts; 6. Establish andmonitor key quality metrics aligned with the business goals,including turnaround time, confidence scores, and user corrections;7. Act as a strategic partner to Product and Engineering, andadvocate for quality from design through delivery; 8. Keep up withthe latest AI tech and how to best apply the latest advancements tomake the previously impossible possible for our customers; 9. Senseof ownership, take ownership of code quality through exploratoryand automated tests. MUST HAVES - Bachelor’s degree in ComputerScience, Information Systems, Engineering, or a related fieldexperience; - 5+ years in AQA, Software Test Engineering, orrelated roles, including leadership responsibilities; - Experiencein AQA Javascript; - Solid knowledge of software development lifecycle (SDLC), Agile methodologies, and Quality Assurance or QualityEngineering methodologies; - Proven experience building and scalingtest automation frameworks (e.g., Pytest, Cypress, Selenium,Postman, etc.). Strong technical skills with REST APIs, datapipelines, and backend services; - Strong technical background withAPIs, CI/CD pipelines, backend services, and cloud environments(AWS, Azure); - Exceptional attention to detail, with a mindset forbuilding robust systems that catch issues early and protect thecustomer experience; - Demonstrated fast, proactive learningskills, especially crucial in the rapidly changing field of AI; -Upper-Intermediate English level. NICE TO HAVES - Experiencetesting AI/ML in production environments; - Experience with GenAImodel evaluation metrics; - Experience setting up proactivemonitoring and alerting systems to catch issues like model drift,performance degradation, or workflow failures. THE BENEFITS OFJOINING US - Professional growth: Accelerate your professionaljourney with mentorship, TechTalks, and personalized growthroadmaps. - Competitive compensation: We match your ever-growingskills, talent, and contributions with competitive USD-basedcompensation and budgets for education, fitness, and teamactivities. - A selection of exciting projects: Join projects withmodern solutions development and top-tier clients that includeFortune 500 enterprises and leading product brands. - Flextime:Tailor your schedule for an optimal work-life balance, with optionsof working from home or in the office—whatever makes you happiestand most productive. Your application doesn't end here! To unlockthe next steps, check your email and complete your registration onour Applicant Site. Incomplete registration will result in thetermination of your process. #J-18808-Ljbffr Engineering