Join to apply for the AQA Engineer (Senior) ID35731role at AgileEngine 3 days ago Be among the first 25 applicantsJoin to apply for the AQA Engineer (Senior) ID35731 role atAgileEngine Get AI-powered advice on this job and more exclusivefeatures. AgileEngine is one of the Inc. 5000 fastest-growingcompanies in the US and a top-3 ranked dev shop according toClutch. We create award-winning custom software solutions that helpcompanies across 15+ industries change the lives of millions. Ifyou like a challenging environment where you’re working with thebest and are encouraged to learn and experiment every day, there’sno better place - guaranteed! :) WHAT YOU WILL DO - Architect andoversee end-to-end test strategies across different layers in thetesting pyramid; - Define, evaluate, and monitor model validationcriteria, including accuracy threshold, confidence scoring,fallback behaviors, etc.; - Drive the automation of QA processes,ensuring robust, scalable processes for data ingestion, extraction,and classification; - Lead the validation integration pointsbetween AI components and business logic, identifying risks andensuring seamless operation; - Own, maintain, and evolve the testinfrastructure, specifically the CI/CD quality gates, datageneration, and automated validation scripts; - Establish andmonitor key quality metrics aligned with the business goals,including turnaround time, confidence scores, and user corrections;- Act as a strategic partner to Product and Engineering, andadvocate for quality from design through delivery; - Keep up withthe latest AI tech and how to best apply the latest advancements tomake the previously impossible possible for our customers; - Senseof ownership, take ownership of code quality through exploratoryand automated tests. MUST HAVES -Bachelor’s degree in ComputerScience, Information Systems, Engineering, or a related fieldexperience; - 5+ years in AQA, Software Test Engineering, orrelated roles, including leadership responsibilities; - Experiencein AQA Javascript; - Solid knowledge of software development lifecycle (SDLC), Agile methodologies, and Quality Assurance or QualityEngineering methodologies; - Proven experience building and scalingtest automation frameworks (e.g. Pytest, Cypress, Selenium,Postman, etc.). Strong technical skills with REST APIs, data,pipelines, and backend services; - Strong technical background withAPIs, CI/CD pipelines, backend services, and cloud environments(AWS, Azure); - Exceptional attention to detail, with a mindset forbuilding robust systems that catch issues early and protect thecustomer experience; - Demonstrated fast, proactive learningskills, especially crucial in the rapidly changing field of AI; -Uppper-Intermediate English level. NICE TO HAVES - Experiencetesting AI/ML in production environments; - Experience with GenAImodel evaluation metrics; - Experience setting up proactivemonitoring and alerting systems to catch issues like model drift,performance degradation, or workflow failures. THE BENEFITS OFJOINING US - Professional growth: Accelerate your professionaljourney with mentorship, TechTalks, and personalized growthroadmaps. - Competitive compensation: We match your ever-growingskills, talent, and contributions with competitive USD-basedcompensation and budgets for education, fitness, and teamactivities. - A selection of exciting projects: Join projects withmodern solutions development and top-tier clients that includeFortune 500 enterprises and leading product brands. - Flextime:Tailor your schedule for an optimal work-life balance, by havingthe options of working from home and going to the office - whatevermakes you the happiest and most productive. Your applicationdoesn't end here! To unlock the next steps, check your email andcomplete your registration on our Applicant Site. The incompleteregistration results in the termination of your process. Senioritylevel - Seniority level Mid-Senior level Employment type -Employment type Full-time Job function - Job function InformationTechnology - Industries IT Services and IT Consulting Referralsincrease your chances of interviewing at AgileEngine by 2x Sign into set job alerts for “Senior Engineer” roles. .NET & AngularFull Stack Engineer (Senior/Lead) ID34837 Elixir Full StackEngineer (Lead) ID34499 Node.js/Vue.js Full Stack Engineer(Senior/Lead) ID35448 Java/React.js Full Stack Engineer(Senior/Lead) ID33721 We’re unlocking community knowledge in a newway. Experts add insights directly into each article, started withthe help of AI. #J-18808-Ljbffr