Perform Bogota, D.C., Capital District, Colombia Join or sign in to find your next job Join to apply for the Automation Agent Engineer (SDET + RAG/Prompt Engineering) role at Perform Perform Bogota, D.C., Capital District, Colombia 3 days ago Be among the first 25 applicants Join to apply for the Automation Agent Engineer (SDET + RAG/Prompt Engineering) role at Perform Get AI-powered advice on this job and more exclusive features. We're looking for a forward-thinking Automation Agent Engineer —part seasoned SDET, part prompt engineer—who’s excited to bridge the gap between classic QA automation and AI-assisted workflows. In this hybrid role, you’ll help develop and refine a mini-RAG system that transforms manual test cases into intelligent, LLM-generated test skeletons. You'll shape how context is retrieved, how prompts are designed, and how generated test code aligns with standards for our Java-based automation stack (RestAssured, Selenium, Cucumber, Screenplay). This is a hands-on, highly collaborative role where your decisions will directly affect the quality, consistency, and scalability of our AI-enabled testing pipeline. What You’ll Do Design and refine prompt templates and few-shot examples to guide the LLM toward generating high-quality test code. Collaborate on RAG logic , including chunking strategies, metadata filters, and reranker tuning for optimal context retrieval. Help convert manual test cases into structured test skeletons , normalizing them to project standards. Build evaluation loops to validate generated code—ensuring compliance with naming, format, assertions, lint rules, and compile/run requirements. Review and land autoscripted code with proper guardrails , documentation, and handoff to the SDET team. Optimize token usage and latency while maintaining test fidelity in collaboration with the AI and QA teams. What You Bring 5+ years of experience in QA automation with strong skills in Java , RestAssured , Selenium , Cucumber , and ideally the Screenplay pattern. Hands-on knowledge of prompt engineering , including few-shot prompting and structured output design. Working understanding of RAG concepts (embeddings, retrievers, rerankers) and how they apply to software development workflows. Familiarity with CI pipelines (Jenkins), Git workflows, and code review best practices. It is an asset if you have: Experience with LangChain , ChromaDB , or other local retrieval systems. Understanding of LLMs like Claude 4 Sonnet and how to manage token/cost trade-offs. Ability to build small tools such as static analyzers, linters, or rule-based code evaluators. Seniority level Seniority level Not Applicable Employment type Employment type Other Job function Job function Sales and Business Development Referrals increase your chances of interviewing at Perform by 2x Get notified about new Agent jobs in Bogota, D.C., Capital District, Colombia . Software Development Engineer in Test (Windows) Bogota, D.C., Capital District, Colombia 3 weeks ago Bogota, D.C., Capital District, Colombia 1 month ago Bogota, D.C., Capital District, Colombia 2 weeks ago Bogota, D.C., Capital District, Colombia 1 week ago Bogota, D.C., Capital District, Colombia 3 months ago Bogota, D.C., Capital District, Colombia 2 months ago Python Software Engineer - Ubuntu Hardware Certification Team Bogota, D.C., Capital District, Colombia 4 months ago Distributed Systems Software Engineer, Python / Go Bogota, D.C., Capital District, Colombia 4 months ago Bogota, D.C., Capital District, Colombia 2 weeks ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr