Senior AI QA Automation Engineer Austin, TX (Onsite) only on w2

  • BURGEON IT SERVICES LLC
  • Austin, Texas
  • Full Time
Senior AI QA Automation Engineer
Location: Austin, TX (Onsite)
Duration: 6 months plus

pranayatburgeonitsdotcom
Job Summary:
We are seeking a Senior AI QA Automation Engineer with strong experience in AI/LLM testing, Red Teaming, RAG pipelines, and Python development. The ideal candidate will be responsible for validating AI-powered applications, automating API testing, and identifying vulnerabilities in GenAI systems.
Required Skills:
  • 5 8+ years of experience in QA Automation or Software Testing
  • Strong expertise in Red Teaming for AI/LLM applications
  • Hands-on experience with RAG (Retrieval-Augmented Generation) Pipelines
  • Strong Python Full Stack Development experience
  • Experience with LangChain
  • Experience with MCP (Model Context Protocol)
  • Strong API Automation Testing experience
  • REST API testing and automation
  • Experience testing AI/GenAI/LLM-based applications
  • Knowledge of automation frameworks such as PyTest
  • Strong debugging and problem-solving skills
Preferred Experience:
  • AI/ML Testing
  • LLM Validation & Security Testing
  • GenAI Application Testing
  • AI Safety and Prompt Injection Testing
Job ID: 523508233
Originally Posted on: 6/3/2026

Want to find more Technology opportunities?

Check out the 165,503 verified Technology jobs on iHireTechnology