Saved Jobs (0)
Current Employees
Candidates
Job Opportunities
Life @ Comcast
Benefits
Early Career
FAQs
Search Jobs
Search Jobs by Keyword
Location
Radius
select radius
5 miles
15 miles
25 miles
35 miles
50 miles
Search Jobs
Agentic AI Test Engineer
Mount Laurel, New Jersey
Apply Now Save Job
Overview
Success Profile
Benefits
Responsibilities
Hear From Our People
Culture
More About Comcast
Overview
Make your mark at Comcast -- a Fortune 30 global media and technology company. Become part of our award-winning, international engineering team that turns big ideas into cutting-edge products, platforms, and solutions that our customers love. We create space to innovate, and we recognize, reward, and invest in your ideas, while ensuring you can proudly bring your authentic self to the workplace. You'll do the best work of your career right here.
Back to nav
Success Profile
What makes a successful Agentic AI Test Engineer at Comcast? Check out these top traits and explore role-specific skills in the job description below.
Results-driven
Adaptable
Inventive
Entrepreneurial
Team Player
Problem-Solver
Back to nav
Benefits
We're proud to offer comprehensive benefits to help support you physically, financially and emotionally through the big milestones and in your everyday life.
Paid Time off
We know how important it can be to spend time away from work to relax, recover from illness, or take time to care for others needs.
Physical Wellbeing
We offer a range of benefits and support programs to ensure that you and your loved ones get the care you need.
Financial Wellbeing
These benefits give you personalized support designed entirely around your unique needs today and for the future.
Emotional Wellbeing
No matter how you're feeling or what you're dealing with, there are benefits to help when you need it, in the way that works for you.
Life Events + Family Support
Benefits that support you no matter where you are in life's journey.
See All Benefits
Back to nav
Responsibilities
Agentic AI Test Engineer
Location Mount Laurel, New Jersey
Req ID R436458
Job Type Full Time
Category Computer Engineering
Date posted 05/06/2026
Apply Now Save Job
Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and solutions that our customers love. We create space to innovate, and we recognize, reward, and invest in your ideas, while ensuring you can proudly bring your authentic self to the workplace. Join us. You'll do the best work of your career right here at Comcast. (In most cases, Comcast prefers to have employees on-site collaborating unless the team has been designated as virtual due to the nature of their work. If a position is listed with both office locations and virtual offerings, Comcast may be willing to consider candidates who live greater than 100 miles from the office for the remote option.)
Job Summary
The AI Agentic Team designs, builds, and runs intelligent agents end to end. We own agent logic, workflows, integrations, production deployment, and ongoing performance. By combining build and operations, we deliver agentic systems that are reliable, secure, and scalable in real-world use. We are building the next generation of our chat experience, transitioning from a human-assisted workflow to a fully agentic, AI-driven system. As an AI Agentic Software Engineer, you will create re-usable AI agents that will be used across Xfinity applications. Your initial focus will be to enable agentic capabilities at our Xfinity Assistant (chat application) with a strong passion for customer experience and a commitment to building intuitive, high-quality interactions.
Job Description
We are seeking a AI Agentic Test Engineer to join our core automation team. This role is designed for a hands-on engineer who is passionate about the intersection of AI and Quality Engineering. You will focus on building automated evaluation loops for AI Agents using LLM-as-a-judge patterns and maintaining robust Web and API test suites. The ideal candidate is a Python expert who is also comfortable working across various modern tech stacks and CI/CD environments.
AI & Agent Evaluation (Primary Focus)
LLM-as-a-Judge: Design and implement automated evaluation frameworks that utilize Large Language Models to assess the quality, accuracy, and safety of Agent responses.
Agentic Testing: Perform hands-on validation of AI Agents within complex environments, moving beyond static assertions to intelligent, semantic validation.
Data Validation: Automate the testing of real-time data streams and LLM outputs to ensure consistency and prevent regression in Agent behavior.
Full-Stack Automation & Coding
Python Mastery: Expert in Python for building custom test utilities, framework extensions, and automation scripts.
Cross-Functional Tooling: Develop and maintain automation across TypeScript, Java, and React environments to support various application layers.
Web & API Automation: Build high-performance automated tests for modern web interfaces and RESTful APIs, ensuring end-to-end system reliability.
Internal Tooling: Help build or maintain internal quality dashboards and tools using frameworks like Streamlit.
CI/CD & Technical Operations
Pipeline Execution: Integrate automated tests into CI/CD pipelines (e.g., Jenkins, Concourse) to ensure continuous quality feedback throughout the development lifecycle.
Code Quality: Actively participate in technical code reviews, focusing on script efficiency, maintainability, and clean code principles.
Troubleshooting: Use logs and observability tools to perform deep-dive root cause analysis on automation failures and system defects.
What You'll Need:
5+ years of experience as an SDET or Automation Engineer.
Strong technical background in building and maintaining custom automation frameworks.
Ability to work independently on complex coding tasks while collaborating effectively in an Agile environment.
Core Language: Expert-level hands-on coding in Python.
AI/LLM Skills: Solid understanding of Agent Evaluation techniques and using LLMs as a judge.
Automation Breadth: Proven experience in Web and API automation.
Multi-Stack Knowledge (Good to Have):
Languages: TypeScript, Java.
Frameworks: React, Streamlit.
DevOps: CI/CD pipeline management (Jenkins/Concourse).
Disclaimer: This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.
Comcast is an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law.
Skills:
Agentic AI; Adaptability; Critical Thinking; Automation; AI Agents; Python (Programming Language); AI Agent Orchestration
Salary:
Primary Location Pay Range: $114,985.89 - $172,478.83
Comcast intends to offer the selected candidate base pay within this range, dependent on job-related, non-discriminatory factors such as experience. The application window is 30 days from the date job is posted, unless the number of applicants requires it to close sooner or later.
Base pay is one part of the Total Rewards that Comcast provides to compensate and recognize employees for their work. Most sales positions are eligible for a Commission under the terms of an applicable plan, while most non-sales positions are eligible for a Bonus. Additionally, Comcast provides best-in-class Benefits to eligible employees. We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That's why we provide an array of options, expert guidance and always-on tools, that are personalized to meet the needs of your reality - to help support you physically, financially and emotionally through the big milestones and in your everyday life. Please visit the compensation and benefits summary on our careers site for more details.
Education
Bachelor's Degree
While possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.
Relevant Work Experience
5-7 Years
Apply Now Save Job
Share this job
Facebook
X
LinkedIn
Email
Back to nav
Hear from our people
Comcast brings to the table the leading edge in the technology, so that sets the baseline for the features that are available to our customers
Albert
Vice President, Product Management
I mean, that's one of the best things about working here is that there have been very few times when I've been set, when I've been told, No, you can't do this.
Greg
Engineer
It is incredibly rewarding to see the work that we've done impact people in such a meaningful way, and we're bringing joy to people's lives.
Faisal
Executive Director, Machine Learning
Previous Slide
Next Slide
Back to nav
Culture
At Comcast you can have work/life balance in an inclusive environment where you can be your authentic self.
Comcast provides many opportunities to build skills and grow in your career and a top-notch benefits, time off and perks package.
We are committed to delivering reliable, effortless experiences to our customers no matter how they choose to interact with us.
You will build personal relationships on a growing team that while making Xfinity a best-in-class, most-loved brand.
Back to nav
More About Comcast
Comcast Unveils Industry-First Gateway Designed for Apartment Buildings Enabling Instant' Connectiity for Residents
Comcast has launched a new, innovative gateway with Tri-Band WiFi 6E technology that delivers faster speeds, lower latency, and Instant On' connectivity to apartment residents.
Xfinity Mobile, Comcast Business Mobile Customers Unlock PowerBoost - Delivering WiFi Speeds of Up to a Gig - with the New Samsung Galaxy S25 Series
Android fans have something to celebrate now that the new Samsung Galaxy S25 Series can unlock PowerBoost - a unique feature that delivers speeds of up to 1 gigabit-per-second (Gbps) over WiFi to Xfinity Mobile and Comcast Business Mobile customers.
Network Innovation Delivering Business Solutions at Scale
Comcast Business is hyper scaling the availability of its Dedicated Internet connectivity solution, which provides business customers with unparalleled speeds, 99.99 percent uptime, and proactive network monitoring.
Back to nav
Jobs For You
Featured Jobs
Recently Viewed Jobs
Saved Jobs
Quality Engineering Lead - Agent Evaluation & AI Platforms
Mount Laurel, New Jersey, West Chester, Pennsylvania Computer Engineering, AI 05/08/2026
Optical Transport Operations Engineer 2
Englewood, Colorado, Mount Laurel, New Jersey Computer Engineering 05/06/2026
Agentic AI Test Engineer
Mount Laurel, New Jersey Computer Engineering, AI 05/06/2026
Talent Community
Join our talent community so we can get to know you better, learn more about your skills and experience, and how they could align with future open positions at Comcast.
Sign Up Here
Job Alerts
Sign up for Job Alerts to be the first to know about new opportunities. After signing up or logging in to Workday, select Job Alerts in the top right corner to create a new alert or edit an existing one.
Get Started
Got a Question?
Check our FAQs or connect with @ComcastCareers
(opens in new window)
.
Facebook
X
LinkedIn
Glassdoor
YouTube
Instagram
COMCAST CAREERS
Job Opportunities
Life @ Comcast
Benefits
Early Career
FAQ
Search Jobs
Talent Community
OTHER CAREER OPTIONS AT COMCAST
NBCUniversal Careers
Universal Studios Hollywood Careers
Universal Studios Orlando Careers
Sky Careers
COMCAST CORPORATE
Comcast Corporate
Terms
Candidate Privacy
Comcast Policy on EEO
Do Not Sell My Personal Information
Motion Settings
Sitemap
Comcast is an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law. Comcast endeavors to make our career site accessible to any and all users. If you would like to contact us regarding accommodations for any part of the application or interview process, please contact .... Any inquiries regarding employment application status, resume submittal, open positions and any other general inquiries will not receive a response so please visit our FAQ page for more information. Comcast participates in the E-VERIFY PROGRAM in our hiring practices to achieve a lawful workforce. Comcast is a drug-free workplace.
Cookie Preferences
Current Employees
Candidates
Job Opportunities
Life @ Comcast
Benefits
Early Career
FAQs
Search Jobs
Search Jobs by Keyword
Location
Radius
select radius
5 miles
15 miles
25 miles
35 miles
50 miles
Search Jobs
Agentic AI Test Engineer
Mount Laurel, New Jersey
Apply Now Save Job
Overview
Success Profile
Benefits
Responsibilities
Hear From Our People
Culture
More About Comcast
Overview
Make your mark at Comcast -- a Fortune 30 global media and technology company. Become part of our award-winning, international engineering team that turns big ideas into cutting-edge products, platforms, and solutions that our customers love. We create space to innovate, and we recognize, reward, and invest in your ideas, while ensuring you can proudly bring your authentic self to the workplace. You'll do the best work of your career right here.
Back to nav
Success Profile
What makes a successful Agentic AI Test Engineer at Comcast? Check out these top traits and explore role-specific skills in the job description below.
Results-driven
Adaptable
Inventive
Entrepreneurial
Team Player
Problem-Solver
Back to nav
Benefits
We're proud to offer comprehensive benefits to help support you physically, financially and emotionally through the big milestones and in your everyday life.
Paid Time off
We know how important it can be to spend time away from work to relax, recover from illness, or take time to care for others needs.
Physical Wellbeing
We offer a range of benefits and support programs to ensure that you and your loved ones get the care you need.
Financial Wellbeing
These benefits give you personalized support designed entirely around your unique needs today and for the future.
Emotional Wellbeing
No matter how you're feeling or what you're dealing with, there are benefits to help when you need it, in the way that works for you.
Life Events + Family Support
Benefits that support you no matter where you are in life's journey.
See All Benefits
Back to nav
Responsibilities
Agentic AI Test Engineer
Location Mount Laurel, New Jersey
Req ID R436458
Job Type Full Time
Category Computer Engineering
Date posted 05/06/2026
Apply Now Save Job
Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and solutions that our customers love. We create space to innovate, and we recognize, reward, and invest in your ideas, while ensuring you can proudly bring your authentic self to the workplace. Join us. You'll do the best work of your career right here at Comcast. (In most cases, Comcast prefers to have employees on-site collaborating unless the team has been designated as virtual due to the nature of their work. If a position is listed with both office locations and virtual offerings, Comcast may be willing to consider candidates who live greater than 100 miles from the office for the remote option.)
Job Summary
The AI Agentic Team designs, builds, and runs intelligent agents end to end. We own agent logic, workflows, integrations, production deployment, and ongoing performance. By combining build and operations, we deliver agentic systems that are reliable, secure, and scalable in real-world use. We are building the next generation of our chat experience, transitioning from a human-assisted workflow to a fully agentic, AI-driven system. As an AI Agentic Software Engineer, you will create re-usable AI agents that will be used across Xfinity applications. Your initial focus will be to enable agentic capabilities at our Xfinity Assistant (chat application) with a strong passion for customer experience and a commitment to building intuitive, high-quality interactions.
Job Description
We are seeking a AI Agentic Test Engineer to join our core automation team. This role is designed for a hands-on engineer who is passionate about the intersection of AI and Quality Engineering. You will focus on building automated evaluation loops for AI Agents using LLM-as-a-judge patterns and maintaining robust Web and API test suites. The ideal candidate is a Python expert who is also comfortable working across various modern tech stacks and CI/CD environments.
AI & Agent Evaluation (Primary Focus)
LLM-as-a-Judge: Design and implement automated evaluation frameworks that utilize Large Language Models to assess the quality, accuracy, and safety of Agent responses.
Agentic Testing: Perform hands-on validation of AI Agents within complex environments, moving beyond static assertions to intelligent, semantic validation.
Data Validation: Automate the testing of real-time data streams and LLM outputs to ensure consistency and prevent regression in Agent behavior.
Full-Stack Automation & Coding
Python Mastery: Expert in Python for building custom test utilities, framework extensions, and automation scripts.
Cross-Functional Tooling: Develop and maintain automation across TypeScript, Java, and React environments to support various application layers.
Web & API Automation: Build high-performance automated tests for modern web interfaces and RESTful APIs, ensuring end-to-end system reliability.
Internal Tooling: Help build or maintain internal quality dashboards and tools using frameworks like Streamlit.
CI/CD & Technical Operations
Pipeline Execution: Integrate automated tests into CI/CD pipelines (e.g., Jenkins, Concourse) to ensure continuous quality feedback throughout the development lifecycle.
Code Quality: Actively participate in technical code reviews, focusing on script efficiency, maintainability, and clean code principles.
Troubleshooting: Use logs and observability tools to perform deep-dive root cause analysis on automation failures and system defects.
What You'll Need:
5+ years of experience as an SDET or Automation Engineer.
Strong technical background in building and maintaining custom automation frameworks.
Ability to work independently on complex coding tasks while collaborating effectively in an Agile environment.
Core Language: Expert-level hands-on coding in Python.
AI/LLM Skills: Solid understanding of Agent Evaluation techniques and using LLMs as a judge.
Automation Breadth: Proven experience in Web and API automation.
Multi-Stack Knowledge (Good to Have):
Languages: TypeScript, Java.
Frameworks: React, Streamlit.
DevOps: CI/CD pipeline management (Jenkins/Concourse).
Disclaimer: This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.
Comcast is an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law.
Skills:
Agentic AI; Adaptability; Critical Thinking; Automation; AI Agents; Python (Programming Language); AI Agent Orchestration
Salary:
Primary Location Pay Range: $114,985.89 - $172,478.83
Comcast intends to offer the selected candidate base pay within this range, dependent on job-related, non-discriminatory factors such as experience. The application window is 30 days from the date job is posted, unless the number of applicants requires it to close sooner or later.
Base pay is one part of the Total Rewards that Comcast provides to compensate and recognize employees for their work. Most sales positions are eligible for a Commission under the terms of an applicable plan, while most non-sales positions are eligible for a Bonus. Additionally, Comcast provides best-in-class Benefits to eligible employees. We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That's why we provide an array of options, expert guidance and always-on tools, that are personalized to meet the needs of your reality - to help support you physically, financially and emotionally through the big milestones and in your everyday life. Please visit the compensation and benefits summary on our careers site for more details.
Education
Bachelor's Degree
While possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.
Relevant Work Experience
5-7 Years
Apply Now Save Job
Share this job
X
Back to nav
Hear from our people
Comcast brings to the table the leading edge in the technology, so that sets the baseline for the features that are available to our customers
Albert
Vice President, Product Management
I mean, that's one of the best things about working here is that there have been very few times when I've been set, when I've been told, No, you can't do this.
Greg
Engineer
It is incredibly rewarding to see the work that we've done impact people in such a meaningful way, and we're bringing joy to people's lives.
Faisal
Executive Director, Machine Learning
Previous Slide
Next Slide
Back to nav
Culture
At Comcast you can have work/life balance in an inclusive environment where you can be your authentic self.
Comcast provides many opportunities to build skills and grow in your career and a top-notch benefits, time off and perks package.
We are committed to delivering reliable, effortless experiences to our customers no matter how they choose to interact with us.
You will build personal relationships on a growing team that while making Xfinity a best-in-class, most-loved brand.
Back to nav
More About Comcast
Comcast Unveils Industry-First Gateway Designed for Apartment Buildings Enabling Instant' Connectiity for Residents
Comcast has launched a new, innovative gateway with Tri-Band WiFi 6E technology that delivers faster speeds, lower latency, and Instant On' connectivity to apartment residents.
Xfinity Mobile, Comcast Business Mobile Customers Unlock PowerBoost - Delivering WiFi Speeds of Up to a Gig - with the New Samsung Galaxy S25 Series
Android fans have something to celebrate now that the new Samsung Galaxy S25 Series can unlock PowerBoost - a unique feature that delivers speeds of up to 1 gigabit-per-second (Gbps) over WiFi to Xfinity Mobile and Comcast Business Mobile customers.
Network Innovation Delivering Business Solutions at Scale
Comcast Business is hyper scaling the availability of its Dedicated Internet connectivity solution, which provides business customers with unparalleled speeds, 99.99 percent uptime, and proactive network monitoring.
Back to nav
Jobs For You
Featured Jobs
Recently Viewed Jobs
Saved Jobs
Quality Engineering Lead - Agent Evaluation & AI Platforms
Mount Laurel, New Jersey, West Chester, Pennsylvania Computer Engineering, AI 05/08/2026
Optical Transport Operations Engineer 2
Englewood, Colorado, Mount Laurel, New Jersey Computer Engineering 05/06/2026
Agentic AI Test Engineer
Mount Laurel, New Jersey Computer Engineering, AI 05/06/2026
Talent Community
Join our talent community so we can get to know you better, learn more about your skills and experience, and how they could align with future open positions at Comcast.
Sign Up Here
Job Alerts
Sign up for Job Alerts to be the first to know about new opportunities. After signing up or logging in to Workday, select Job Alerts in the top right corner to create a new alert or edit an existing one.
Get Started
Got a Question?
Check our FAQs or connect with @ComcastCareers
(opens in new window)
.
X
Glassdoor
YouTube
COMCAST CAREERS
Job Opportunities
Life @ Comcast
Benefits
Early Career
FAQ
Search Jobs
Talent Community
OTHER CAREER OPTIONS AT COMCAST
NBCUniversal Careers
Universal Studios Hollywood Careers
Universal Studios Orlando Careers
Sky Careers
COMCAST CORPORATE
Comcast Corporate
Terms
Candidate Privacy
Comcast Policy on EEO
Do Not Sell My Personal Information
Motion Settings
Sitemap
Comcast is an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law. Comcast endeavors to make our career site accessible to any and all users. If you would like to contact us regarding accommodations for any part of the application or interview process, please contact .... Any inquiries regarding employment application status, resume submittal, open positions and any other general inquiries will not receive a response so please visit our FAQ page for more information. Comcast participates in the E-VERIFY PROGRAM in our hiring practices to achieve a lawful workforce. Comcast is a drug-free workplace.
Cookie Preferences
Job ID: 520693862
Originally Posted on: 5/11/2026
Want to find more Technology opportunities?
Check out the 165,238 verified Technology jobs on iHireTechnology
Similar Jobs
Sign Up for Job Alerts
