Vizient Logo

Vizient

Lead, AI Quality & Reliability Engineering

Reposted One Month Ago
Be an Early Applicant
In-Office
60607, Chicago, IL, USA
89K-156K Annually
Senior level
In-Office
60607, Chicago, IL, USA
89K-156K Annually
Senior level
Lead AI Quality Engineering initiatives for enterprise AI, establishing AI-native testing, validation, runtime quality controls, observability, and automation. Coordinate cross-functional validation, release readiness, and production reliability for LLM-enabled workflows and AI platforms. Mentor teams and drive adoption of AI-assisted testing, telemetry analysis, and continuous improvement across healthcare-related AI solutions.
The summary above was generated by AI

When you’re the best, we’re the best. We instill an environment where employees feel engaged, satisfied and able to contribute their unique skills and talents while living and working as their authentic selves. We provide extensive opportunities for personal and professional development, building both employee competence and organizational capability to fuel exceptional performance through an inclusive environment both now and in the future.

Summary

In this role, you will lead the day-to-day execution and delivery of AI Quality Engineering initiatives supporting Vizient's enterprise AI transformation efforts. You will help ehelp implement AI Quality Engineering practices, AI validation processes, AI-assisted testing approaches, runtime quality controls, and scalable testing frameworks supporting responsible deployment of AI-powered business solutions. This role combines hands-on quality engineering leadership, AI-enabled testing modernization, healthcare workflow validation, team leadership, and cross-functional delivery coordination to ensure the reliability, performance, and governance of AI-enabled systems.

Responsibilities

  • Lead day-to-day AI Quality Engineering activities supporting AI-powered applications, LLM-enabled workflows, intelligent automation solutions, agentic systems, and enterprise AI platforms.
  • Implement AI Quality Engineering practices, including AI-native testing approaches, validation processes, runtime quality controls, reusable testing accelerators, and scalable testing workflows.
  • Coordinate AI validation efforts, including functional testing, prompt testing, workflow validation, regression testing, defect management, release readiness, and production quality assurance.
  • Partner with AI Engineering, AIOps, LLMOps, Security, Governance, Clinical, Data, and Product teams to ensure scalable and effective quality engineering processes across AI initiatives.
  • Support runtime quality and reliability through observability, monitoring, telemetry analysis, incident support, drift detection, distributed tracing, and continuous improvement initiatives.
  • Drive adoption of AI-assisted testing, intelligent automation, reusable test assets, and modern quality engineering practices that improve efficiency and quality outcomes.
  • Lead delivery coordination activities including sprint execution, testing planning, issue tracking, risk identification, dependency management, and release support.
  • Collaborate with clinical, operational, and engineering stakeholders to validate healthcare workflows, payer operations, and AI-enabled business processes while supporting responsible AI deployment.
  • Mentor quality engineers, analysts, contractors, and delivery teams while fostering a culture of continuous learning, engineering excellence, and operational accountability.

Qualifications

  • Bachelor's degree in Computer Science, Information Systems, Engineering, or related field preferred.
  • 7 or more years of experience in Quality Engineering, Software Testing, Quality Assurance, or related technology disciplines required.
  • 1 or more years of experience supporting AI Quality Engineering, AI testing, AI validation, AI-enabled automation, or modern AI engineering initiatives preferred.
  • Strong experience supporting Quality Engineering or Quality Assurance activities across enterprise platforms, APIs, operational workflows, healthcare applications, or integrated business systems required.
  • Experience with enterprise testing practices, test automation frameworks, SDLC methodologies, Agile delivery models, defect management, release validation, and production support coordination required.
  • Strong analytical, organizational, communication, collaboration, and leadership skills required.
  • Ability to manage multiple priorities within fast-paced, evolving, and highly collaborative enterprise environments required.
  • Experience with Python, APIs, automation frameworks, AI-enabled workflows, or modern software engineering practices preferred.
  • Experience supporting AI/ML platforms, orchestration frameworks, runtime monitoring, observability tooling, or AI operational support processes preferred.
  • Familiarity with AI-assisted testing, AI evaluation approaches, prompt testing, runtime observability, operational monitoring, drift detection, or AI operational assurance practices preferred.
  • Experience supporting enterprise modernization or transformation initiatives involving AI, automation, or operational scaling preferred.

#LI-JB1

Estimated Hiring Range:

At Vizient, we consider skills, experience, and organizational needs in our compensation approach. Geographic factors may adjust the range estimate and hires typically fall below the top range. Compensation decisions are tailored to individual circumstances. The current salary range for this role is $88,900.00 to $155,500.00.

This position is also incentive eligible.

Vizient has a comprehensive benefits plan! Please view our benefits here:

http://www.vizientinc.com/about-us/careers

Equal Opportunity Employer:   Females/Minorities/Veterans/Individuals with Disabilities

The Company is committed to equal employment opportunity to all employees and applicants without regard to race, religion, color, gender identity, ethnicity, age, national origin, sexual orientation, disability status, veteran status or any other category protected by applicable law.

Vizient Chicago, Illinois, USA Office

Chicago, United States

Vizient Skokie, Illinois, USA Office

Skokie, United States

Similar Jobs

23 Minutes Ago
Hybrid
15-20 Hourly
Junior
15-20 Hourly
Junior
eCommerce • Fashion • Retail • Sales • Wearables • Design
The Sales Associate will deliver personalized shopping experiences, drive sales, maintain store operations, and build client relationships while adhering to brand standards.
Top Skills: Mobile PosPos SystemsSocial Selling Platforms
An Hour Ago
Remote or Hybrid
USA
Mid level
Mid level
Machine Learning • Payments • Security • Software • Financial Services
Leads the design and development of software solutions addressing complex business needs. Provides technical guidance, facilitates problem resolution, reviews coding and testing, prepares technical documentation, and applies modern development methodologies and tools. The role also supports application architecture, integration, testing, release management, and business initiatives while managing technology-related risks.
Top Skills: AgileApplication Development ToolsApplication TestingPackaged Application IntegrationScrum
An Hour Ago
Remote or Hybrid
USA
Senior level
Senior level
Machine Learning • Payments • Security • Software • Financial Services
Supports the stability, availability, performance, and compliance of production systems. Responsibilities include monitoring, maintenance, patching, upgrades, incident resolution, root cause analysis, capacity reporting, application governance, continuity testing, audit responses, and technology-standard compliance. The role requires Hogan mainframe experience, participates in rotating on-call support, and transfers system knowledge to junior staff.
Top Skills: HoganMainframeUmbrella

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account