Vizient Logo

Vizient

Lead, AI Quality & Reliability Engineering

Reposted 2 Months Ago
Be an Early Applicant
In-Office
60607, Chicago, IL, USA
89K-156K Annually
Senior level
In-Office
60607, Chicago, IL, USA
89K-156K Annually
Senior level
Lead AI Quality Engineering initiatives for enterprise AI, establishing AI-native testing, validation, runtime quality controls, observability, and automation. Coordinate cross-functional validation, release readiness, and production reliability for LLM-enabled workflows and AI platforms. Mentor teams and drive adoption of AI-assisted testing, telemetry analysis, and continuous improvement across healthcare-related AI solutions.
The summary above was generated by AI

When you’re the best, we’re the best. We instill an environment where employees feel engaged, satisfied and able to contribute their unique skills and talents while living and working as their authentic selves. We provide extensive opportunities for personal and professional development, building both employee competence and organizational capability to fuel exceptional performance through an inclusive environment both now and in the future.

Summary

In this role, you will lead the day-to-day execution and delivery of AI Quality Engineering initiatives supporting Vizient's enterprise AI transformation efforts. You will help ehelp implement AI Quality Engineering practices, AI validation processes, AI-assisted testing approaches, runtime quality controls, and scalable testing frameworks supporting responsible deployment of AI-powered business solutions. This role combines hands-on quality engineering leadership, AI-enabled testing modernization, healthcare workflow validation, team leadership, and cross-functional delivery coordination to ensure the reliability, performance, and governance of AI-enabled systems.

Responsibilities

  • Lead day-to-day AI Quality Engineering activities supporting AI-powered applications, LLM-enabled workflows, intelligent automation solutions, agentic systems, and enterprise AI platforms.
  • Implement AI Quality Engineering practices, including AI-native testing approaches, validation processes, runtime quality controls, reusable testing accelerators, and scalable testing workflows.
  • Coordinate AI validation efforts, including functional testing, prompt testing, workflow validation, regression testing, defect management, release readiness, and production quality assurance.
  • Partner with AI Engineering, AIOps, LLMOps, Security, Governance, Clinical, Data, and Product teams to ensure scalable and effective quality engineering processes across AI initiatives.
  • Support runtime quality and reliability through observability, monitoring, telemetry analysis, incident support, drift detection, distributed tracing, and continuous improvement initiatives.
  • Drive adoption of AI-assisted testing, intelligent automation, reusable test assets, and modern quality engineering practices that improve efficiency and quality outcomes.
  • Lead delivery coordination activities including sprint execution, testing planning, issue tracking, risk identification, dependency management, and release support.
  • Collaborate with clinical, operational, and engineering stakeholders to validate healthcare workflows, payer operations, and AI-enabled business processes while supporting responsible AI deployment.
  • Mentor quality engineers, analysts, contractors, and delivery teams while fostering a culture of continuous learning, engineering excellence, and operational accountability.

Qualifications

  • Bachelor's degree in Computer Science, Information Systems, Engineering, or related field preferred.
  • 7 or more years of experience in Quality Engineering, Software Testing, Quality Assurance, or related technology disciplines required.
  • 1 or more years of experience supporting AI Quality Engineering, AI testing, AI validation, AI-enabled automation, or modern AI engineering initiatives preferred.
  • Strong experience supporting Quality Engineering or Quality Assurance activities across enterprise platforms, APIs, operational workflows, healthcare applications, or integrated business systems required.
  • Experience with enterprise testing practices, test automation frameworks, SDLC methodologies, Agile delivery models, defect management, release validation, and production support coordination required.
  • Strong analytical, organizational, communication, collaboration, and leadership skills required.
  • Ability to manage multiple priorities within fast-paced, evolving, and highly collaborative enterprise environments required.
  • Experience with Python, APIs, automation frameworks, AI-enabled workflows, or modern software engineering practices preferred.
  • Experience supporting AI/ML platforms, orchestration frameworks, runtime monitoring, observability tooling, or AI operational support processes preferred.
  • Familiarity with AI-assisted testing, AI evaluation approaches, prompt testing, runtime observability, operational monitoring, drift detection, or AI operational assurance practices preferred.
  • Experience supporting enterprise modernization or transformation initiatives involving AI, automation, or operational scaling preferred.

#LI-JB1

Estimated Hiring Range:

At Vizient, we consider skills, experience, and organizational needs in our compensation approach. Geographic factors may adjust the range estimate and hires typically fall below the top range. Compensation decisions are tailored to individual circumstances. The current salary range for this role is $88,900.00 to $155,500.00.

This position is also incentive eligible.

Vizient has a comprehensive benefits plan! Please view our benefits here:

http://www.vizientinc.com/about-us/careers

Equal Opportunity Employer:   Females/Minorities/Veterans/Individuals with Disabilities

The Company is committed to equal employment opportunity to all employees and applicants without regard to race, religion, color, gender identity, ethnicity, age, national origin, sexual orientation, disability status, veteran status or any other category protected by applicable law.

Vizient Chicago, Illinois, USA Office

Chicago, United States

Vizient Skokie, Illinois, USA Office

Skokie, United States

Similar Jobs

An Hour Ago
In-Office
16-24 Hourly
Junior
16-24 Hourly
Junior
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Schedules home health visits, manages patient referrals, assigns clinicians for start-of-care assessments, processes visit status changes, monitors pending referrals, and communicates with field staff to resolve scheduling issues. The role requires strong organization, communication, customer service, and decision-making skills, with knowledge of healthcare scheduling and OASIS-related regulations preferred.
Top Skills: Online Scheduling System
An Hour Ago
In-Office
38-69 Hourly
Junior
38-69 Hourly
Junior
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Provides home-based nursing and case management, including patient assessments, care planning, referrals, education, self-care coaching, supervision of LPNs and HHAs, documentation, on-call support, and communication with the care team. Requires an active state RN license, clinical nursing experience, CPR certification, and reliable transportation for patient visits.
An Hour Ago
In-Office
22-40 Hourly
Entry level
22-40 Hourly
Entry level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Provides skilled nursing care to patients in their homes according to care plans and state nursing regulations. Responsibilities include educating families, monitoring and documenting patient responses, reporting condition changes, and coordinating with supervising nurses and physicians. Requires unrestricted LPN or LVN licensure, a driver’s license, insurance, and dependable transportation. CPR certification, home care experience, independence, communication skills, and flexible availability are preferred.

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account