Vizient Logo

Vizient

Lead Architect, AI Quality and Reliability Engineering

Reposted 5 Days Ago
Be an Early Applicant
In-Office
60607, Chicago, IL, USA
135K-237K Annually
Senior level
In-Office
60607, Chicago, IL, USA
135K-237K Annually
Senior level
Lead end-to-end quality engineering and validation for an AI-enabled healthcare operations analytics product. Design scalable automated validation frameworks, data quality and reconciliation, ontology and metric validation, LLM and AI evaluation, test harnesses, regression suites, and observability. Partner across product, engineering, and domain teams, mentor engineers, and drive root-cause resolution to ensure accurate, reliable, and traceable data, metrics, APIs, analytics, and user workflows.
The summary above was generated by AI

When you’re the best, we’re the best. We instill an environment where employees feel engaged, satisfied and able to contribute their unique skills and talents while living and working as their authentic selves. We provide extensive opportunities for personal and professional development, building both employee competence and organizational capability to fuel exceptional performance through an inclusive environment both now and in the future.

Responsibilities:


Required Responsibilities:
  • Lead quality engineering strategy and execution, establishing test automation, validation standards, and measurable quality goals across the product.
  • Design and develop scalable automated testing frameworks covering data pipelines, APIs, business logic, analytics, AI capabilities, and user-facing applications.
  • Establish comprehensive data validation and reconciliation practices to ensure accuracy, completeness, consistency, and integrity of healthcare data and calculated metrics.
  • Develop automated testing approaches for AI-enabled applications, including LLM evaluation, output accuracy, regression testing, and agentic workflow validation.
  • Build and maintain automated regression suites, test datasets, CI/CD quality gates, and monitoring capabilities to detect defects early and prevent regressions.
  • Drive end-to-end product validation, including integration, functional, performance, and reliability testing across complex data and application workflows.
  • Partner with Product, Engineering, and domain experts to define acceptance criteria, investigate defects, and ensure production readiness.
  • Champion shift-left quality engineering, mentor engineers, and drive continuous improvement in automation, testing practices, and product reliability.

Preferred Responsibilities:

  • Develop reusable testing tools and automation frameworks leveraging Palantir Foundry, AIP, and modern AI-assisted development capabilities.
  • Evaluate emerging AI testing tools and methodologies to improve testing efficiency, coverage, and reliability.

Estimated Hiring Range:

At Vizient, we consider skills, experience, and organizational needs in our compensation approach. Geographic factors may adjust the range estimate and hires typically fall below the top range. Compensation decisions are tailored to individual circumstances. The current salary range for this role is $135,200.00 to $236,600.00.

This position is also incentive eligible.

Vizient has a comprehensive benefits plan! Please view our benefits here:

http://www.vizientinc.com/about-us/careers

Equal Opportunity Employer:   Females/Minorities/Veterans/Individuals with Disabilities

The Company is committed to equal employment opportunity to all employees and applicants without regard to race, religion, color, gender identity, ethnicity, age, national origin, sexual orientation, disability status, veteran status or any other category protected by applicable law.

Vizient Chicago, Illinois, USA Office

Chicago, United States

Vizient Skokie, Illinois, USA Office

Skokie, United States

Similar Jobs

An Hour Ago
Hybrid
Chicago, IL, USA
87K-135K Annually
Mid level
87K-135K Annually
Mid level
Artificial Intelligence • Cloud • Information Technology • Legal Tech • Productivity • Software
Manages post-sale customer success for cloud customers and law firms using a pooled model. Responsibilities include driving adoption, responding to customer inquiries, creating self-service resources, maintaining documentation, coordinating escalations, analyzing customer data, improving scalable workflows, and building customer advocacy. Requires strong communication, organization, resourcefulness, and experience in a high-volume SaaS support or customer success environment.
Top Skills: ImanageSaaSSalesforceZendesk
6 Hours Ago
Remote or Hybrid
Chicago, IL, USA
85K-110K Annually
Mid level
85K-110K Annually
Mid level
Automotive • Professional Services • Software • Consulting • Energy • Chemical • Renewable Energy
Leads GMP and quality system audits across manufacturing sites, farms, and processing facilities. Assesses compliance with pharmaceutical, supplement, medical device, cosmetics, food safety, and client standards; prepares detailed reports; mentors auditors; leads complex audits; and manages audit schedules and expenses. Requires frequent international and regional travel, strong analytical and communication skills, relevant credentials, and at least four years of related experience.
Top Skills: 21 Cfr 11121 Cfr 210/21121 Cfr 820CpgpCqaGfsiGmpIrcaIso 22716ExcelMicrosoft WordPcqiRabqsaRac
6 Hours Ago
Hybrid
Northbrook, IL, USA
142K-189K Annually
Expert/Leader
142K-189K Annually
Expert/Leader
Automotive • Professional Services • Software • Consulting • Energy • Chemical • Renewable Energy
Leads technical planning for UL laboratory capabilities supporting large-scale data center testing. Evaluates power, cooling, facility, equipment, safety, and operational requirements; identifies infrastructure investments and limitations; translates data center needs into laboratory requirements; and collaborates with engineering, operations, business, and technical leadership. Provides technical guidance and training while monitoring evolving data center architectures and testing demands.
Top Skills: CommissioningControlsData Center Cooling SystemsData Center Power InfrastructureElectrical SystemsFacility InfrastructureHvacInstrumentationIt InfrastructureLaboratory TestingMechanical SystemsSafety SystemsValidation

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account