Vizient Logo

Vizient

Lead Software Engineer (Databricks Platform Engineer)

Reposted One Month Ago
Be an Early Applicant
In-Office
60607, Chicago, IL, USA
118K-206K Annually
Senior level
In-Office
60607, Chicago, IL, USA
118K-206K Annually
Senior level
Lead design, engineering, and evolution of the enterprise Databricks platform. Build IaC, CI/CD, automation, and self-service capabilities; enable ML/AI features (MLflow, Model Registry, Feature Store, Vector Search); optimize performance, security, governance, and cost; evaluate new technologies; mentor engineers and drive platform adoption across stakeholders.
The summary above was generated by AI

When you’re the best, we’re the best. We instill an environment where employees feel engaged, satisfied and able to contribute their unique skills and talents while living and working as their authentic selves. We provide extensive opportunities for personal and professional development, building both employee competence and organizational capability to fuel exceptional performance through an inclusive environment both now and in the future.

Summary:
 

In this role, you will lead the design, engineering, and evolution of the enterprise Databricks platform as a strategic capability that enables analytics, data products, machine learning, and AI solutions across the organization. You will develop reusable platform services, automation frameworks, reference architectures, and self-service capabilities that accelerate delivery while aligning with enterprise architecture, governance, and engineering standards. You will collaborate with cross-functional teams to enhance developer experience, drive platform adoption, evaluate emerging technologies, and deliver scalable, secure, and cost-effective healthcare data and AI solutions.

Responsibilities:

  • Lead the design, implementation, and continuous evolution of the enterprise Databricks platform and supporting architecture.
  • Develop reusable platform services, reference architectures, engineering standards, and implementation patterns for analytics, data products, streaming, and AI workloads.
  • Build Infrastructure-as-Code, CI/CD pipelines, and automation frameworks to improve platform scalability, reliability, and operational efficiency.
  • Create self-service capabilities, reusable templates, and engineering accelerators that simplify platform onboarding and deployment.
  • Optimize platform performance, scalability, security, governance, and cost efficiency across cloud environments.
  • Enable machine learning and AI platform capabilities by implementing patterns for MLflow, Model Registry, Feature Store, Vector Search, and other Databricks technologies.
  • Partner with Enterprise Architecture, Data Engineering, Product Management, Cloud Engineering, Data Science, and client stakeholders to deliver enterprise platform capabilities.
  • Evaluate emerging Databricks features and cloud technologies, lead proof-of-concepts, and recommend platform enhancements that support business objectives.
  • Provide technical leadership, mentoring, and engineering guidance while promoting Platform-as-a-Product principles and engineering best practices.
  • Drive continuous improvement through automation, innovation, and adoption of enterprise platform standards.

Qualifications:

  • Relevant degree preferred. Advanced degree in Computer Science, Engineering, Information Systems, or a related field preferred.
  • 7 or more years of relevant experience required.
  • 3 or more years of hands-on experience designing, implementing, and supporting Databricks platform solutions required.
  • Strong experience with Azure cloud services, cloud-native architectures, and enterprise platform engineering required.
  • Experience with Terraform, Infrastructure-as-Code, and CI/CD pipelines, and infrastructure automation.
  • Strong knowledge of Delta Lake, Unity Catalog, Apache Spark, and lakehouse architectures.
  • Experience developing reusable platform services, automation frameworks, self-service capabilities, and engineering accelerators.
  • Experience supporting machine learning and AI platform capabilities, including MLflow, Model Registry, Feature Store, Vector Search, or MLOps practices preferred.
  • Databricks certification, experience with streaming and event-driven architectures, enterprise-scale data platforms, or healthcare industry experience preferred.

Estimated Hiring Range:

At Vizient, we consider skills, experience, and organizational needs in our compensation approach. Geographic factors may adjust the range estimate and hires typically fall below the top range. Compensation decisions are tailored to individual circumstances. The current salary range for this role is $117,600.00 to $206,000.00.

This position is also incentive eligible.

Vizient has a comprehensive benefits plan! Please view our benefits here:

http://www.vizientinc.com/about-us/careers

Equal Opportunity Employer:   Females/Minorities/Veterans/Individuals with Disabilities

The Company is committed to equal employment opportunity to all employees and applicants without regard to race, religion, color, gender identity, ethnicity, age, national origin, sexual orientation, disability status, veteran status or any other category protected by applicable law.

Vizient Chicago, Illinois, USA Office

Chicago, United States

Vizient Skokie, Illinois, USA Office

Skokie, United States

Similar Jobs

3 Minutes Ago
Remote or Hybrid
United States
97K-131K Annually
Senior level
97K-131K Annually
Senior level
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Leads end-to-end quality assurance for Workday implementations, upgrades, and enhancements. Defines testing strategies, plans, frameworks, and risk mitigation; oversees functional, integration, regression, and UAT testing across Workday modules. Manages defects, test data, environments, release validation, reporting, and stakeholder sign-off. Coordinates QA activities among business teams, developers, system integrators, vendors, and delivery partners while ensuring adherence to quality standards and governance.
Top Skills: Azure DevopsErpJIRAWorkday
13 Minutes Ago
Remote or Hybrid
United States
142K-192K Annually
Expert/Leader
142K-192K Annually
Expert/Leader
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Lead complex real estate tax engagements, mentor teams, provide client advisory on tax strategies, and drive business growth through networking.
Top Skills: CpaJdLlmMstTax Technology Tools
13 Minutes Ago
Remote or Hybrid
United States
106K-160K Annually
Senior level
106K-160K Annually
Senior level
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Manage tax compliance engagements, communicate with clients, review tax work, provide training, and maintain technical expertise in tax areas.
Top Skills: AdobeCasewareExcelGo File RoomPowerPointTax Preparation Software (Axcess)Tax Research Software (Ria)Word

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account