NVIDIA Logo

NVIDIA

Distinguished Engineer, Production Engineering, Cluster Management

Posted Yesterday
Be an Early Applicant
Remote or Hybrid
Hiring Remotely in OR, USA
320K-489K Annually
Senior level
Remote or Hybrid
Hiring Remotely in OR, USA
320K-489K Annually
Senior level
Leads the technical strategy, architecture, operating standards, and automation for NVIDIA DGX Cloud clusters across on-premises, hyperscaler, and cloud partner environments. The role drives cluster lifecycle management, production readiness, reliability, restoration, release safety, and cross-team coordination. It requires hands-on software and systems engineering, architectural leadership, and influence across platform, hardware, provider, and service teams.
The summary above was generated by AI

NVIDIA is seeking a Distinguished Engineer to serve as a senior technical leader in the Production Engineering organization. The person will be passionate about leading cluster activities within DGX Cloud GPU capacity. Production Engineering at NVIDIA is tasked with ensuring large-scale production systems remain reliable, manageable, and progressively automated across DGX Cloud resources. Our method combines software engineering, systems engineering, and production expertise. This allows us to develop platforms, workflows, and operating models that preserve GPU infrastructure health, scalability, and availability for researchers and customers.

This position focuses on the operational structure for DGX Cloud clusters across on-prem, hyperscalers, and NVIDIA Cloud Partner environments. The scope includes the engineering connections needed to ensure DGX Cloud capacity is fully functional in production: Kubernetes service management, provider and hardware readiness, on-prem infrastructure handling, deployment and operational preparedness, service reliability collaborations, and the processes that integrate these areas into a unified production system. This is a hands-on Distinguished Engineer role for a deeply technical leader who will define architectural direction for cluster operations throughout DGX Cloud. The right person will combine software engineering rigor, systems depth, and production judgment. They will set technical strategy and establish operating standards. They will guide the framework’s evolution for production operations. They will drive progress on cross-organizational capabilities to keep DGX Cloud capacity usable, supportable, and improving at scale. This role requires both the ability to go deep in building and implementation and the ability to lead through influence across multiple teams and high-consequence production outcomes.

What you'll be doing:

  • Define the long-range technical strategy for operating DGX Cloud clusters consistently across local data centers, hyperscalers, and NeoCloud environments

  • Define the architectural direction and fundamental operating standards for cluster lifecycle, runtime delivery, restoration, release readiness, and steady-state operability concerning DGX Cloud capacity

  • Guide the roadmap and execution of critical cross-organizational investments that improve production readiness, operational safety, performance, and cross-team coordination

  • Make and influence high-impact technical decisions that build how platform, hardware, provider, and service teams work together to operate DGX Cloud resources in production

  • Build durable workflows, interfaces, and engineering handshakes across Kubernetes production service, provider and hardware preparation, on-prem and bare-metal

  • Restructure operations, and service-layer reliability domains

  • Build and evolve the automation, APIs, operating workflows, and readiness gates required to move new capacity into stable production and keep existing capacity balanced

  • Implement production operating approaches that lower manual input, establish clear ownership responsibilities, and increase consistency, traceability, and release safety within DGX Cloud environments

  • Partner closely with platform teams, hardware and provider engineering, service owners, and other Production Engineering leaders to identify repeated friction and convert it into durable improvements in software, processes, and operational interfaces

  • Raise the engineering bar for operability, resilience, scalability, and performance across cluster operations through build leadership, architecture review, and technical standards

What we need to see:

  • BS, MS, or PhD in Computer Science, Electrical Engineering, or a related technical field, or equivalent experience

  • 18+ years of experience building and operating large-scale distributed systems, infrastructure platforms, or production environments

  • Confirmed company-level technical leadership at principal, distinguished, or equivalent scope in production engineering, SRE, infrastructure software, or cloud platforms

  • Consistent track record of defining operating models, architectural direction, and engineering standards across multiple technical domains and organizations

  • Consistent record leading large, cross-team technical efforts from concept through production, including aligning collaborators, navigating for clarity and delivering measurable outcomes

  • Deep experience with one or more of these areas: Kubernetes-based production systems, infrastructure automation, or distributed systems operations.

  • Strong software engineering skills in languages such as Python, Go, or similar low-level programming languages

  • Deep understanding of distributed systems, Linux, networking, containers, and production reliability concerns

  • Experience crafting operational workflows, APIs, service interfaces, or automation frameworks that become the standard way teams run production systems

  • Strong architectural judgment and a validated history of simplifying complex operational problems through reusable software, clear technical strategy, and durable engineering direction

Ways to stand out from the crowd:

  • Defined the structural foundation for a large, heterogeneous infrastructure environment spanning multiple platforms or providers

  • Established widely used operating standards, architectures, APIs, or workflows that improved reliability, operability, or performance at company scale

  • Built automation and engineering interfaces that connect platform teams, infrastructure teams, and service owners into a consistent production system

  • Experience improving production readiness, restoration, runtime safety, or release quality for large-scale infrastructure

  • Equally comfortable setting technical strategy, reviewing architecture at scale, writing code, and driving adoption across organizational boundaries

This role is purposely assigned to the cross-domain production operating model for DGX Cloud capacity. It does not involve a shared platform-software function for typical automation services. Success is achieved by making sure the larger DGX Cloud cluster estate functions optimally in a live environment. The position calls for strong technical leadership, consistent workflows, clear limits, and productive cross-team engineering coordination.

#LI-Hybrid

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 320,000 USD - 488,750 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until September 7, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

11 Minutes Ago
Easy Apply
Remote
USA
Easy Apply
263K-309K Annually
Senior level
263K-309K Annually
Senior level
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Provides architectural and technical leadership for institutional exchange systems, including matching engines, order management, market data, risk, and unified trading platforms. Leads ultra-low-latency distributed-system design, cross-team technical alignment, reliability standards, incident response, and multi-quarter initiatives. Maintains hands-on engineering contributions while mentoring senior engineers and developing technical leadership across teams.
Top Skills: C++Cloud ComputingColocated InfrastructureDistributed SystemsEvent SourcingGenerative AiGoJavaJvmLinux
11 Minutes Ago
Easy Apply
Remote
USA
Easy Apply
191K-225K Annually
Senior level
191K-225K Annually
Senior level
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Build and operate low-latency market data systems for institutional trading, including feed handlers, normalization pipelines, venue connectivity, and distribution services. Develop high-throughput services, improve reliability and performance through observability and incident response, participate in on-call support, and collaborate with engineering and product teams. The role requires production backend engineering experience, market data infrastructure expertise, Java or C++, messaging frameworks, and exchange connectivity protocols.
Top Skills: AeronC++FixItch/OuchJavaMulticastSbe
12 Minutes Ago
Easy Apply
Remote
USA
Easy Apply
186K-219K Annually
Senior level
186K-219K Annually
Senior level
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Owns and optimizes resilient, ultra-low-latency network and physical data-center infrastructure for institutional trading across cloud and on-premises environments. Designs routing, multicast, segmentation, firewall, VPN, telemetry, and automation systems. Leads production changes, incident response, failover testing, maintenance, and on-call support for 24/7 trading platforms. Mentors engineers and partners with SRE, product, and trading-system teams to improve reliability and developer velocity.
Top Skills: AnsibleArista MlagBgpCisco VpcFortinetGrpcIgmpIpsec VpnLinuxMulticast NetworkingOspfPalo AltoPimPythonSnmpSsl VpnVrfsVrrp

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account