Design, orchestrate, and optimize large-scale LLM pre-training across 1,000+ GPUs. Implement 3D parallelism, manage GPU clusters (SLURM/Kubernetes), optimize InfiniBand/RDMA networking and memory, and automate checkpointing and failure recovery for long training runs.
We are seeking a highly skilled LLM Pre-training & Distributed Systems Engineer. This role is essential for orchestrating large-scale machine learning training runs and optimizing distributed infrastructure. The ideal candidate will have a deep understanding of GPU clusters and extensive experience in system engineering to ensure efficient and reliable training processes.
Responsibilities:
- Orchestrate distributed training runs across 1,000+ GPUs using PyTorch, DeepSpeed, or Megatron-LM.
- Optimize networking (InfiniBand/RDMA) and memory management to prevent out-of-memory errors.
- Automate checkpointing and failure recovery during month-long training runs.
Required Skills:
- Deep expertise in 3D parallelism (Data, Tensor, Pipeline).
- Experience managing SLURM or Kubernetes-based GPU clusters.
- Strong systems engineering background (C++, CUDA, Python).
Similar Jobs
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Manage customer onboarding, training, adoption, retention, and growth for the Falcon Shield SaaS security platform. Build trusted relationships with security teams, develop measurable success plans, conduct strategic reviews, demonstrate product value, and advise customers on SaaS security posture and architecture. Partner with Product and R&D teams to communicate customer needs, identify product gaps, and support feature improvements.
Top Skills:
Ai AgentsFalcon ShieldIdentity And Access Management (Iam)Large Language Models (Llms)Saas Security Posture Management (Sspm)Saas Security Tooling
Cloud • Security • Software • Cybersecurity • Automation
As Principal Product Manager, you'll define product strategy for GitLab's AI models, focusing on custom and self-hosted AI capabilities, collaborating with engineering, and ensuring alignment with company strategy.
Top Skills:
AIDevsecopsInfrastructure
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Own a portfolio of 50–75 Canadian mid-market renewals per quarter, leading quoting, negotiations, approvals, forecasting, and 36-month contract execution. Minimize churn, protect revenue, identify expansion opportunities, and communicate account insights. Partner with customer success, account executives, Deal Desk, Legal, and Finance to secure favorable terms and deliver predictable retention results.
Top Skills:
Salesforce
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
