d-Matrix Logo

d-Matrix

Senior Infrastructure Engineer

Posted 15 Days Ago
Remote
Hiring Remotely in USA
98K-150K Annually
Senior level
Remote
Hiring Remotely in USA
98K-150K Annually
Senior level
Owns production infrastructure across Kubernetes, CI/CD, Linux systems, virtual machines, and AI accelerator environments. Responsibilities include incident response, troubleshooting, automation, monitoring, alerting, patching, upgrades, certificate renewals, capacity checks, runbook development, and on-call support. The engineer collaborates across IT and product software teams and contributes to infrastructure design and build work.
The summary above was generated by AI

Join d-Matrix and help build the future of AI inference. We’ve pioneered a memory-centric architecture that brings compute directly into memory, making AI faster, more energy efficient, and accessible on a global scale. From chips and software to rack-scale systems, our team is tackling some of AI infrastructure’s hardest challenges — and shipping breakthrough technology today. If you want to create what comes next and help make infinite inference possible, we’d love to hear from you.

Our culture is built on respect, collaboration, and direct communication. We value humility, we believe our different perspectives lead to better solutions, and we’re looking for people who are driven by execution and energized by hard problems.

Senior Infrastructure Engineer
Location: Remote, United States

Role Overview

Software Infrastructure runs the Kubernetes clusters, CI/CD systems, and compute environments that every d-Matrix engineer builds and tests on, along with the systems behind our externally accessible product demos. As a senior infrastructure engineer, you will be the team’s first responder and own issues end to end: diagnosing them, fixing them, and engaging IT or the product software group when the root cause sits with them. Our environment combines cloud resources, conventional servers, and our own AI accelerators and networking hardware, so quickly isolating the cause is central to the job. When an issue recurs, you will turn it into automation, better alerting, or a runbook. This is not an IT support or ticket-queue role, and IT owns physical hardware; we manage everything from the operating system up. On-call participation is expected.

What You Will Do

  • Own first response and resolution for issues across Kubernetes clusters, GitLab and CI runners, VMs, standalone systems, and demo environments

  • Triage across teams with IT and the product software group when the root cause sits on their side

  • Convert recurring issues into automation, alerts, and runbooks so repeat incidents decline

  • Improve monitoring and alerting to reduce false alarms and speed detection of real problems

  • Perform routine operational work, including upgrades, patching, certificate renewals, and capacity checks

  • Ship automation and improvements the team relies on, beyond individual fixes

  • Participate in on-call coverage for the environment

  • Contribute to design and build work across the team’s systems as your scope grows

What You Will Bring

  • 2+ years operating production Linux systems, including hands-on Kubernetes troubleshooting

  • Methodical debugging skills: forming hypotheses, narrowing them quickly, and working across layers when the obvious answer is wrong

  • Scripting experience in Python and/or Bash

  • Familiarity with CI/CD systems (GitLab preferred)

  • Working knowledge of networking fundamentals, including DNS, routing, load balancing, and TLS

  • Experience with monitoring and observability tools

  • Clear communication under pressure, including concise incident status updates

  • Drive and curiosity to learn unfamiliar systems and how state-of-the-art inference systems are built

Preferred Qualifications

  • Experience with GPU or accelerator nodes in Kubernetes

  • Experience with infrastructure-as-code tools such as Ansible or Terraform

  • Experience with monitoring platforms such as DataDog, Prometheus, or Grafana

  • Bare metal or on-prem infrastructure experience

  • CKA or CKAD certification

Equal Opportunity Employment Policy

d-Matrix is proud to be an equal opportunity workplace and affirmative action employer. We’re committed to fostering an inclusive environment where everyone feels welcomed and empowered to do their best work. We hire the best talent for our teams, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status. Our focus is on hiring teammates with humble expertise, kindness, dedication, and a willingness to embrace challenges and learn together every day.

d-Matrix does not accept resumes or candidate submissions from external agencies. We appreciate the interest and effort of recruitment firms, but we kindly request that individuals interested in opportunities with d-Matrix apply directly through our official channels. This approach allows us to streamline our hiring processes and maintain a consistent and fair evaluation of all applicants. Thank you for your understanding and cooperation.

Similar Jobs

Yesterday
Remote or Hybrid
165K-250K Annually
Senior level
165K-250K Annually
Senior level
Cloud • Digital Media • News + Entertainment • On-Demand
Build and operate Philo’s ML and LLM infrastructure, including AWS and Kubernetes platforms, GPU scheduling, model serving, inference optimization, monitoring, evaluation, experimentation, and CI/CD. The role establishes infrastructure best practices, reliability, security, scalability, and Infrastructure as Code while supporting recommendation, video classification, and agent workloads. It also involves collaborating with engineers and vendors to deploy, instrument, and manage production systems.
Top Skills: AirflowAlbAmazon BedrockAnthropicAWSC++CloudFormationCloudwatchDagsterDatadogDnsDockerDvcElasticacheElbElkFeastFluentdGitlabGoGrafanaHTTPIamInfluxdbJavaScriptJenkinsKubeflowKubernetesLakefsLinuxLitellmMetaflowMlflowNlbNvidia TritonOpenaiPgvectorPineconePrometheusPythonRagRayRdsRoute 53RubySqsTcp/IpTectonTensorrt-LlmTerraformTgiTickTypescriptVllmVpcWeaviateWeights & Biases
9 Days Ago
Remote
United States
174K-261K Annually
Senior level
174K-261K Annually
Senior level
Artificial Intelligence • Productivity • Software • Automation
Secure Zapier’s production infrastructure by identifying and mitigating risks, hardening cloud environments, improving Terraform and CI/CD security, managing vulnerability and misconfiguration tools, enforcing least-privilege access, strengthening data governance, hardening Kubernetes images, and supporting incident response. The role collaborates with Platform, Engineering, and Security teams in a remote-first environment.
Top Skills: AWSCi/CdCloudFormationDockerGoInfrastructure-As-CodeJavaScriptKubernetesPythonTerraformWiz
15 Days Ago
Easy Apply
Remote
United States
Easy Apply
150K-185K Annually
Senior level
150K-185K Annually
Senior level
Fintech • Insurance • Machine Learning • Analytics • Financial Services • Automation
Designs and evolves AWS infrastructure as code using CDK, develops backend software primarily in TypeScript, and applies secure engineering practices for regulated environments. The role contributes to architecture, code reviews, CI/CD pipelines, production support, observability, and on-call operations. It collaborates cross-functionally, builds scalable and reusable systems, supports SOC 2 compliance, and uses AI coding assistants to improve development, testing, and documentation.
Top Skills: AWSAws CdkC#Ci/CdClaude CodeCursorGitIamRoute53Security GroupsSoc 2TypescriptVpc

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account