Insight Softmax Consulting LLC Logo

Insight Softmax Consulting LLC

Kubernetes Platform Engineer

Posted 5 Days Ago
In-Office or Remote
Hiring Remotely in San Francisco, CA
Senior level
In-Office or Remote
Hiring Remotely in San Francisco, CA
Senior level
Design, deploy, and operate multi-tenant Kubernetes platforms for GPU and HPC workloads across bare metal, cloud, edge, and air-gapped environments. Build cluster lifecycle automation, infrastructure as code, CI/CD, identity and security controls, and enterprise-hardened platforms. Support managed-service customers through monitoring, incident response, patching, on-call rotations, and runbooks. Collaborate with customer teams on approvals and security processes, while contributing to pre-sales, internal platform development, and mentoring.
The summary above was generated by AI

Insight Softmax is a leading organization in the fields of machine learning, data science, and high-performance computing (HPC). We are dedicated to providing innovative solutions in computing technology to solve complex problems in various sectors including research, science, manufacturing, finance, and data analytics.

Description:

  • We are hiring a Kubernetes Platform Engineer for our engineering team. You will design, build and operate multi-tenant Kubernetes platforms for GPU and HPC workloads, and the automation, identity and security layers around them.
  • Our customers include a Kubernetes platform vendor who has us build and deliver their product, enterprises and telcos deploying GPU clusters inside strict security perimeters, and neoclouds standing up multi-tenant capacity at scale.
  • Much of this work happens inside large-enterprise security and compliance processes. You need to be comfortable getting things done in those environments: understanding why the controls exist, designing within them, and knowing when and how to push for an exception.
  • This is a platform engineering role, not IT administration. You write code, build automation, and leave behind systems that run without you.
  • Our team requires individuals with focus on delivery and results, hunger to learn, ability to adapt, and can thrive in a self-directed environment where you’ll figure out what’s needed to deliver rather than wait for detailed instructions

Key Responsibilities:

  • Design, deploy and operate Kubernetes clusters on bare metal, cloud and edge, including multi-tenant and air-gapped deployments.
  • Build cluster lifecycle automation: bare metal provisioning, immutable node images, cluster profiles and packages, upgrades and fleet management.
  • Operate GPU workloads on Kubernetes: device plugins, Dynamic Resource Allocation, GPU partitioning, node tuning, high-speed networking and storage.
  • Build and maintain infrastructure as code and CI/CD pipelines (Terraform, Ansible, GitLab or GitHub, Helm, GitOps).
  • Implement identity and access: SSO and SAML, OIDC, Entra ID, Okta, AWS Organizations and IAM, role-based access across clusters and cloud accounts.
  • Harden platforms for enterprise and sovereign environments: network policy, secrets management, image signing and scanning, FIPS, audit logging, compliance evidence.
  • Own day-2 operations for managed service customers: monitoring, alerting, on-call rotations, patching, incident response and runbooks.
  • Work with customer security, network and platform teams to get access, approvals and changes through their processes.
  • Reserve time each week for pre-sales support, internal platform work and mentoring.

Qualifications:

  • At least 5 years in platform, DevOps or SRE roles, with at least 3 years running production Kubernetes you built yourself.
  • Deep Kubernetes knowledge: networking (CNI, Gateway API, service mesh), storage (CSI), scheduling, operators, multi-cluster management.
  • Strong linux chops, including networking, systemd, kernel and driver level troubleshooting.
  • Robust infrastructure as code and CI/CD experience with Terraform, Ansible and a GitOps toolchain.
  • Hands-on experience with enterprise identity and security: SSO, SAML and OIDC, IAM design, secrets management, network segmentation, security review processes.
  • Deep knowledge of at least one of AWS, GCP, or Azure. Preferably AWS.
  • Experience running on-call and incident response for production platforms.
  • Proficient in Python, Go or a similar language for automation and tooling.

Optional Experience and Skills:

  • Spectro Cloud Palette, PaletteAI and VerteX, or comparable cluster management platforms (Rancher, OpenShift, Cluster API).
  • Bare metal provisioning with MAAS, Ironic, PXE or BCM, and immutable OS images such as Kairos.
  • GPU operators, NVIDIA and AMD device plugins, RDMA and InfiniBand on Kubernetes.
  • Air-gapped or sovereign deployments, FIPS 140-3, DISA STIG or similar hardening.
  • Multi-tenancy design: namespaces, virtual clusters, quotas, chargeback.
  • Security tooling such as Vault, cert-manager, OPA or Kyverno, Falco, Trivy or Cosign.
  • Telco or large enterprise experience.

Bonus Experience and Skills:

  • Slurm or other batch schedulers alongside Kubernetes.
  • AWS Outposts or other hybrid cloud hardware.
  • Observability stacks: Prometheus, Grafana, OpenTelemetry, PagerDuty.
  • Rust.
  • Using linux as your primary desktop workstation environment.

Attributes that we value:

  • Transparency
  • Grit
  • Effectiveness
  • Willingness to learn

Location and Hours:

  • Full time position
  • Remote work environment
  • 80% of your work schedule will be during the business time zones for Latin America and Canada.
  • Some customer meetings will occur each week at non-standard / nighttime hours, as we currently support a global team across 3-4 continents.
  • Some customer engagements include on-site work at US customer sites, typically for workshops, platform bring-up and go-live. Expect occasional US travel.
  • Participation in an on-call rotation for managed service customers.

References:

  • 3 references will be required.

Notes:

  • AI systems may be used with the recruitment and screening processes for this job requisition.

Similar Jobs

16 Days Ago
Remote or Hybrid
USA
140K-220K Annually
Senior level
140K-220K Annually
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Design, operate, and improve highly scalable hybrid multi-cloud Kubernetes platforms supporting business-critical systems. Responsibilities include optimizing reliability, managing large-scale infrastructure, integrating open-source technologies, guiding Kubernetes platform evolution, and mentoring engineers. The role requires expertise with Kubernetes clusters containing thousands of nodes, observability tools, Golang, Linux, AWS, GCP, OCI, custom data centers, and on-call operations. Candidates must be eligible for CJIS clearance and periodically complete government-required background and fingerprint checks.
Top Skills: Ai TechnologiesAlertmanagerAWSGCPGoGrafanaKubernetesKubernetes OperatorsLinuxOciPrometheusThanos
Senior level
Artificial Intelligence • Cloud • Machine Learning
Design, automate, secure, and operate Kubernetes platforms for a DoD environment. Responsibilities include infrastructure as code, GitOps and CI/CD, Kubernetes networking and RBAC, service mesh, cloud integrations, platform troubleshooting, and reliability improvements. Senior engineers also guide technical decisions and mentor others while remaining hands-on.
Top Skills: Admission ControllersAnsibleAws/EksAzure/AksCi/CdControllersCrdsGcp/GkeGitopsHelmIstioKubernetesKubernetes OperatorsLinuxOciRbacTerraform
3 Months Ago
Remote
USA
Senior level
Senior level
Artificial Intelligence • Cloud • Software
Design and manage Kubernetes control plane architecture while ensuring platform reliability across regions. Troubleshoot incidents, scale deployments, and collaborate with teams for optimal infrastructure performance.
Top Skills: CiliumGrafanaKubernetesLinux SystemsPrometheus

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account