Salvo Software Logo

Salvo Software

Senior MLOps Engineer

Posted 6 Days Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
Designs and operates MLOps infrastructure for production machine learning and LLM systems across cloud, on-premises, and air-gapped environments. Builds training, deployment, CI/CD, inference, monitoring, and infrastructure-as-code workflows; manages containerized workloads, Linux servers, networking, security, GPUs, and observability. Establishes platform standards, guides AI and RAG engineers, troubleshoots incidents, and ensures scalable, secure, reliable, and cost-effective AI deployments.
The summary above was generated by AI

Salvo Software is a global technology company specializing in custom software development and advanced engineering solutions. With distributed teams across the US, LATAM, and India, we partner with clients to build high-performance, scalable systems that solve complex technical challenges. Our culture values innovation, ownership, and engineering excellence. We’re growing our AI department and are looking for a Senior MLOps Engineer to build the platform that takes our models and LLM systems reliably into production.

Role Overview
We are looking for a Senior MLOps Engineer to design, build, and own the infrastructure and workflows behind our machine learning and LLM-powered systems. Your core work will be creating a reliable path from experimentation to production: training and fine-tuning pipelines, model registries, automated deployment, scalable inference, and monitoring for models running in cloud, on-prem, and air-gapped environments.

This is a senior, hands-on role. You’ll define MLOps standards and platform architecture, make key decisions on reliability, scalability, and cost, and provide technical guidance to AI Developers and RAG Engineers on the team. You’ll work closely with engineering, product, and client stakeholders to make sure AI features are reproducible, observable, secure, and ready to scale.

Key Responsibilities

MLOps Platform & Engineering (core focus)

  • Design, deploy, and operate MLOps platform infrastructure, cloud services (AWS, Azure, GCP), and LLM inference pipelines (Ollama, vLLM).
  • Build automated CI/CD pipelines, IaC, and monitoring/alerting systems to support RAG applications, AI agents, and production deployments.
  • Manage Linux servers, networking, security endpoints, and troubleshoot production issues alongside AI engineering teams.

Technical Leadership

  • Establish department-wide MLOps/DevOps standards, best practices, and reusable infrastructure templates.
  • Partner with AI Developers and RAG Engineers to guide architecture, deployment strategies, tool selection, and production readiness.
  • Translate feature requirements into reliable, secure, cost-effective infrastructure and maintain comprehensive system documentation.

Infrastructure & Operations

  • Provision containerized workloads, Linux servers, and infrastructure using IaC (Terraform, Ansible) across cloud and on-prem environments.
  • Manage CI/CD (GitHub Actions, Azure DevOps), observability tools (Prometheus, Grafana), secure networking, and GPU-enabled hardware.
  • Troubleshoot platform incidents, perform root cause analysis, and maintain operational resilience.

Requirements
  • 5+ years of senior-level experience in DevOps/SRE/platform engineering with at least 1 year deploying ML models and LLM inference engines (Ollama, vLLM) in production.
  • Proficiency with Linux, Docker, Kubernetes, virtualization (Proxmox, VMware), GPU infrastructure (CUDA/NVIDIA), and major cloud platforms (AWS, Azure, GCP).
  • Hands-on expertise with Infrastructure as Code (Terraform, Ansible), CI/CD platforms (GitHub Actions, Azure DevOps), Bash, and Python scripting.
  • Solid background in core networking (DNS, TLS, firewalls, VPNs), monitoring/logging, and security/authentication (OAuth2/OIDC, API gateways, Zero Trust/SOC 2).
  • Familiarity with ML tooling (MLflow, Kubeflow), vector DBs, RAG/agent frameworks (MCP), workflow orchestration (Airflow/Kafka), and model optimization/quantization.

Similar Jobs

Senior level
HR Tech • Information Technology • Professional Services
Own production ML data pipelines from raw sources through feature and training tables using Spark and Databricks. Onboard internal, external, partner, and web data; integrate LLM processing; maintain training-serving consistency; and monitor data quality, drift, and anomalies. Deploy reliable, cost-efficient pipelines through GitHub Actions, Docker, and AWS. Review AI-generated code for correctness, edge cases, and data integrity while collaborating across backend and ML platform systems.
Top Skills: AirflowAmazon S3SparkAWSDatabricksDatabricks WorkflowsDbtDockerFeature StoresGithub ActionsGrafanaIamJavaKafkaLlmsMlflowPandasPyarrowPythonScalaSnowflakeSpark Structured StreamingSQLTerraform
2 Months Ago
In-Office or Remote
California, USA
152K-230K Annually
Senior level
152K-230K Annually
Senior level
Software • Travel
Build and maintain internal platforms and tooling for AI engineers, including React and Next.js dashboards, Python backend services, REST APIs, model deployment automation, observability integrations, and ML pipeline testing. Partner with engineering and ML teams to improve developer experience, production AI reliability, and self-service workflows while documenting systems and runbooks.
Top Skills: AWSAzureDatabasesDatadogDockerGCPGrafanaInfrastructure As Code (Iac)Job Queuing SystemsKubernetesLangsmithNext.JsPrometheusPythonReactRest ApisTypescript
3 Months Ago
Remote
United States
143K-197K Annually
Senior level
143K-197K Annually
Senior level
Healthtech • HR Tech
Build and maintain ML and generative AI tooling, training and inference platform services, model evaluation and testing frameworks, and APIs to expose ML products. Deploy and manage applications across the AI/ML SDLC, mentor teammates, and write production-quality code daily.
Top Skills: AWSCeleryDockerGenerative AiJavaKotlinKubernetesLow-Latency DatabasesMachine LearningProtobufPythonRagRelational DatabasesRestful ApisVector Databases

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account