TinyFish Logo

TinyFish

MLOps Engineer

Reposted 6 Days Ago
Remote or Hybrid
Hiring Remotely in United States
Senior level
Remote or Hybrid
Hiring Remotely in United States
Senior level
Build and maintain reproducible data pipelines, experiment orchestration, CI/CD for models, Terraform-based ML infrastructure, observability, security controls, and automation to deploy and operate ML systems in production.
The summary above was generated by AI
Position Overview

As the first dedicated ML Ops Engineer, you’ll own the tooling and infrastructure that make our ml engineers wildly productive and ensure we are able to efficiently iterate on ML models, prompts, and datasets and deploy our AI systems into a predictable production environment. You’ll bridge the gap between research and DevOps—designing reproducible dataset pipelines, automated experiment workflows, and Terraform-based cloud deployments that scale.

Key Responsibilities

Dataset Management

• Design version-controlled data pipelines (feature stores, data registries) using tools such as Delta Lake, Apache Iceberg
• Implement systems for data validation, lineage tracking, and automated quality checks (e.g., Great Expectations).

Experiment Execution & Tracking

• Build and maintain experiment orchestration with platforms like MLflow, torchx, and Apache Airflow.
• Provide templated systems and tools to ML Engineers that easily launch training/evaluation data processing systems
• Automate hyper-parameter sweeps and A/B tests, exposing clear dashboards for results.

CI/CD

Models/Agents

• workflows that package, test, and promote models and agents through staging to production.
• Implement canary deployments and rollbacks for models/agents services

Terraform Infrastructure-as-Code

• Author and maintain Terraform modules for all ML infra—networking, GPU/TPU clusters, object storage, secrets, monitoring.
• Enforce best practices for state management, workspaces, and automated plan/apply stages via CI.

Observability & Reliability

• Integrate logging, tracing, and metric collection (Prometheus, Grafana, Datadog) across data pipelines and model endpoints.
• Set SLIs/SLOs for data freshness and model latency; implement alerts and runbooks.

Security & Compliance• Work with Security to implement IAM least-privilege, key rotation, and data-encryption policies.
• Support audit requirements (SOC 2, GDPR, HIPAA where applicable).

Minimum Qualifications
  • 5+ years combined experience in DevOps, Data Engineering, or ML Ops roles.

  • Strong Terraform skills; ability to craft reusable modules and navigate complex state.

  • Production experience with at least one cloud provider (AWS, GCP, or Azure).

  • Proficiency in Python and containerization (Docker); familiarity with Kubernetes or serverless batch systems.

  • Hands-on knowledge of ML experiment platforms (MLflow, Kubeflow, Weights & Biases, or similar).

  • Experience with workflow execution frameworks (Kubeflow, Apache Airflow)

  • Understanding of modern data-versioning/feature-store concepts and tools.

  • Solid grasp of CI/CD principles, Git workflows, and infrastructure testing.

  • Excellent communication skills—capable of partnering with Data Scientists, Software Engineers, and Security teams.

Preferred (Nice-to-Have)
  • Experience with GPU orchestration (NVIDIA DGX, Karpenter, or Ray).

  • Familiarity with IaC security scanning (Checkov, tfsec).

  • Exposure to policy-as-code (OPA/Gatekeeper).

  • Prior work in real-time streaming (Kafka, Flink) and online feature serving.

  • Contributions to open-source ML Ops projects.

Reporting Structure

Reports to: Director of Infra

Similar Jobs

16 Hours Ago
Remote
United States
175K-220K Annually
Senior level
175K-220K Annually
Senior level
Fintech • Financial Services
Design, build, and operate a low-latency online feature store and supporting batch/streaming pipelines. Optimize Postgres schemas and real-time serving for ML models, improve scalability, reliability, and observability, mentor junior engineers, and partner with data science, analytics, product, and application teams to deliver production-grade MLOps solutions.
Top Skills: AirflowDbtFeastFeature StoreMlflowMlopsPostgresPythonReal-Time InferenceSagemaker Feature StoreTecton
6 Days Ago
Remote
Georgia, USA
Senior level
Senior level
Information Technology • Software • Consulting
Design, build, and operate cloud-native MLOps platforms using Databricks and AWS. Implement IaC, scalable data pipelines, model serving and lifecycle management, integrate LLMs and RAG architectures, and drive observability, cost-efficiency, and reliability for production ML workloads while collaborating with AI and data engineering teams.
Top Skills: AWSAws BedrockAws CdkCi/CdCloudFormationDatabricksDockerDspyEcsLlmsMlflowModel ServingOpensearchPythonRagTypescriptVector Databases
9 Hours Ago
Remote
United States
Internship
Internship
Artificial Intelligence • Cloud • Information Technology • Consulting
Build and maintain MLOps infrastructure: CI/CD for models, monitoring, deployment into a NestJS monolith, feature store/versioning, retraining workflows, A/B experimentation, and LLM operationalization.
Top Skills: BashDockerEltETLFeature StoreKubeflowLangchainLlamaindexLlmMakefileMlflowNestjsNode.jsPythonSagemakerTerraformTypescript

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account