BJAK Logo

BJAK

Machine Learning Platform Engineer

Posted One Month Ago
Remote
Hiring Remotely in United States
Mid level
Remote
Hiring Remotely in United States
Mid level
Design, build, and operate ML infrastructure for training, evaluation, deployment, and inference. Improve reliability, scalability, latency, throughput, and cost. Create pipelines, observability, benchmarking, and tooling to enable fast experimentation and productionization of models while diagnosing regressions and bottlenecks.
The summary above was generated by AI

About ActAI

There are over 5 billion users using basic applications today such email, notes, tasks, calendar and they're not AI-native. Our mission is to build proactive applications for anyone in the world, who are not used to complex prompting. We aim to bring intelligence to conversations, errands, organising and workflows, with minimal to no prompting.

Our product focuses on achieving high reliability for long-running workflows, persistent context, and real-world task completion. We believe products will greatly reduce hallucinations.

Our objective is to organise anyone's life, allowing us all to spend time on valuable and meaningful things.

About the Role

As an ML Platform Engineer, you will build the infrastructure and systems that power ActAI's AI capabilities.

You will design and operate the systems behind the AI stack, from model training and evaluation to deployment, inference, observability, and continuous improvement.

You will work closely with AI engineers, researchers, and product engineers to turn models into reliable, scalable, and cost-efficient production systems. You will build the platforms, tooling, and infrastructure that enable the team to experiment quickly and bring AI capabilities to production with confidence.

Focus

  • Build and operate the ML infrastructure and platforms powering A1’s AI products

  • Design systems for model training, evaluation, deployment, inference, and experimentation

  • Build and optimise model serving and inference infrastructure for high-throughput and low-latency workloads

  • Improve reliability, scalability, latency, and cost efficiency of AI systems

  • Develop reliable pipelines for data preparation, training, evaluation, model release, and continuous improvement

  • Build platforms and tooling that enable AI engineers and researchers to experiment, evaluate, and ship models faster

  • Develop evaluation and benchmarking infrastructure to measure model quality, performance, and regressions

  • Build production observability, monitoring, tracing, and alerting for AI/ML workloads

  • Improve AI systems across reliability, scalability, latency, throughput, and cost

  • Identify bottlenecks across the ML stack and continuously improve system performance

  • Work closely with AI engineers, researchers, and product teams to turn evolving model requirements into production-ready infrastructure

Tech Stack

  • Python

  • PyTorch / JAX

  • LLM and ML serving infrastructure such as vLLM, SGLang, or TensorRT-LLM

  • Cloud infrastructure

  • Distributed systems

  • ML/data pipelines and workflow orchestration

  • GPU infrastructure and performance tooling

  • Vector databases and retrieval infrastructure

Ideal Experience

  • Strong software engineering fundamentals and experience building production systems

  • Experience building ML infrastructure, platforms, or production machine learning systems

  • Experience with model deployment, inference, evaluation, or data pipelines

  • Strong understanding of distributed systems and system reliability

  • Ability to write clean, maintainable, production-quality code

  • Comfortable working in ambiguous, fast-moving environments

  • Bias toward ownership, experimentation, and continuous improvement

Outcomes

  • AI infrastructure reliably supports production workloads at scale

  • Models can be trained, evaluated, deployed, and improved efficiently

  • Inference systems deliver strong latency, throughput, reliability, and cost efficiency

  • ML pipelines are reproducible, observable, maintainable, and robust

  • Model and infrastructure regressions are detected quickly and diagnosed efficiently

  • Common ML infrastructure capabilities become reusable platform primitives rather than being rebuilt for every AI product

  • The AI stack can evolve rapidly as new models, architectures, and inference techniques emerge

Similar Jobs

16 Days Ago
In-Office or Remote
165K-282K Annually
Expert/Leader
165K-282K Annually
Expert/Leader
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Own the architecture and long-term evolution of hybrid, multi-tenant AI compute platforms across bare-metal OpenShift and public-cloud services. Define distributed training networking, GPU utilization and cost models, GitOps governance, model-serving standards, workload placement, identity and security controls, SLOs, disaster recovery, and platform upgrade strategies. Partner with AI, privacy, and security teams to deliver HIPAA-compliant infrastructure for training and inference workloads.
Top Skills: Argo CdAws BedrockAzure Ai FoundryCephDcgmDeepspeedFsdpGcp Vertex AiGitopsGpudirect RdmaHipaaIbm Storage ScaleInfinibandJaxKserveKubeflow PipelinesKubernetesKueueLustreMigMtlsNcclNfdNvidia Gpu OperatorNvidia GpusNvlinkOauthOdfOidcOpenshift AiPytorch DdpRayRbacRed Hat OpenshiftRhacmRocev2Tensorrt-LlmVastVaultVllmVolcanoWeka
18 Days Ago
In-Office or Remote
226K-356K Annually
Senior level
226K-356K Annually
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead the technical direction for Atlassian’s Search Serving platform, building globally scalable, low-latency agentic search systems. Own architecture for retrieval, indexing, query processing, and ML inference while improving quality, reliability, scalability, operability, and cost. Establish production ML practices for evaluation, experimentation, observability, rollouts, and incident response. Optimize inference for embedding, retrieval, and ranking models, and lead cross-team initiatives while mentoring senior engineers and aligning technical leaders.
Top Skills: CachingDistillationDistributed SystemsEmbedding ModelsHybrid RetrievalInformation RetrievalMachine LearningMl InferenceModel OptimizationQuantizationRanking ModelsSearch InfrastructureSemantic SearchShardingVector Search
Yesterday
In-Office or Remote
Chicago, IL, USA
Senior level
Senior level
AdTech • Big Data • Marketing Tech • Mobile • Grocery & Supermarkets • Consumer Packaged Goods (CPG)
Build and improve machine learning systems for ad ranking, relevance, personalization, and optimization. Responsibilities include feature pipelines, model training and evaluation, active learning, LLM-assisted labeling and synthetic data generation, experimentation, and low-latency production inference. The role partners with product, data, and platform teams to improve advertiser performance and user engagement while maintaining reliability, latency, and data quality.
Top Skills: AWSAws BedrockChatgptClaudeGithub CopilotGoLangchainLlmsPythonVector Databases

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account