MLabs Logo

MLabs

Staff Software Engineer - Backend & AI Infra

Reposted 22 Days Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
Lead design and implementation of high-performance agent runtimes, backend services, and self-hosted model/agent infrastructure. Build low-latency execution systems, real-time data pipelines, telemetry loops, CI/CD for zero-downtime deployments, and ensure fleet reliability on AWS/EKS.
The summary above was generated by AI

Staff Software Engineer - Backend & AI Infra

Remote | Full-time
Location:
Based in US to GMT timezones

Compensation: Competitive Compensation Package

Our client is a high-growth technology firm. They are seeking a Staff Software Engineer to spearhead two critical domains: the core agent runtime and backend infrastructure powering a high-frequency trading fleet, and the comprehensive migration of model hosting and agent deployment to in-house, proprietary infrastructure.

This is a foundational, high-impact building role. The successful candidate will design and implement the backend services, runtime engines, and deployment systems that enable a fleet of autonomous agents to operate with superior speed, reliability, and intelligence. By moving away from third-party LLM providers and hosted platforms, this role will establish the sovereign infrastructure necessary for the next generation of autonomous financial software.

Key Responsibilities

Agent Runtime & Backend Development

  • Plugin Runtime Ownership: Lead the evolution of the per-agent process, migrating from a distributed Go/Python hybrid to a centralized, high-performance Go service utilizing Postgres state and real-time websocket price feeds.
  • Rules Engine Engineering: Build a YAML-configurable "Scanner Gateway" to bridge signal production and execution, allowing for complex scoring and filtering without direct code manipulation.
  • Advanced Execution Systems: Develop and maintain the RatchetStop Backend, a centralized profit-trailing service capable of sub-second evaluation and websocket-based order execution to protect capital even when agents are offline.
  • Data & Connectivity: Manage the Model Context Protocol (MCP) server bridging agents to platform tools, and oversee a high-throughput data pipeline (Redis, Postgres, ClickHouse) for real-time market intelligence ingestion.

Model & Agent Hosting Migration

  • Infrastructure Sovereignty: Lead the technical execution of migrating agents from third-party platforms to a custom-built, Senpi-hosted environment featuring isolated workspaces and state persistence.
  • Model Serving: Evaluate and implement the transition from external LLM APIs (Anthropic, Google) to self-hosted inference, optimizing for telemetry capture and performance.
  • Telemetry & Feedback Loops: Architect systems to capture every agent decision and score, creating a self-reinforcing loop where the fleet learns and improves from collective performance data.
  • Deployment Pipelines: Build robust CI/CD pipelines for zero-downtime rollouts, ensuring that updates to scanner logic or runtime patches do not interrupt active market positions.

Infrastructure & Operations

  • System Reliability: Design monitoring and alerting frameworks to detect agent failures, state corruption, or authentication expirations before they impact financial performance.
  • Cloud Orchestration: Manage AWS/EKS environments using Infrastructure-as-Code (IaC).
  • Incident Response: Own the operational health of the fleet, acting as the primary responder for high-stakes trading system incidents.

IInterview Process

  1. Founder / CEO Interview: Introduction to the vision and strategic goals.
  2. Take-Home Test: A practical assessment of technical design and coding capabilities.
  3. Technical Interview: A deep dive into systems architecture and engineering expertise.
  4. Final Interview: Cultural alignment and final technical synthesis.

Requirements
  • Technical Essentials
    • Expert Backend Engineering: Proficiency in writing production-grade code in Go, Python, and Node.js/TypeScript (Go is strongly preferred for runtime services).
    • Startup Experience: A proven track record of building complex backend services (APIs, job scheduling, distributed systems) from scratch in a fast-paced environment.
    • Real-Time Systems: Deep understanding of low-latency environments, websocket management, and sub-second condition evaluation.
    • Database Mastery: Production experience with Postgres, Redis, and at least one analytical database (e.g., ClickHouse, TimescaleDB, or BigQuery).
    • Orchestration: Hands-on experience deploying, scaling, and debugging production workloads on Kubernetes (AWS EKS).
    • End-to-End Ownership: Demonstrated ability to design, build, deploy, and maintain systems throughout their entire lifecycle.
  • Preferred Qualifications
    • LLM Infrastructure: Experience with model serving and optimizing inference (e.g., vLLM, TGI, or TensorRT-LLM).
    • FinTech/Trading: Background in exchange APIs, wallet operations, or on-chain infrastructure where uptime has direct financial consequences.
    • Agentic Frameworks: Familiarity with Model Context Protocol (MCP) or orchestrating multi-agent platforms.

Benefits
    • Competitive compensation and equity packages.
    • The opportunity to build foundational infrastructure in a new category of autonomous software.
    • High-autonomy environment with a focus on engineering excellence.
    • Collaborative culture working alongside industry-leading founders and engineers.

Due to the high volume of applications we anticipate, we regret that we are unable to provide individual feedback to all candidates. If you do not hear back from us within 4 weeks of your application, please assume that you have not been successful on this occasion. We genuinely appreciate your interest and wish you the best in your job search.

Commitment to Equality and Accessibility:

At MLabs, we are committed to offer equal opportunities to all candidates. We ensure no discrimination, accessible job adverts, and providing information in accessible formats. Our goal is to foster a diverse, inclusive workplace with equal opportunities for all. If you need any reasonable adjustments during any part of the hiring process or you would like to see the job-advert in an accessible format please let us know at the earliest opportunity by emailing [email protected].

MLabs Ltd collects and processes the personal information you provide such as your contact details, work history, resume, and other relevant data for recruitment purposes only. This information is managed securely in accordance with MLabs Ltd’s Privacy Policy and Information Security Policy, and in compliance with applicable data protection laws. Your data may be shared only with clients and trusted partners where necessary for recruitment purposes. You may request the deletion of your data or withdraw your consent at any time by contacting [email protected].

Similar Jobs

4 Hours Ago
Remote or Hybrid
45K-85K Annually
Junior
45K-85K Annually
Junior
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Handle inbound calls and warm leads, consult customers on insurance needs, recommend appropriate Property and Casualty products and coverages, and convert prospects into policyholders. Complete paid licensing and sales training, represent the Liberty Mutual brand, communicate persuasively, and maintain customer-focused service. The role requires a prescribed schedule, state residency, professional home workspace, reliable wired high-speed internet, and eventual Property and Casualty licensing.
Top Skills: Cable/Fiber/Dsl InternetHigh-Speed InternetPc
5 Hours Ago
Remote or Hybrid
United States
60K-81K Annually
Mid level
60K-81K Annually
Mid level
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Partner with skilled nursing and long-term care clients to assess and improve revenue cycle operations—admissions, payer authorization, MDS/PDPM reimbursement, billing, collections, and denials. Lead client engagements, recommend process and system improvements using EHR and billing data, manage project execution, deliver training, and support change management to optimize reimbursement and financial performance.
Top Skills: Billing SystemsElectronic Health Record (Ehr)Revenue Cycle Management Systems
5 Hours Ago
Remote or Hybrid
United States
107K-144K Annually
Mid level
107K-144K Annually
Mid level
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Own and prioritize the Workday/ERP product backlog, translate business needs into epics and user stories, partner with Finance and business leaders, support Agile delivery and releases, manage integrations and reporting, ensure compliance and security, and drive continuous improvement and adoption across Workday modules.
Top Skills: AgileWorkday FinancialsWorkday IntegrationsWorkday PsaWorkday Release ManagementWorkday Reporting

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account