Rescale Logo

Rescale

Software Engineer, Agentic AI Systems

Posted 8 Hours Ago
Remote
Hiring Remotely in United States
115K-159K Annually
Mid level
Remote
Hiring Remotely in United States
115K-159K Annually
Mid level
Build and operate production AI systems, including LLM-backed APIs, agents, retrieval and RAG workflows, evaluation systems, ingestion pipelines, and data services. Develop reliable data paths connecting customer environments, cloud storage, and compute clusters. Partner with Product and Design to define requirements, make architectural decisions, ship platform improvements, and own post-launch performance across backend services, cloud infrastructure, and occasional UI work.
The summary above was generated by AI

Rescale is pioneering the future of engineering and scientific discovery. As the leader in digital engineering, we’re transforming how products are developed—through intelligent automation, applied AI, data management, and the integration of the world’s largest network of engineering and R&D applications. Joining Rescale means becoming part of a diverse, collaborative, and mission-driven team that’s unlocking faster innovation across industries like aerospace, energy, life sciences, and manufacturing. We’re solving complex challenges that traditional HPC can’t—and we’re seeking passionate, curious minds to help build the next wave of breakthroughs.

We’re hiring a product-focused Software Engineer, AI Systems to build Rescale’s Data Intelligence and Agentic AI platforms within our infrastructure organization. The work spans production agents, retrieval, evals, ingestion pipelines, and the data services connecting customer environments, cloud storage, and compute clusters.

Projects often start as broad goals. You’ll partner with Product to identify the customer problem, sharpen the spec, and decide what to ship first. You’ll own the technical design and delivery of a meaningful part of the platform. You’ll use Rescale’s product yourself, find friction in the full workflow, and keep improving what you launch.

What you’ll do:

  • Build and operate LLM-backed APIs, agents, retrieval systems, and integrations with internal and external systems.

  • Develop evals for agent and RAG workflows, then use the results to improve quality and reliability.

  • Build ingestion pipelines and high-throughput file and data paths between customer environments, cloud object storage, and compute clusters, balancing reliability, performance, and cost.

  • Work with Product and Design to turn broad goals into clear problems, practical specs, and small releases.

  • Spot worthwhile improvements, bring the right people into the decision, ship frequently, and follow through on the result.

  • Work across backend services (Python, Java, Go), cloud infrastructure (AWS, Azure, GCP, containers/Kubernetes), and occasional UI changes (React and TypeScript) to complete the customer experience.

What we’re looking for:

  • 3–5 years of experience building and operating backend services and distributed systems in AWS, Azure, or GCP.

  • Production experience with agentic AI, retrieval-augmented generation (RAG), and evals. You can explain how your evaluations led to changes in a shipped system.

  • Strong experience in at least one of Python, Java, or Go, with comfort working across services and APIs.

  • Experience with data-intensive systems such as object storage, relational databases, caches, and queues or streams.

  • Effective use of AI coding agents in your development work, including the judgment to verify their output. You follow new AI engineering practices and test ideas that could improve how the team builds.

  • The ability to turn an ambiguous goal into a plan with Product, make sound architectural decisions for your area, and take responsibility for how the work performs after launch.

  • A BS in Computer Science or equivalent experience.

Diversity, equity, inclusion and belonging are fundamental to our success. We strive to be a workplace where we:

  • Welcome ALL and ALL are welcome.

  • Show up with our whole selves or whichever parts of ourselves we’re comfortable sharing, and be ready to see the same in others.

  • Be ready to learn, unlearn, and learn again.

  • Respect others and their opinions. We practice empathy in the way we interact with each other and celebrate uniqueness as a team.

  • Seek to understand - ask more questions than one makes statements.

  • Provide safety from judgment and preserve a collaborative environment.


Rescale is an equal opportunities employer and welcomes applications from all qualified persons regardless of their race, sex, disability, religion/belief, sexual orientation or age. As part of our standard hiring process for new employees, employment with Rescale will be contingent upon successful completion of a comprehensive background check. Here at Rescale, we are committed to being transparent in our policies around candidate privacy. For more details on the information Rescale collects in your application, please view the Rescale Applicant Privacy Policy here.

Similar Jobs

11 Minutes Ago
Easy Apply
Remote or Hybrid
Easy Apply
152K-190K Annually
Junior
152K-190K Annually
Junior
Cloud • Information Technology • Security • Software • Cybersecurity
Design, train, fine-tune, optimize, and deploy large-scale machine learning systems for cloud security use cases. Build end-to-end ML pipelines, develop transformer and embedding models, productionize open-weight language models, and optimize inference for latency, cost, and quality. Architect resilient ML services across AWS and GCP using cloud-native microservices while collaborating with engineering teams on AI strategy and solving complex problems involving massive datasets.
Top Skills: AWSDeep LearningGCPHugging FaceJaxLarge Language ModelsLoraMicroservicesOnnx RuntimePeftPythonPyTorchQloraTensorFlowTensorrt-LlmTransformer ModelsVllm
12 Minutes Ago
Remote
USA
152K-175K Annually
Senior level
152K-175K Annually
Senior level
Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)
Secure Runpod’s multitenant GPU cloud infrastructure across bare-metal and virtualized environments. Responsibilities include designing workload and network isolation, hardening Linux kernels and container platforms, testing hypervisor and hardware security, developing low-level controls in C, Go, or Rust, securing GPU and PCIe interactions, and responding to infrastructure security incidents with forensic capabilities for ephemeral containers.
Top Skills: ApparmorBare-Metal Cloud InfrastructureCC.V.E.SCgroupsContainerdDockerEbpfGoGpu ArchitectureKubernetesKvmLinuxLinux KernelNamespacesPciePythonQemuRustSelinuxVirtualized Networking
13 Minutes Ago
Remote or Hybrid
153K-261K Annually
Entry level
153K-261K Annually
Entry level
Aerospace • Hardware • Information Technology • Security • Software • Cybersecurity • Defense
Leads business development for BAE Systems’ Advanced Mission Solutions portfolio, shaping domestic and international growth strategies, identifying and qualifying opportunities, and developing customer engagement and campaign plans. Builds relationships with defense customers, industry partners, and internal teams; translates mission needs into product and technical roadmaps; supports capture, pricing, market analysis, compliance, and business-winning activities. Requires F-16 customer relationships, fighter aircraft knowledge, government contracting expertise, and approximately 50% international travel.
Top Skills: C4IsrDirect Commercial Sales (Dcs)F-16F-35Foreign Military Sales (Fms)

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account