Hippocratic AI Logo

Hippocratic AI

Forward Deployed Engineer

Reposted Yesterday
Remote
Hiring Remotely in United States
Mid level
Remote
Hiring Remotely in United States
Mid level
Technical owner for AI deployments building production Python systems with LangChain/LangSmith and advanced LLM techniques (RAG, tool-calling, LLM-as-judge). Integrates with customer systems, sets up secure monitored deployments, monitors production agents, responds to incidents, and collaborates with customers to ensure reliable clinical AI operations.
The summary above was generated by AI
Forward Deployed Engineer (FDE)

The Forward Deployed Engineer is the technical owner for AI deployments. You will be a core contributor to our agentic AI platform. This is a high-ownership role where you work closely with Deployment Strategists and customers, building real production systems that directly impact healthcare operations. You need to be a strong software engineer who enjoys working in customer environments and taking ownership of end-to-end system reliability.

You have expertise in software development in python, experience with frameworks such as langchain and langsmith, deep understanding of LLM techniques such as RAG, LLM as a judge, and MCP/tool calling.

What Success Looks Like
  • AI Innovation: You use your expertise in AI Engineering to solve cutting-edge problems in healthcare-focused conversational AI, applying RAG, tool-calling, and advanced LLM techniques to novel customer challenges

  • Customer Problem-Solving: You identify issues early through close monitoring and proactive communication, often solving problems before they affect clinical operations

  • Reliable AI Systems: You build integrations that connect reliably to customer systems (EHRs, data warehouses, operational tools), handling errors gracefully and monitoring for anomalies

  • Smooth Deployments: You execute deployment plans without surprises—infrastructure is ready, integrations are tested, cutover is planned and executed professionally

  • Production Ownership: You monitor deployed systems, respond quickly to incidents, and drive operational improvements that keep agents running smoothly

  • Technical Partnership: You help customers understand the AI system architecture, debug issues collaboratively, and build their confidence in the solution

Core Responsibilities
  • AI Innovation & Problem-Solving – Identify customer challenges and design AI solutions using advanced LLM techniques (RAG, tool calling, LLM-as-judge); implement novel approaches to healthcare AI problems

  • RAG Pipeline Implementation – Design and implement retrieval-augmented generation pipelines that ground LLM responses in customer data, ensuring accuracy and clinical relevance

  • Tool & MCP Architecture – Implement tool-calling architectures and Model Context Protocol (MCP) connections that enable agents to interact with customer systems safely

  • Python AI Development – Build production Python code using LangChain, LangSmith, and modern AI frameworks to create reliable AI systems

  • Infrastructure & Deployment – Set up secure, monitored production environments; manage deployment and go-live activities

  • Production Monitoring & Support – Monitor deployed systems, respond to incidents, troubleshoot problems with customers, implement fixes

What You BringMust Haves
  • 3-5 years of software engineering experience with strong Python fundamentals and production software development experience

  • Hands-on experience with LLM frameworks (LangChain, LangSmith) and understanding of modern LLM development patterns

  • Deep understanding of LLM techniques: RAG, prompt engineering, tool calling, LLM-as-judge, and related patterns

  • Experience building integrations with APIs, databases, or enterprise systems; comfort with async patterns and error handling

  • Bachelor's degree in Computer Science (or related field) from a top ranked university.

Nice to Haves
  • Experience with Model Context Protocol (MCP) or similar approaches for tool integration

  • Healthcare IT experience (EHR integrations, FHIR, HL7, healthcare data standards)

  • Production DevOps or infrastructure experience; ability to set up monitoring and incident response

  • Experience deploying AI systems or working with LLMs in production environments

Why Hippocratic AI
  • You're innovating in AI-native healthcare. You're not building traditional integrations—you're solving cutting-edge problems in conversational AI for healthcare. Every RAG pipeline you design, every tool-calling pattern you implement, every LLM optimization you discover contributes to healthcare transformation.

  • You work with world-class AI engineers and clinical experts from Google, Meta, Microsoft, NVIDIA, Johns Hopkins, Washington University, Stanford. You'll tackle harder AI problems alongside smarter people. You'll grow your AI expertise faster here than almost anywhere.

  • Backed by $404M from top-tier AI and healthcare investors—CapitalG, a16z, General Catalyst, Kleiner Perkins, plus strategic health system investors. This validates the category and gives you the resources to focus on innovation without runway concerns.

  • This is category creation. You're defining how LLM agents interact with healthcare systems, how RAG grounds clinical AI, how to deploy AI safely at scale. You're not following playbooks—you're writing them..

Ready to Apply?

If you've built production AI systems, thrive at the edge of technical and human complexity, and want your work to matter in the most direct sense possible — we'd like to meet you.

Please be aware of recruitment scams impersonating Hippocratic AI. All recruiting communication will come from @hippocraticai.com email addresses. We will never request payment or sensitive personal information during the hiring process.

Similar Jobs

Yesterday
In-Office or Remote
197K-246K Annually
Entry level
197K-246K Annually
Entry level
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
Build and deploy production backend services, third-party integrations, internal tooling, and voice agents for strategic enterprise customers. Work directly on site with customer technical and business teams, monitoring and optimizing live systems for accuracy, latency, and throughput. Collaborate with research and product teams to extend the platform, provide field feedback, and create reusable solutions. The role involves regular customer-site work, solution scoping, technical problem-solving, and end-to-end ownership of deployed systems.
Top Skills: APIsCloud InfrastructureDockerGoJavaScriptKotlinKubernetesPythonRustSpeech-To-TextText-To-SpeechTypescriptVoice Ai
3 Days Ago
Remote or Hybrid
201K-352K Annually
Expert/Leader
201K-352K Annually
Expert/Leader
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Build and deploy production-grade, LLM-enabled applications for strategic enterprise customers. Own backend services, data orchestration, front-end integrations, APIs, vector databases, and AI pipelines. Work onsite with customers to adapt and iterate solutions, integrate legacy systems, and deliver in agile sprints. Create reusable libraries, prompts, SDKs, scaffolds, and documentation while contributing feedback to platform and product teams. Deploy secure, observable systems using cloud, CI/CD, containers, and infrastructure-as-code practices.
Top Skills: AngularAWSAzureCi/CdContainersDistributed SystemsGoogle Cloud PlatformGraphQLInfrastructure As CodeJavaLangchainLlmsMonitoringNode.jsPrompt ChainingPythonReactRestSemantic KernelVector DatabasesVector Search
4 Days Ago
Remote or Hybrid
United States
106K-179K Annually
Senior level
106K-179K Annually
Senior level
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Leads technical pre-sales and foundational implementation engagements for SailPoint SaaS solutions. Discovers customer requirements, maps them to product capabilities, delivers proof-of-value implementations, explains architecture and best practices, and collaborates with sales, product, services, and customer success teams. Develops AI and agentic technology solutions for demonstrations and customer problems, while serving as a technical and consultative advisor to customers, partners, and colleagues.
Top Skills: Active DirectoryAgentic AiAngularApplication ServersArtificial IntelligenceAWSAzureCassandraClaude CodeCursorDatabasesGithub CopilotGoogle AntigravityGoogle Cloud PlatformJavaJavaScriptJSONKiroLdapLinuxMachine LearningMicrosoft Sql ServerMongoDBMySQLNode.jsOne IdentityOpenai CodexOracleOracle Identity ManagerPeoplesoftPowershellPythonReactRedisRsa AveksaSaas ArchitectureSailpointSAPSaviyntServicenowSQLSybaseTypescriptUnixVirtualizationWeb ServicesWindowsXML

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account