UpDoc Logo

UpDoc

Senior Software Engineer, AI

Posted One Month Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
Lead development of a patient-facing conversational AI agent for chronic disease management. Build scalable, low-latency voice and multimodal systems, engineer prompts, define evaluation metrics, develop fine-tuning data pipelines, deploy AI models and APIs, assess emerging LLM technologies, and collaborate with clinical experts to validate medical accuracy. Develop backend services using FastAPI and Pydantic while supporting secure, reliable medical AI infrastructure.
The summary above was generated by AI

About UpDoc

At UpDoc, we are building the first clinically validated, physician-supervised AI agent that manages chronic diseases. We are an early-stage startup founded by Stanford physicians.

We are seeking a talented and motivated senior engineer to join our team. You will primarily work on UpDoc’s patient-facing conversational agent. This is a fully remote position.

Who You Are

You’re an experienced senior engineer with a backend tilt. You’re well-versed in all things web and have experience building LLM applications end-to-end, even if not in a professional context. You follow the AI/LLM space closely, play with new technologies as they come out, and are excited to use these technologies to build safe, reliable medical AI systems.

What You'll Do

  • Lead the development of our patient-facing conversational agent

  • Implement a scalable, low-latency system for voice/multimodal conversations

  • Implement rigorous prompt engineering processes and develop useful metrics for system evaluation

  • Identify where fine-tuning and alignment might be valuable, and create data pipelines to enable fast experimentation

  • Work with other backend engineers to deploy AI models and chat/voice APIs

  • Help identify, evaluate, and implement emerging LLM technologies, tools and frameworks

  • Collaborate with clinical experts to validate performance and medical accuracy

  • Work on developing backend services using FastAPI and Pydantic

What You’ll Need

  • 5+ years of professional software development experience, including 2+ years of experience with backend web development

  • Experienced and comfortable working with type-hinted, modern Python

  • 2+ years of experience building end-to-end LLM applications, personally or professionally

    • Experience integrating/optimizing LLMs in production environments

    • Knowledge of evaluation frameworks

    • Knowledge and experience with MLOps/LLMOps best practices

    • Experience building AI infrastructure from 0 -> 1

  • Experience with cloud platforms (especially Azure) and containerization technologies

Highly Desired

  • Professional experience building end-to-end LLM-powered applications

  • Experience with model fine-tuning/alignment

  • Experience in an early stage startup environment

  • Experience with healthcare industry standards, such as FHIR, and regulations, including HIPAA and SOC 2

Similar Jobs

2 Days Ago
Remote or Hybrid
GA, USA
Senior level
Senior level
Financial Services
Leads software engineering for AI/ML products within an agile banking technology team. Develops, reviews, debugs, and operationalizes secure production code using Python, PySpark, Databricks, AWS, and LLM technologies. Establishes governance and validation standards for AI-assisted engineering, promotes responsible AI practices, guides technical design and operations, and serves as a subject matter expert across teams.
Top Skills: Agentic AiAWSDatabricksGenerative AiLlmPysparkPython
11 Days Ago
In-Office or Remote
Chicago, IL, USA
100K-140K Annually
Senior level
100K-140K Annually
Senior level
Fintech
Build and deploy governed AI agents, automations, and multi-agent systems for business teams. Responsibilities include identifying AI opportunities, translating needs into requirements, prototyping, integrating enterprise systems, instrumenting telemetry, measuring ROI, monitoring risks and costs, and applying governance controls. The role also develops reusable patterns, documents solutions, enables business users, and communicates lessons learned to the AI Center of Excellence.
Top Skills: Ai AgentsAssistant And Agent FrameworksConversational AiDocument IntelligenceIso/Iec 42001Low-Code Workflow AutomationMcp ServersNatural Language AnalyticsNist Ai RmfRetrieval
14 Days Ago
Easy Apply
Remote
United States
Easy Apply
173K-255K Annually
Senior level
173K-255K Annually
Senior level
Big Data • Fintech • Mobile • Payments • Financial Services
Build and operate Affirm’s AI platform, including LLM and MCP gateways, agent runtimes, evaluation services, and governance controls. Design highly available backend systems, manage identity, quotas, routing, caching, reliability, observability, and security for AI workloads. Own projects from design through launch and on-call, establish engineering standards, collaborate across teams, mentor engineers, and help scale AI systems into production.
Top Skills: AWSAws BedrockChatgptClaudeKotlinKubernetesLitellmMcpMySQLPython

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account