UpDoc Logo

UpDoc

Senior Software Engineer, AI

Posted 4 Days Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
Lead development of a patient-facing conversational AI agent for chronic disease management. Build scalable, low-latency voice and multimodal systems, engineer prompts, define evaluation metrics, develop fine-tuning data pipelines, deploy AI models and APIs, assess emerging LLM technologies, and collaborate with clinical experts to validate medical accuracy. Develop backend services using FastAPI and Pydantic while supporting secure, reliable medical AI infrastructure.
The summary above was generated by AI

About UpDoc

At UpDoc, we are building the first clinically validated, physician-supervised AI agent that manages chronic diseases. We are an early-stage startup founded by Stanford physicians.

We are seeking a talented and motivated senior engineer to join our team. You will primarily work on UpDoc’s patient-facing conversational agent. This is a fully remote position.

Who You Are

You’re an experienced senior engineer with a backend tilt. You’re well-versed in all things web and have experience building LLM applications end-to-end, even if not in a professional context. You follow the AI/LLM space closely, play with new technologies as they come out, and are excited to use these technologies to build safe, reliable medical AI systems.

What You'll Do

  • Lead the development of our patient-facing conversational agent

  • Implement a scalable, low-latency system for voice/multimodal conversations

  • Implement rigorous prompt engineering processes and develop useful metrics for system evaluation

  • Identify where fine-tuning and alignment might be valuable, and create data pipelines to enable fast experimentation

  • Work with other backend engineers to deploy AI models and chat/voice APIs

  • Help identify, evaluate, and implement emerging LLM technologies, tools and frameworks

  • Collaborate with clinical experts to validate performance and medical accuracy

  • Work on developing backend services using FastAPI and Pydantic

What You’ll Need

  • 5+ years of professional software development experience, including 2+ years of experience with backend web development

  • Experienced and comfortable working with type-hinted, modern Python

  • 2+ years of experience building end-to-end LLM applications, personally or professionally

    • Experience integrating/optimizing LLMs in production environments

    • Knowledge of evaluation frameworks

    • Knowledge and experience with MLOps/LLMOps best practices

    • Experience building AI infrastructure from 0 -> 1

  • Experience with cloud platforms (especially Azure) and containerization technologies

Highly Desired

  • Professional experience building end-to-end LLM-powered applications

  • Experience with model fine-tuning/alignment

  • Experience in an early stage startup environment

  • Experience with healthcare industry standards, such as FHIR, and regulations, including HIPAA and SOC 2

Similar Jobs

6 Days Ago
Remote or Hybrid
OH, USA
Senior level
Senior level
Financial Services
Leads software engineering efforts within an agile infrastructure platform team. Develops, reviews, debugs, and governs secure production code using Java full-stack technologies, React, cloud platforms, containers, and relational databases. Drives adoption of AI-assisted engineering tools, establishes validation and security standards, coaches technical teams, promotes SDLC automation, and influences technology decisions. Balances hands-on development with technical leadership and contributes to an inclusive engineering culture.
Top Skills: AWSAzureDockerGCPGithub CopilotHibernate/JpaJava 11+KubernetesLarge Language Models (Llms)MySQLOraclePostgresReactRestful ApisSpring BootSpring Framework
10 Days Ago
In-Office or Remote
180K-240K Annually
Senior level
180K-240K Annually
Senior level
Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
Architect and build high-performance distributed infrastructure for batch and streaming data across global regions. Optimize state management, checkpointing, JVM performance, and exactly-once processing. Develop AI infrastructure including vector indexing, agentic workflows, and real-time data streaming. Own the full software development lifecycle, contribute to shared tooling and SDKs, and mentor engineers through technical leadership and design reviews.
Top Skills: Apache FlinkSparkGoJavaJvmKafkaKotlinKubernetesOlap EnginesVector Indexing
Yesterday
In-Office or Remote
150K-180K Annually
Senior level
150K-180K Annually
Senior level
Robotics
Design, build, and operate AWS-based microservices and asynchronous workflows powering AI-driven laboratory protocol generation. Develop NLP pipelines, classifiers, embedding and RAG infrastructure, evaluation frameworks, guardrails, cost monitoring, and observability. Integrate AI systems into production SaaS architecture, ensure reliability and safe scaling, and support post-launch operations through debugging, incident response, and continuous improvement.
Top Skills: AWSCi/CdFastapiGitLarge Language Models (Llms)MicroservicesNatural Language Processing (Nlp)PythonReactRestful ApisRetrieval-Augmented Generation (Rag)Typescript

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account