Design realistic, specialty-specific clinical case scenarios and gold-standard attending-level responses, evaluate and grade AI-generated outputs using structured rubrics, provide detailed written feedback to improve model clinical reasoning, and participate in onboarding, calibration, and review sessions in a fully remote, asynchronous contractor role (~20 hours/week).
This role is for one of our clients
Compensation: $130-$300 per hour
We are partnering with a leading AI research lab to develop high-quality healthcare reasoning data for training next-generation AI models. As a Clinical AI Specialist, you will contribute your medical expertise to design realistic clinical scenarios, evaluate AI-generated outputs, and help improve how advanced models reason about patient care in real-world settings.
Requirements
What You’ll Do
- Design clinically accurate and realistic case scenarios based on your specialty, including diagnostic reasoning, treatment planning, risk stratification, and guideline-based care
- Develop “gold standard” responses at an attending-physician level to guide AI model learning
- Evaluate and grade AI-generated outputs using structured rubrics and evidence-based medical standards
- Provide detailed written feedback to enhance model accuracy, safety, and clinical reasoning
- Participate in onboarding sessions, office hours, and specialty-specific calibration discussions
Who You Are
- Attending Physicians: Board-certified with a current, active, and unrestricted medical license
- Resident Physicians: Final year of residency (recent graduates must be board-eligible)
- Fellows: Board-certified/board-eligible in primary specialty with an active, unrestricted license
- Strong understanding of evidence-based medicine and clinical guidelines within your specialty
- Excellent analytical and written communication skills
Engagement Details
- Fully remote, asynchronous work environment
- Standard commitment of ~20 hours per week (with potential to increase based on performance and demand)
- Flexible schedule—work at your convenience
- Ongoing engagement with monthly performance reviews
- Start date: Rolling, following onboarding completion
Compensation
- Rates vary by specialty and experience level
- Final compensation details will be shared during the offer stage
- Payments are processed weekly via supported global payment platforms
Additional Information
- Engagement is on an independent contractor basis
- Work must not involve sharing confidential or proprietary information from any affiliated organization
- Projects may be extended, modified, or concluded based on business needs and individual performance
- At this time, visa sponsorship is not available for certain work authorization categories
Onboarding Process
Upon acceptance, you will receive onboarding materials along with an invitation to attend orientation and office hours sessions before beginning your first assignment.
Similar Jobs
Information Technology • Consulting
Own clinical quality for member-facing AI products by partnering with product, engineering, and clinical teams. Design clinical AI evaluations, define quality thresholds and rubrics, assess accuracy, omissions, hallucinations, medication-safety risks, and translate clinical reasoning into prompts and decision logic. Monitor evolving evidence and standards of care, validate product launches, and communicate findings to technical and clinical audiences.
Top Skills:
Clinical AiContext EngineeringLlmsMachine LearningPrompt Engineering
Cloud • Security • Software • Cybersecurity • Automation
Conduct advanced application security research across GitLab’s DevSecOps and AI-powered platforms. Identify and exploit novel, systemic, and chained vulnerabilities; develop proof-of-concept exploits, testing methodologies, and research automation; assess AI attack vectors and open-source dependencies; drive remediation and security improvements; advise engineering teams, contribute to roadmaps, mentor researchers, and share findings with the security community.
Top Skills:
Duo Agent PlatformGitlabGitlab DuoGoPythonRubyRustTypescript
Cloud • Security • Software • Cybersecurity • Automation
Conducts advanced application security research across GitLab’s DevSecOps and AI-powered platforms. Responsibilities include discovering and exploiting systemic vulnerabilities, penetration testing, developing proof-of-concept exploits, researching AI and agentic security threats, building automated research tooling, coordinating remediation, mentoring security professionals, and communicating findings to engineering and security communities.
Top Skills:
Ai FrameworksDevsecopsDuo Agent PlatformGitlabGitlab Duo ChatGoPythonRubyRustTypescript
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
