Clinical AI Evaluator – Licensed US Physician (MD/DO)

Job Description: Clinical AI Evaluator – Licensed US Physician (MD/DO)

Company: Truelancer AI
Location: United States
Engagement Type: Independent Contractor
Workload: 10–20 hours per week
Minimum Experience: 3+ years

Project Overview

Truelancer AI is seeking licensed, actively practicing US physicians (MD/DO) to participate in a medical AI evaluation project. Selected candidates will review clinical case scenarios and evaluate AI-generated medical responses for clinical accuracy, diagnostic reasoning, and treatment appropriateness.

This opportunity is ideal for physicians with strong clinical judgment, recent patient-care experience, and the ability to assess medical information against established clinical standards.

Key Responsibilities

• Review clinical case scenarios covering a range of medical conditions.
• Evaluate AI-generated diagnoses, treatment recommendations, and alternative answers for clinical accuracy.
• Assess the quality and validity of clinical reasoning based on the information provided.
• Review clinical questions and answers for clarity, completeness, and appropriate structure.
• Evaluate alternative answer choices and identify potential clinical reasoning errors.
• Provide concise, evidence-based explanations to support evaluation decisions.
• Participate in independent assessments and physician reviews to resolve differences in clinical judgment.
• Maintain high standards of accuracy, consistency, and quality throughout the project.

Required Qualifications

• MD or DO degree from an accredited medical school.
• Currently residing in the United States.
• Active, unrestricted US medical licence, subject to verification.
• Completed residency training.
• Minimum 3 years of relevant clinical experience.
• Currently practising medicine, with recent direct patient-care experience.
• Strong clinical knowledge across multiple medical specialties, particularly diagnosis and treatment.
• Excellent written English communication skills.
• Strong analytical skills and attention to detail.

Preferred: Board-certified physicians and candidates with attending-level clinical experience.

Preferred Specialties

Physicians practising in the following specialties are particularly encouraged to apply:

• Internal Medicine / General Medicine
• Family Medicine
• Hospital Medicine / Hospitalists
• Emergency Medicine

Experience in medical AI evaluation, clinical content review, medical question development, examination question validation, or clinical annotation and quality assurance will be an added advantage.

Project Commitment

• Duration: Approximately 4 weeks.
• Workload: 10–20 hours per week.
• Start Date: Expected in early November 2026.
• Engagement: Independent contractor under a task-based Statement of Work (SOW).

Candidates should be available to commit to the project schedule and complete assigned evaluations within the agreed timelines.

Important Eligibility Criteria

Applicants must meet all the following requirements:

• Hold an MD or DO degree.
• Have completed residency training.
• Hold an active, unrestricted US medical licence.
• Be currently based in the United States and actively practising medicine.
• Confirm their current state of residence during screening.

Candidates residing in the following states are not eligible for this project:

Alaska, Arkansas, California, Connecticut, Delaware, Georgia, Hawaii, Illinois, Indiana, Kansas, Louisiana, Maine, Maryland, Massachusetts, Nebraska, Nevada, New Hampshire, New Jersey, New Mexico, Ohio, Oregon, Tennessee, Utah, Vermont, Washington, and West Virginia.

The following applicants are not eligible: Medical students, unlicensed medical graduates, nurses, nurse practitioners, physician assistants, pharmacists, and other non-physician healthcare professionals.

How to Apply

If you meet the eligibility criteria and are interested in contributing your clinical expertise to medical AI evaluation, please share your updated CV and confirm:

• Your medical degree (MD/DO).
• Your primary specialty.
• Your years of clinical experience.
• Your current US state of residence.
• Your active US medical licence status.
• Your current clinical practice status and availability for 10–20 hours per week.

Shortlisted candidates will be contacted for further screening and licence verification.

Join Truelancer AI and help improve the accuracy and clinical reliability of AI-generated medical responses.

Screening & Qualification Details

• Which state you are located in?