Domain Expert - Geography

About Turing: Turing is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems.

Turing helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM and frontier knowledge; and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies.

Role Overview: We are seeking a highly qualified Geography Domain Expert to evaluate and improve Large Language Models (LLMs). You will design challenging prompts, assess factual accuracy and reasoning, and identify knowledge gaps within physical and human geography, GIS concepts, climate, geopolitics, and demographics.

Key Responsibilities:

• Create advanced prompts covering physical and human geography, GIS concepts, climate, geopolitics, and demographics.
• Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance.
• Identify hallucinations, logical inconsistencies, outdated information, and edge cases.
• Develop benchmark datasets and adversarial test cases.
• Provide evidence-based feedback with reliable references.
• Collaborate with AI researchers to improve model performance.
• Maintain high annotation quality and documentation.

Day-to-day tasks:

• Write domain-specific prompts of varying difficulty.
• Compare multiple AI responses and rank them.
• Explain why a response is correct or incorrect using authoritative references.
• Identify ambiguous questions and propose improved prompts.

Minimum Qualifications:

• Master's degree or higher in a discipline related to Geography.
• 3+ years of professional, research, or teaching experience.
• Excellent written English and analytical skills.
• Strong attention to detail.

Preferred Qualifications:

• Experience with LLMs, Generative AI, prompt engineering, or AI evaluation.
• Published research, industry recognition, or teaching experience is a plus.
• Ability to work independently and provide objective, evidence-backed reviews.

Offer Details:

• Commitments Required: 40 hours per week with at least 4 hours PST overlap
• Employment type: Contractor assignment (no medical/paid leave)
• Duration of contract: 8 weeks.