Small Business Owners (AI Response Evaluation) - US

About Turing

Turing is one of the world's fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems. Turing works with leading AI labs to advance frontier model capabilities and builds real-world AI systems for companies.

Role Overview

We are seeking US-based generalist raters to participate in Workspace Personalization Evals. In this role, raters perform generalist evaluation work using personalized prompts designed to retrieve context and data across connected Google Workspace apps. We are looking for a mix of Small Business Owners (>10 employees) and Retail Users.

Responsibilities

• Create realistic business-related prompts based on defined user goals
• Interact with multiple AI chatbots (maximum 5 turns per conversation)
• Assess response quality across clarity, usefulness, and accuracy
• Provide structured feedback and comparative evaluations
• Submit conversation transcripts and evaluation results

Requirements

• Business owner with >10 employees and strong understanding of small business operations
• Strong analytical and critical thinking skills
• Ability to follow structured evaluation guidelines
• Comfortable interacting with AI tools
• Must use Gmail as the primary business communication tool
• High familiarity and active usage across Google Workspace (Gmail, Chat, Calendar, Drive, Docs, Sheets, Slides, Meet), with heavy Chat, Drive, and Calendar usage

What you'll work on

• Create engaging visual content for marketing
• Help answer and evaluate day-to-day operations and customer interactions
• Conduct market research and contribute ideas in your area of expertise
• Work with data to support analysis and financial planning
• Review and evaluate AI-generated responses for small business use cases
• Use spreadsheets, PDFs, and images as part of your workflow

Offer Details

• Commitment: up to 40 hours per week
• Engagement type: contractor
• Engagement length: up to 4 months

Evaluation Process

• Shortlisted candidates complete a Job Interest Form
• Eligible candidates proceed through project-specific screening and qualification
• Final selected candidates are contacted with next steps, including consent and onboarding