AI Dialogue & Tone Evaluator

AI overview

Evaluate and enhance AI-generated communication by ensuring empathy and cultural relevance, while collaborating with a team to maintain consistent scoring.

We’re looking for an AI Dialogue & Tone Evaluator to help fine-tune AI communication so it sounds authentically human. You’ll review, tag, and improve AI-generated responses — ensuring the right balance of empathy, cultural awareness, and clarity.

Requirements

Responsibilities

Compare multiple AI response options and select the most human-like
Tag tone and personality issues using a structured rubric
Write short sample prompts in specific styles and emotional tones
Recognize and interpret cultural references, humor, and character archetypes
Collaborate with other evaluators to keep scoring consistent

Requirements

Native or near-native US English fluency
Exceptional reading comprehension and attention to subtle tone shifts
Strong awareness of emotional cues and conversational flow
Familiarity with US pop culture, media, and humor styles

Preferred Background

Content moderation, copyediting, or customer communications
Journalism, creative writing, or psychology
Familiarity with AI chat tools or evaluation

Benefits

Pay Range: $20–$25/hr