Audio Evaluation Expert - Linguistics

apartmentMercor placeSan Francisco calendar_month 

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: English (US) Audio Generalist Evaluator Expert
Type: Contract
Compensation: $50/hour
Location: Remote

Commitment: 10–20 hours/week

Role Responsibilities
  • Transcribe and optimize audio and video content in English (US), ensuring clarity and accuracy.
  • Develop and document evaluation standards, including rubrics and grading guidelines in English.
  • Conduct model testing and grading, providing structured feedback to improve AI model performance.
  • Support benchmarking and quality assurance to maintain consistency and reliability.
  • Collaborate with project leads to resolve ambiguities and improve task design.

Qualifications

Must-Have
  • Strong writing, editing, and critical thinking skills.
  • Ability to work independently and manage time effectively.
  • Native or near-native fluency in English (US).
  • Familiarity with American English spoken language and regional vocabulary.
  • Ability to transcribe and analyze English audio content.
  • Available to commit 10–20 hours per week.
Preferred
  • College students or recent graduates.
  • Background in linguistics, humanities, social sciences, journalism, translation/localization, or technical disciplines.
  • Experience with transcription, annotation, localization, evaluation, or research workflows in English.
  • Familiarity with regional dialects and variations of American English.
  • Interest in AI, language models, or applied research environments.
Application Process (Takes 20–30 mins to complete)
  • Complete a short AI-led interview (approximately 15 minutes).
  • If selected, you will be onboarded and invited to begin project work.
Resources & Support
  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

apartmentSOSiplaceSan Francisco
to enable national security missions worldwide. Job Description Overview SOSi is seeking Spanish Linguists in San Francisco, California to support our federal law enforcement customer. The Spanish Analytic Linguist will provide operational support to support...
apartmentMercorplaceSan Francisco
College students or recent graduates.  •  Background in linguistics, humanities, social sciences, journalism, translation/localization, or technical disciplines.  •  Experience with transcription, annotation, localization, evaluation, or research workflows...
apartmentCrazy Maple StudioplaceSunnyvale, 35 mi from San Francisco
in storytelling across different platforms.  •  Stay updated on industry trends and best practices in localization and interactive storytelling. Requirements  •  Bachelor's degree in Translation, Linguistics, Film Studies, Screenwriting, or a related field.  •  Proven...