Audio Evaluation Expert - Linguistics
Mercor San Francisco
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: English (US) Audio Generalist Evaluator ExpertType: Contract
Compensation: $50/hour
Location: Remote
Commitment: 10–20 hours/week
Role Responsibilities- Transcribe and optimize audio and video content in English (US), ensuring clarity and accuracy.
- Develop and document evaluation standards, including rubrics and grading guidelines in English.
- Conduct model testing and grading, providing structured feedback to improve AI model performance.
- Support benchmarking and quality assurance to maintain consistency and reliability.
- Collaborate with project leads to resolve ambiguities and improve task design.
Qualifications
Must-Have- Strong writing, editing, and critical thinking skills.
- Ability to work independently and manage time effectively.
- Native or near-native fluency in English (US).
- Familiarity with American English spoken language and regional vocabulary.
- Ability to transcribe and analyze English audio content.
- Available to commit 10–20 hours per week.
- College students or recent graduates.
- Background in linguistics, humanities, social sciences, journalism, translation/localization, or technical disciplines.
- Experience with transcription, annotation, localization, evaluation, or research workflows in English.
- Familiarity with regional dialects and variations of American English.
- Interest in AI, language models, or applied research environments.
- Complete a short AI-led interview (approximately 15 minutes).
- If selected, you will be onboarded and invited to begin project work.
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
- For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
SOSiSan Francisco
to enable national security missions worldwide. Job Description Overview SOSi is seeking Spanish Linguists in San Francisco, California to support our federal law enforcement customer. The Spanish Analytic Linguist will provide operational support to support...
MercorSan Francisco
College students or recent graduates.
• Background in linguistics, humanities, social sciences, journalism, translation/localization, or technical disciplines.
• Experience with transcription, annotation, localization, evaluation, or research workflows...
Crazy Maple StudioSunnyvale, 35 mi from San Francisco
in storytelling across different platforms.
• Stay updated on industry trends and best practices in localization and interactive storytelling.
Requirements
• Bachelor's degree in Translation, Linguistics, Film Studies, Screenwriting, or a related field.
• Proven...