AI Evaluator - Software Expert

apartmentMercor placeNew York calendar_month8/21/26

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Software / AI / IT / data Evaluator
Type: Contract
Compensation: $80–$120/hour

Location: Remote

Role Responsibilities

Evaluate AI-generated artifacts against domain-specific quality rubrics.
Identify factual, aesthetic, and presentation errors in outputs.
Provide clear, structured written feedback to improve quality.
Work independently and asynchronously to meet deadlines.
Utilize expertise in Microsoft Office and Google Workspace, especially Slides.

Qualifications

Must-Have

5+ years of relevant professional experience in Software / AI / IT / data.
Native or professional fluency in English.
Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Preferred

Advanced degree (Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

Upload resume
AI interview based on your resume
Submit form

Resources & Support

For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

business_centerHigh salary

HELICOPTER FLIGHT INSTRUCTOR/EVALUATOR with Security Clearance

apartmentDepartment of the ArmyplaceRonkonkoma, 44 mi from New York

Duties As a HELICOPTER FLIGHT INSTRUCTOR/EVALUATOR (GS-2181-13), you will be responsible for providing instruction, evaluation and examination of rated pilots, instructor pilots, and aeroscout observers in flying techniques and methods...

starFeatured

CRM Operations Evaluator - Fully Remote

apartmentMercorplaceNew York

Position: Data quality / CRM operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities • Evaluate AI-generated artifacts against domain-specific quality rubrics. • Identify factual, aesthetic, and presentation...

check_circleNew offer

Procurement Evaluator - Fully Remote

apartmentMercorplaceNew York

Position: Procurement / vendor management Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities • Evaluate AI-generated artifacts against domain-specific quality rubrics. • Identify factual, aesthetic...

Best jobs you don't want to miss:

Finance Jobs in New York

Banking Jobs in New York

Financial Services Jobs in New York 2 Urgent

Bank Jobs in New York

Financial Analyst Jobs in New York 5 Urgent