Full-time

Remote Language Model Evaluator at Mercor

Posted by Mercor • June 08, 2026

📍 toronto, montreal (administrative region), calgary, vancouver, winnipeg, quebec, edmonton, ottawa, mississauga, moncton, ontario, quebec, alberta, metro vancouver regional district, manitoba, capitale nationale, division no. 11, ontario, peel region, moncton parish, Canada
Apply Now

Description

Elevate AI language models as a Language Model Evaluator with Mercor, working remotely. Conduct evaluations in English and Punjabi to enhance model performance and accuracy.

Mercor seeks a Generalist for a contract role focused on language modeling. This remote position requires you to possess native Punjabi skills and strong English writing ability. Your primary task will involve generating high-quality evaluation data that assesses reasoning quality, clarity, and factual accuracy across model responses.

Key Responsibilities:
• Conduct fact-checking using trusted public sources
• Generate evaluation data based on response quality
• Assess reasoning clarity and tone in model outputs
• Ensure model responses meet conversational guidelines
• Work independently to meet deadlines and improve AI performance

Requirements:
• Bachelor's degree in a relevant field
• Native Punjabi and strong English writing skills<...

Ready to Seal the Deal?

Submit your application today and take the next step in your career with Mercor.

Apply for this Job