AI Translation Evaluator; Russian-English

Responsibilities

• Review conversation history and translation requests with additional contextual instructions
• Apply MQM error annotations with appropriate categories and severity levels
• Verify auto-generated rubric items for relevance, marking spurious items as needed
• Evaluate each rubric item as Pass or Fail based on the user's stated requirements
• Provide accurate and consistent ratings based on project guidelines
• Complete assigned tasks within the given timelines
• Key Requirements:
• Must be a native Russian speaker with a strong command of English, including grammar, vocabulary, and translation conventions
• Must be a language specialist, professional translator, or hold a Master's Degree in a language-related field
• Keen attention to detail
• Access to a stable internet connection and a computer
• If you have a passion for language and translation, this is a great opportunity to help shape AI systems that produce accurate, context-aware multilingual translations.
• Slots are limited - apply through CrowdGen and start evaluating!
• #crowdgen

Additional Information

Join the Appen team as an Independent Contractor for Project Centric. Project Centric is seeking individuals for an ongoing, ad-hoc project focused on improving AI-powered translation. In this project, participants will evaluate context-dependent translations produced by an AI chatbot, where each item includes a conversation history, a translation request with additional context (such as dialect preferences, selective non-translation rules, tone/register requirements, or domain-specific terminology), and the chatbot's response. You will apply MQM error annotations, verify auto-generated rubric items for relevance, and evaluate each applicable rubric item as Pass or Fail based on whether the translation meets the user's stated requirements. Help improve AI translation systems by evaluating Russian-English translations for accuracy, quality, and adherence to user-specified requirements.

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at CrowdGen by Appen? Share your experience