Lithuanian Audio Generalist Evaluator Expert
Job description
About the Role
Mercor is seeking a Lithuanian Audio Generalist Evaluator Expert to contribute to a high-impact AI research project focused on multilingual audio data.
In this role, you will perform transcription, annotation, and evaluation tasks that help train and benchmark advanced language models.
This short-term engagement is ideal for candidates with strong analytical skills who are fluent in Lithuanian and English and enjoy transforming complex audio and visual information into clear, structured text.
Key Responsibilities
Transcribe and Optimize Audio & Video
- Listen to, analyze, and transcribe Lithuanian audio and video content
- Produce high-quality written outputs in Lithuanian, with supporting work in English when required
- Ensure accuracy and adherence to formatting and stylistic guidelines
- Capture linguistic nuances such as tone, intent, register, and regional variations
Define and Document Evaluation Standards
- Establish expectations for high-quality responses in consumer audio tasks
- Develop evaluation rubrics and grading guidelines
- Document standards to ensure consistency across reviewers
- Identify linguistic edge cases and grammatical complexities
Conduct Model Testing and Grading
- Run prompts through AI models and evaluate generated responses
- Assess outputs for accuracy, completeness, fluency, and clarity
- Provide structured feedback to improve AI model performance
Support Benchmarking and Quality Assurance
- Participate in quality assurance reviews
- Ensure datasets meet Mercor’s quality standards
- Collaborate with project leads to resolve task ambiguities
Minimum Qualifications
- Strong writing, editing, and analytical skills
- Ability to work independently and meet deadlines
- Native or near-native fluency in Lithuanian
- Professional fluency in English
- Ability to accurately transcribe and analyze Lithuanian audio
- Availability to commit 10–20 hours per week
Preferred Qualifications
- College students or recent graduates
- Background in linguistics, journalism, humanities, or social sciences
- Experience with transcription, localization, or data annotation
- Familiarity with Lithuanian dialects such as:
- Aukštaitian
- Samogitian
- Interest in AI systems and language model research
Application Process
- Complete a short AI-led interview (approximately 15 minutes)
- If selected, receive onboarding instructions
- Begin project work
Additional Role Details
- Structured project environment with clear guidelines and tools
- Hands-on experience with AI research and evaluation workflows
- Opportunity to contribute to multilingual AI model benchmarking
Contract & Payment Terms
- Independent contractor engagement
- Fully remote work schedule
- Weekly payments via Stripe or Wise
- Projects may be extended or shortened depending on performance
Please note: Mercor cannot support H1-B or STEM OPT candidates at this time.
About Mercor
Mercor partners with leading AI labs and enterprises to train frontier AI models using human expertise.
Contributors collaborate with researchers and engineers to improve the accuracy, reasoning ability, and multilingual capabilities of next-generation AI systems.
You will be redirected to the company's website to complete your application.
Mercor
Discover more opportunities that match your skills and interests.