Location : Dublin
Work Model : Hybrid

Job Summary
You are a key member of the Language Experts group closely monitoring and evaluating responses quality for your locale. As a Language Expert you evaluate the performance of the language model ensuring that it: Correctly understands user requests. Provides relevant and useful responses. Presents the information in a clear and understandable manner. You also review and evaluate ratings.
Responsibilities
Collaborating with the cross-locale team of Language Experts you transform task-specific challenges and observations into valuable insights and process improvement suggestions. You also identify and call out what works well.
LLM model Improvement and Accountability: Linguists are directly responsible for driving model enhancements specific to their respective language and partner with Subject Matter Experts to ensure that the model delivers high-quality responses.
Data Analysis and Evaluation: Linguists meticulously analyze evaluation data to identify patterns successes and areas for improvement across various releases.
Evaluations Trustworthiness: Linguists safeguard the reliability of evaluations by vetting samples and assessing their quality.
Contextualized Guidance: Linguists create language-specific evaluation guidelines and instructions to provide tailored support and enhance model performance.
Quality Control: They provide feedback and conduct quality assessments on evaluations and rewrites ensuring that human-generated data aligns with the linguistic nuances and expectations of each language.
Skills and Qualifications
Bachelors degree in Linguistics and in-depth knowledge of language structures phonetics syntax semantics and language analysis methods. Advanced degrees (Masters or Ph.D.) in Linguistics preferred
Native-level fluency in the target language is essential with exceptional command of grammar vocabulary and cultural nuances.
Strong analytical abilities to dissect language structures identify patterns and draw conclusions about language use.
Excellent written and verbal communication skills are necessary for presenting research findings and writing reports.
Meticulous attention to language details including pronunciation grammar and subtle language variations.
Understanding of cultural context social norms and non-verbal communication associated with a language
Research skills: Ability to conduct research collect data and analyze linguistic phenomena is preferred. (not required) Programming languages (e.g. Python): Knowledge of programming for computational linguistics natural language processing and data analysis tasks is preferred
#LI-SK17