Job Details

We are looking for a candidate with experience as an annotator for AI and NLP-products, including the annotation of complex datasets to train and refine AI models and to support the ongoing operations and maintenance of such models. The Data Annotation Specialists will work on a diverse set of products and projects focused on multiple different uses of large language models - Q&A, summarization, red lining etc. As a Data Annotation Specialist you'll work closely with our Data Science and Engineering teams to create an impact in developing cutting-edge machine learning models.

Responsibilities

• Develop and refine annotation framework and guidelines.

• Oversee the annotation of datasets, ensuring accuracy and consistency.

• Implement quality measures and metrics to maintain high standards of data labeling and annotations.

• Participate in hands-on annotation work.

• Design and customize tools to enhance efficiency and ensure quality annotations.

• Train and mentor junior annotators.

• Collaborate with team to align annotation strategies with project goals and product missions.

• Create and maintain consistent and actionable reporting of annotations.

• Monitor and report on the progress of annotation projects. Qualifications

• Proven experience in data annotation and LLMs

• Proven team management abilities

• Familiarity with annotation practices, tools and

• Detail-oriented with a critical eye for accuracy

• Excellent communication skills

• Ability to work in a fast-paced environment

Qualifications

• The ideal candidate will have an appreciation for technology, be able to work autonomously and efficiently and have strong attention to detail.

• Ability to work on repetitive tasks effectively

• Strong written grammar skills

• Professional verbal and written communication

• Able to make judgment calls based on a set of criteria

• Able to manage time effectively with minimum oversight

• Organized and detail oriented

• Adaptable, reliable and ethical

• Technology skills including tooling and PC

• Transcription or tagging skills a major plus

• Experience in a related role

• Experience in a role requiring usage of a variety of technology tools

• Experience with Microsoft Office 365 and all its components (SharePoint, Forms, Power Automate, Outlook, Word, Excel)