Creative Writing Generative AI Analyst - California

What You’ll Do

• Perform annotation and labeling tasks for generative AI datasets, including text, image, video, and multimodal content
• Create, review, and evaluate prompts and responses across a variety of domains and use cases
• Conduct quality assurance reviews to ensure annotation accuracy, consistency, and adherence to guidelines
• Assist in developing and refining annotation guidelines and evaluation criteria
• Support data collection, categorization, tagging, and evaluation workflows for machine learning systems
• Identify edge cases, inconsistencies, and quality issues within datasets and model outputs
• Collaborate with internal teams and external partners to improve annotation quality and operational efficiency
• Provide feedback on workflows, tooling, and annotation processes

Requirements:

• Native level proficiency English with excellent written and verbal communication skills.
• Work Authorization is required for the role.
• Strong attention to detail and ability to follow complex annotation guidelines
• Interest in creative writing, generative AI, machine learning, and emerging AI technologies
• Experience with data annotation, content evaluation, labeling operations, or quality review workflows preferred
• Bachelor’s degree or equivalent practical experience

Ways to Stand Out from the Crowd

• Familiarity with generative AI systems, large language models, RLHF, or multimodal AI workflows
• Domain knowledge in Law/Medical/Math/Coding/etc is a plus
• Bilingual proficiency is a plus (Korean, Japanese, Mandarin, Spanish, German, or French)
• Experience annotating prompts, responses, images, video sequences, or other AI training data
• QA/testing experience within AI, data operations, or content review environments
• Experience working with evaluation rubrics, taxonomy development, or dataset quality initiatives
• Python or scripting experience is a plus