German Data Annotator – Remote (LLM AI Quality Analyst)

About the role

We are looking for a German‑speaking Data Annotator to support the quality evaluation of large‑language‑model (LLM) responses. This short‑term contract role is fully remote and focuses on assessing personalized AI outputs for relevance, accuracy, and proper use of personal data.

Key responsibilities

• Design multi‑turn conversational prompts (1‑5 turns) based on personal context.
• Evaluate AI responses for relevance, grounding, integration, and helpfulness.
• Identify and flag incorrect or inappropriate use of personal data in model outputs.
• Perform side‑by‑side (SxS) ranking of AI responses and document rationales.
• Detect grounding errors, hallucinations, poor inferences, and forced personalization.
• Extract and verify model debug information and data source usage.
• Maintain data hygiene by deleting evaluation conversations after review.

Required profile

• Fluent in German (reading and writing) with high proficiency.
• Experience in data annotation, AI quality evaluation, content moderation, or related fields.
• Strong analytical thinking, attention to detail, and ability to evaluate nuanced AI responses.
• Background in prompt design and understanding of personalization concepts.
• BS/BA degree or equivalent experience in an analytical discipline.
• Self‑motivated, able to work independently in a remote environment.
• Reliable desktop/laptop with stable internet connection.

Required skills

• German language proficiency
• Data annotation and AI quality evaluation
• Prompt design for conversational AI

What we offer

• Short‑term contract (1 month) with immediate start.
• Flexible remote work (20 hours/week, with minimum 2 hours overlap with PST).
• Competitive hourly rate of $15 USD.