AI Quality Analyst (German) – Remote, $15/hr

About the role

We are looking for a German‑speaking AI Quality Analyst to help evaluate personalized large‑language‑model responses. This short‑term, remote contract role involves designing prompts, reviewing AI outputs, and providing detailed feedback to improve model performance.

Key responsibilities

• Design and execute multi‑turn conversational prompts (1‑5 turns) based on personal context.
• Evaluate AI responses for relevance, grounding, integration, and overall helpfulness.
• Assess correct and incorrect use of personal data in model outputs.
• Perform side‑by‑side (SxS) evaluation and ranking of AI responses.
• Identify grounding errors, poor inferences, hallucinations, and forced personalization.
• Write clear, structured rationales referencing specific conversation turns.
• Extract and verify model debug information and data source usage.
• Maintain strict data hygiene by deleting evaluation conversations.

Required profile

• High‑proficiency German reading and writing skills.
• Experience in data annotation, AI quality evaluation, content moderation, or related fields.
• Strong analytical thinking, attention to detail, and ability to evaluate nuanced AI responses.
• Experience with prompt design and personalization concepts.
• Comfortable using a personal Google account with enabled data sources.
• BS/BA degree or equivalent analytical experience.
• Excellent written communication and structured feedback abilities.
• Self‑motivated, able to work independently in a remote setting.
• Reliable desktop/laptop with stable internet connection.

Required skills

What we offer

• Competitive hourly rate of $15.
• Fully remote work with flexible scheduling (20 hours/week, minimum 2 hours overlap with PST).
• Opportunity to contribute to cutting‑edge AI personalization research.