Position: LLM – AI Quality Analyst (Personalization) – Korean

Type: Short-Term Contract (2 months)

Compensation: $11 per hour

Location: Remote (Global)

Commitment: Part-time availability required

Role Responsibilities

• Evaluate a personalization feature for Gemini
• Design and execute multi-turn conversational prompts that require the AI to utilize personal information and experiences
• Assess how effectively the model uses past conversations and activity to generate relevant and helpful responses
• Evaluate model responses based on intent and appropriate personalization
• Analyze responses for grounding issues, including flawed inferences or hallucinations
• Assess integration quality to ensure personal data is incorporated naturally into responses
• Perform side-by-side evaluations and stack-rank model responses based on helpfulness and naturalness <...