Italian Language LLM Evaluation Analyst

The work

You will help improve large language models by reviewing Italian and English content, checking claims, and explaining what makes an answer correct or useful. The work combines research, reasoning, writing, and detailed evaluation.

• Break down Italian and English content into clear logical sections.
• Research information online and check whether claims are accurate.
• Answer questions involving data interpretation, logic, analysis, and basic arithmetic.
• Create scenarios and examples that help language models learn.
• Write correct answers, explanations, constructive feedback, and detailed annotations.
• Use creative and lateral thinking to handle unclear or difficult problems.

What it pays and takes

The hourly or project rate is not listed in the provided role details. This is a remote contractor assignment with flexible working hours and a potential extension based on performance and project needs.

• Time commitment: 40 hours per week in the role description; the structured listing also indicates 20+ hours per week.
• Schedule: Include 2 to 5 hours of overlap with UTC-8:00.
• Location: Worldwide and remote.
• Languages: Professional working ability in Italian and English.
• Required: Strong research, analytical, critical-thinking, communication, and independent-working skills.
• Required: Ability to interpret data, reason logically, and explain decisions clearly.
• Required: A desktop or laptop with a reliable internet connection.
• Helpful: Professional writing experience in business analysis, research, journalism, technical writing, editing, translation, or a related field.
• Helpful: Familiarity with Excel and Google Suite.
• Helpful: A bachelor's degree or undergraduate study in engineering, literature, journalism, communications, arts, statistics, or a related field.
• Relevant experience may be considered in place of formal study.

How it works

OpenTrain is the hiring and contracting organization for this role. Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training is the human work behind systems that generate and understand text. Contributors review examples, check model answers, and provide explanations so AI systems can produce more accurate and useful results.