Data Science and Analytic Methodology SME

You will assess large language model performance in advanced analytic pipelines. The work focuses on realistic deployment scenarios, authored cases, model responses, and operational failure modes across government, defense, intelligence, and related workflows.

• Map scaled-analysis and pipeline-integration scenarios to an established evaluation taxonomy.
• Write detailed cases about automated triage, data enrichment, analysis at scale, and real-world failure modes.
• Evaluate model responses for source handling, reasoning, limitations, and practical usefulness.
• Identify over-refusal that could disrupt legitimate analytic workflows or pipeline continuity.
• Document edge cases and methodology concerns, then recommend practical improvements.
• Provide concise written and verbal feedback that supports consistent evaluation quality.

What it pays and takes

This is a remote contractor opportunity with flexible scheduling. The role is listed as entry level, and the work requires strong data science judgment, technical communication, and experience with complex analytic systems.

• Pay: $60 to $100 per hour.
• Work arrangement: Remote contractor role with flexible scheduling.
• Location: Open to candidates in Algeria, Argentina, Austria, Bahrain, Bangladesh, Belgium, Brazil, Canada, Chile, Colombia, Denmark, Egypt, France, Germany, Ghana, Greece, India, Indonesia, Italy, Japan, Jordan, Kazakhstan, Kenya, Kuwait, Kyrgyzstan, Lebanon, Malaysia, Mexico, Morocco, the Netherlands, Nigeria, Oman, Pakistan, Palestinian Territories, Peru, the Philippines, Portugal, Qatar, Saudi Arabia, Singapore, South Africa, Spain, Sri Lanka, Switzerland, Taiwan, Thailand, Tunisia, the United Arab Emirates, the United Kingdom, the United States, Uzbekistan, and Vietnam.
• Language: Professional fluency in English for technical writing and communication.
• Experience integrating large language models, including government GPT variants or equivalent systems, into complex data or analytic pipelines.
• Ability to conduct analysis at scale and understand automation failure modes and evaluation metrics.
• Experience teaching, mentoring, or providing technical leadership in data science or related analytic disciplines.
• Familiarity with evaluation frameworks or benchmark systems.
• Experience in defense, intelligence, or government analytic domains is helpful, especially with knowledge of operational workflows and minimal-clearance environments.

How it works

You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.

The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 6 screening questions.

About AI training work

AI training work is the human side of building artificial intelligence. Contributors write and review examples, assess model responses, and provide structured feedback so AI systems become more useful and reliable; people with specialized experience are needed for demanding technical and industry-specific evaluations.