Skip to content
OpenTrain AIFor AI Companies

Philosophy AI Evaluation Expert

Apply now

Job details

Pay

$50–$100 USD/hr

Engagement

Contract

Location

Remote

95 countries

Posted

Nov 8, 2026

OpenTrain on Trustpilot

The work

About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.

About this role
OpenTrain is recruiting for a Philosophy AI Evaluation Expert to create and assess text-based evaluation data used to measure model judgment. You will develop scenarios covering argument analysis and applied ethical reasoning, write rigorous reference answers, and evaluate whether model outputs are valid, sound, and fair to the strongest opposing view. The role suits a practicing philosopher who can bring precise disciplinary judgment to AI evaluation work.

What you will do
Author philosophical scenarios that test argument reconstruction, ethical dilemmas, and real reasoning. Write reference answers that clearly identify premises, inferences, objections, and argumentative structure. Grade model responses for validity, soundness, and fair treatment of opposing positions. Identify equivocation, question-begging, weak counterexample handling, and other reasoning failures. Apply consistent standards while explaining exactly where an argument succeeds or breaks down.

Required skills
An advanced degree in philosophy or a closely related field is required, along with at least two years of teaching, research, or published philosophical work. Candidates should have depth in an area such as ethics, epistemology, logic, philosophy of mind, or political philosophy, as well as clear written English for constructing and evaluating complex arguments. The ability to steelman a position you reject and distinguish strong objections from weak ones is important.

Helpful background
A PhD, peer-reviewed publications, formal training in logic or decision theory, and applied ethics experience including bioethics or AI ethics are helpful.

Work arrangement and pay
This is independent-contractor project work that is fully remote and asynchronous. The minimum commitment is 10 hours per week, with no maximum, and the workload can scale up or down. The project is ongoing rather than limited to a single batch of tasks. Pay is $50 to $100 per hour, paid weekly via Stripe.

Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.

Requirements

  • Languages: English

Open to applicants in

  • Albania
  • Algeria
  • Antigua and Barbuda
  • Armenia
  • Australia
  • Austria
  • Bahamas
  • Bahrain
  • Belgium
  • Benin
  • Bhutan
  • Bosnia and Herzegovina
  • Botswana
  • Brunei
  • Bulgaria
  • Canada
  • Costa Rica
  • Côte d’Ivoire
  • Croatia
  • Cyprus
  • Czechia
  • Denmark
  • Ecuador
  • El Salvador
  • Estonia
  • Ethiopia
  • Finland
  • France
  • Gambia
  • Germany
  • Greece
  • Guatemala
  • Guyana
  • Hong Kong
  • Hungary
  • Iceland
  • India
  • Indonesia
  • Ireland
  • Israel
  • Italy
  • Jamaica
  • Jordan
  • Kenya
  • Kuwait
  • Latvia
  • Liechtenstein
  • Lithuania
  • Luxembourg
  • Madagascar
  • Malaysia
  • Malta
  • Mauritius
  • Mexico
  • Moldova
  • Mongolia
  • Morocco
  • Mozambique
  • Namibia
  • Netherlands
  • New Zealand
  • North Macedonia
  • Norway
  • Oman
  • Pakistan
  • Panama
  • Peru
  • Philippines
  • Poland
  • Portugal
  • Qatar
  • Romania
  • Rwanda
  • Saint Lucia
  • Senegal
  • Serbia
  • Singapore
  • Slovakia
  • Slovenia
  • South Africa
  • Spain
  • Sri Lanka
  • Sweden
  • Switzerland
  • Taiwan
  • Tanzania
  • Thailand
  • Trinidad and Tobago
  • Tunisia
  • Türkiye
  • United Arab Emirates
  • United Kingdom
  • United States
  • Uzbekistan
  • Vietnam

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

OpenTrain on Trustpilot

Job ID: cmw7va6m300aw08l9rb6eb7gz

Keep exploring

Similar open roles

View all AI training jobs

Philosophy AI Research Expert

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Text
Remote · United States
English
Flexible hours
Hourly · $120/hr

Posted Nov 5, 2026

Senior AI Model Evaluation Domain Expert

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Text
Remote · United Arab Emirates, Antigua and Barbuda, Albania +92 more
English
Flexible hours
Hourly · $135/hr

Posted Nov 5, 2026

AI Evaluator

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

EnglishAttention to DetailAI UsageGoogle ClassroomLiterature
Text
Remote · United States
English
Part-time · Flexible
Hourly · $15–$40/hr

Posted Oct 8, 2026

Philosophy Quality Assurance Lead

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

AI trainingArgument analysisEpistemologyEthicsHumanities reviewLLM evaluation
Text
Remote · United States
English
Part-time · Flexible
Expert level
Hourly · $65/hr

Posted Jul 9, 2026

Philosophical Logic Annotator

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

User ResearchLogical Reasoning
Text
Remote · Worldwide
English
Part-time · Flexible

Posted Nov 20, 2026