Persona-driven Simulation of Voting Behavior in the European Parliament with Large Language Models
Maximilian Kreutner, Marlene Lutz, Markus Strohmaier · Jun 13, 2025
Citations: 0
Automatic MetricsSimulation Env Coding
Platform Overview
Hire, manage, and pay top AI Trainers & Data Labelers in one place while working in the tools you already use
Find Data Labeling Vendors
Browse vetted agencies and BPOs for large-scale projects.
List your data labeling company
Create a free company profile, receive matched RFPs, and submit proposals with your pricing, capacity, and timeline.
JOIN AS Freelancer
The #1 Platform for Finding AI Training Jobs
We bring AI training and data labeling jobs from 20+ platforms into one place.
Work With Us
Hire Freelancers
Post a Job to the #1 Network for AI Training Talent Now
Post your job and find pre-vetted AI Trainers & Data Labelers across any domain, language, or tool.
FOR LARGE PROJECTS / MANAGED SERVICE
Done-for-You AI Data Teams
For large or complex projects. We recruit, train, manage, and QA your team inside your tools.
JOIN AS Freelancer
The #1 Platform for Finding AI Training Jobs
We bring AI training and data labeling jobs from 20+ platforms into one place.
LLM & Agents
View All LLM & Agent Solutions
Structured Data Labeling
View Data Labeling Solutions
Work With Us
Hire Freelancers
Post a Job to the #1 Network for AI Training Talent Now
Post your job and find pre-vetted AI Trainers & Data Labelers across any domain, language, or tool.
FOR LARGE PROJECTS / MANAGED SERVICE
Done-for-You AI Data Teams
For large or complex projects. We recruit, train, manage, and QA your team inside your tools.
Work With Us
Hire Freelancers
Post a Job to the #1 Network for AI Training Talent Now
Post your job and find pre-vetted AI Trainers & Data Labelers across any domain, language, or tool.
FOR LARGE PROJECTS / MANAGED SERVICE
Done-for-You AI Data Teams
For large or complex projects. We recruit, train, manage, and QA your team inside your tools.
Researcher Tools
Paper Explorer (HFEPX)
Browse high-signal papers for RLHF, human feedback datasets, and LLM/agent evaluation workflows.
Paper2Code Finder
Find the best implementation and artifacts for any paper by arXiv ID, DOI, URL, or title.
AI & ML Glossary
Browse 500+ AI and machine learning terms with definitions, examples, and explanations.
Researcher Tools
Human Feedback and Eval Paper Explorer
A focused feed for RLHF, preference data, rater protocols, agent evaluation, and LLM-as-judge research. Every paper includes structured metadata for quick triage.
Filter by tag
A Benchmark for Deep Information Synthesis
Debjit Paul, Daniel Murphy, Milan Gritta, Ronald Cardenas, Victor Prokhorov, Lena Sophia Bolliger · Feb 24, 2026
Citations: 0
Automatic Metrics Tool Use Coding
- To address this, we introduce DEEPSYNTH, a novel benchmark designed to evaluate agents on realistic, time-consuming problems that combine information gathering, synthesis, and structured reasoning to produce insights.
- When evaluated on DEEPSYNTH, 11 state-of-the-art LLMs and deep research agents achieve a maximum F1 score of 8.97 and 17.5 on the LLM-judge metric, underscoring the difficulty of the benchmark.
Protocol Hubs
Expert Verification Papers (32)
CS.CL + Expert Verification Papers (24)
Pairwise Preference Papers (89)
CS.CL + Pairwise Preference Papers (74)
Coding Papers (69)
CS.CL Human Feedback And Eval Papers (1,020)
CS.AI + Expert Verification Papers (20)
CS.AI Human Feedback And Eval Papers (794)
Expert Verification Or Pairwise Preference Papers (118)
Pairwise Preference Papers (Last 120 Days) (59)
Pairwise Preference Papers (Last 90 Days) (58)
Pairwise Preference Papers (Last 60 Days) (57)
Long Horizon Papers (101)
CS.AI + Pairwise Preference Papers (52)
Expert Verification Or Rubric Rating Papers (50)
CS.CL + Coding Papers (51)
Benchmark Hubs
Metric Hubs
- Accuracy & Pass Rate Metric Papers (88)
- Accuracy Metric Papers (82)
- Accuracy & Pass Rate Metric Papers In CS.CL (63)
- Accuracy & Pass Rate Metric Papers + Automatic Metrics (74)
- Accuracy In CS.CL Papers (58)
- Accuracy & Pass Rate Metric Papers In CS.AI (58)
- Accuracy + Automatic Metrics Metric Papers (70)
- Accuracy + Automatic Metrics Metric Papers (Last 120 Days) (53)
- Accuracy + Automatic Metrics Metric Papers (Last 90 Days) (51)
- Accuracy + Automatic Metrics Metric Papers (Last 30 Days) (47)
Need human evaluators for your AI research? Scale annotation with expert AI Trainers.