Skip to content
OpenTrain AIFor AI Companies
← Back to explorer

Tag: Multi Agent

Multi Agent evaluation setups appearing in the current HFEPX corpus (262 papers).

Papers in tag: 262

Running a Multi Agent study?

Post a Job →

Research Utility Snapshot

Evaluation Modes

  • Automatic Metrics (10)
  • Simulation Env (1)

Human Feedback Types

  • Critique Edit (1)
  • Expert Verification (1)
  • Pairwise Preference (1)

Required Expertise

  • General (16)
  • Medicine (2)
  • Coding (1)
TOPAS: Workflow-Aware Prefix-State Scheduling for Multi-Agent LLM Serving

Hongqiu Ni, Han Tian, Chi Zhang, Guopeng Li, Haisheng Tan · Aug 26, 2026 · Citations: 0

General
  • Prefix caching introduces a fundamental tradeoff in multi-agent large language model (LLM) serving: retaining a long system-prompt key-value (KV) cache for an agent accelerates future calls, yet it reduces the GPU memory available for…
  • To strike a balance, we here propose TOPAS, a Task-Oriented Prefix-Aware Scheduler that jointly decides which agent prefixes to keep in the cache and which requests to schedule for execution.
Benchmarking Patent Drafting from Inventor-Style Disclosures

Lekang Jiang, Wenjun Sun, Stephan Goetz · Aug 21, 2026 · Citations: 0

Law
  • It is a multi-agent framework for locally deployable patent drafting.
  • Benchmark results reveal that current LLMs exhibit limitations in patent drafting, while Patent-MAF provides a strong baseline that consistently outperforms evaluated open-source models and remains competitive with large closed-source…
Tree-of-Concerns: Hierarchical Multi-Agent Debate for Unstated-Limitation Extraction in Scientific Critique

Sahil Mishra, Niranjan Rajeev, Tanmoy Chakraborty · Aug 21, 2026 · Citations: 0

Critique Edit Automatic Metrics General
  • Here, we introduce Tree-of-Concerns, a multi-agent framework that deploys specialized skeptic personas, each operating through a category-specific analytical lens, as parallel debate trees to extract unstated limitations from scientific…
  • Through experiments on ToC-Bench, our benchmark of 414 research papers with 1,905 unstated limitations, sourced from reviewer-reported weaknesses and follow-up citation critiques, we demonstrate that ToC improves precision by 79% and…
Multi-Agent Orchestration with the Common-Sense Reasoning Capabilities of LLMs for Autonomous Driving

Mehdi Azarafza, Faezeh Pasandideh, Ali Ehteshami Bejnordi, Stefan Henkler, Achim Rettberg · Aug 20, 2026 · Citations: 0

Automatic Metrics General
  • While reinforcement learning and rule-based methods can provide effective control and safety mechanisms, their performance may degrade in situations requiring contextual reasoning.
  • The results demonstrate the potential of integrating LLM-based reasoning with conventional autonomous driving methods while retaining structured control and safety mechanism.
Reward-Guided Autoregressive Graph Generation for Efficient Multi-Agent Communication Topology Design

Poomphob Suwannapichat, Boonyarit Changaival, Caesar Wu, Pascal Bouvry · Aug 20, 2026 · Citations: 0

Automatic Metrics General
  • LLM-based Multi-Agent Systems (MAS) achieve strong performance on complex reasoning tasks by coordinating multiple agents, but at the cost of substantial token consumption.
  • We address this limitation by introducing a Reward-Guided Autoregressive Graph Generation (RGA-Designer) inspired by Reinforcement Learning from Human Feedback (RLHF).
MARC v1: An Open-Source Multi-Agent Framework for Clinical AI Reasoning and Coordination

Saisha Shetty, Satvik Tripathi, Austin Lin, Colin Zhao, Theodore Kim, Don Enwerem · Aug 13, 2026 · Citations: 0

Expert Verification MedicineCoding
  • We present Multi-Agent Reasoning and Coordination (MARC), an open-source framework that replaces monolithic LLM prompting with deterministic multi-agent orchestration for clinical reasoning.
  • MARC coordinates role-specialized agents for extraction, reasoning, answer generation, and evaluation, with explicit context passing and traceable intermediate outputs, enabling stage-wise failure attribution.
Reconcile Once, Write Anytime: A Trust-Tiered Librarian and a Multi-Agent Writer for Drift-Free, Point-in-Time Research

Xing Zhang, Yanwei Cui, Guanghui Wang, Peiyang He · Aug 13, 2026 · Citations: 0

Red Team Automatic Metrics General
  • We present a two-tier agentic system that separates a maintained, point-in-time knowledge library from report writing.
  • A portable multi-agent "writer" runtime then composes a contradiction-free, evidence-grounded report at any knowledge cutoff T, reading only evidence with as_of <= T (no look-ahead); red-team verdicts flow back into the librarian.
AQuA: Recursively Self-Improving Quantitative Trading Research Agents

Jiacheng Guo, Suozhi Huang, Yunlong Gao, Zihao Li, Jian Ge, Xu Kuang · Aug 13, 2026 · Citations: 0

General
  • The two systems do not share agents, memories, candidate spaces, or research state.
  • The factor system, a manager-mediated multi-agent pipeline, discovers and combines factors into a signal that reaches a combined information coefficient of about 0.190 on a crypto universe.
ERSkill: Evolving for Skill-Guided Adaptive Memory Retrieval

Haolong Chen, Liang Zhang, Zhuo Li, Lei Xue, Guanrxu Zhu · Aug 13, 2026 · Citations: 0

Automatic Metrics General
  • While Large Language Model (LLM) agents increasingly rely on long-term memory for persistent interactions, the retrieval mechanisms governing this memory are rarely treated as evolvable components.
  • Notably, it improves the overall average across F1, BLEU-1, and LLM-judge scores by 31.3\% with Qwen3-Next-80B-A3B-Instruct and by 28.1\% with GPT-5.4-nano.
One Frozen Simulator Is Not Enough: Simulator Collapse in Multi-Agent RL

Simon Yu, Nicholas Tomlin, Marwa Abdulhai, Ximing Lu, Derek Chong, Abe Hou · Aug 12, 2026 · Citations: 0

Simulation Env General
  • Multi-agent reinforcement learning for human-AI interaction typically relies on a single large language model to simulate user behavior.
  • Verbalized Sampling improves held-out success by up to 9% over single-simulator RL, and Co-Training pushes gains further to 14%; the human study shows similar gain on real users.
Learning to Persuade Exposes How Easily LLMs Abandon Correct Beliefs

Nimet Beyza Bozdag, Emre Can Acikgoz, Gokhan Tur, Dilek Hakkani-Tür · Aug 12, 2026 · Citations: 0

Automatic Metrics General
  • As LLMs increasingly debate, advise, and think collaboratively with humans and each other, resistance to harmful persuasion becomes a core requirement for reliable behavior.
  • We formalize this threat as adversarial persuasion and introduce an adversarial reinforcement learning framework that trains persuader agents to change a target model's answer in a single interaction.
Social Chain of Thought: A Multi-Agent Architecture Grounded in Medical Differential Diagnosis Methodology

Del Coburn, Scott Sanner, Dan Silver · Aug 11, 2026 · Citations: 0

Automatic Metrics Medicine
  • We introduce Social Chain of Thought (SCoT),a multi-round pipeline for medical differential diagnosis that structures multi-agent interaction as a deliberative framework for collabora.
  • Evaluating SCoT against single-agent baselines, one-agent pipeline ablations, and best-of-n scaling, we show that its recall advantage is not reproduced by monolithic inference alone.
From Reasoning Depth to Reasoning Breadth: Evaluating Multi-Point Associative Reasoning in Large Language Models

Si'an Xie, Jiaxun Liu, Biao Yang, Wei Yuan, Fan Yang, Tingting Gao · Aug 11, 2026 · Citations: 0

Automatic Metrics General
  • We introduce MPAR-Bench, a bilingual English-Chinese benchmark that isolates reasoning breadth through multi-point associative reasoning.
  • We construct 1,000 items using a multi-agent clue-generation pipeline, embedding-based diversity filtering, and human verification.
What LLM Agents Say When No One Is Watching: Social Structure and Latent Objective Emergence in Multi-Agent Debates

Arman Ghaffarizadeh, Danyal Mohaddes, Aliakbar Izadkhah, Shahriar Noroozizadeh · Jul 2, 2026 · Citations: 0

General
  • We introduce a dual-channel debate framework in which agents produce public utterances that enter the shared history alongside OTR responses that are recorded but never shown to the other participant.
  • We present a dual-channel evaluation framework and complementary behavioral measures that operationalize this assessment.
HULAT2 at MER-TRANS 2026: Governed Multi-Agent Simplification for Spanish Easy-to-Read Generation

Lourdes Moreno, Paloma Martínez, Marco Antonio Sanchez-Escudero, Miguel Domínguez-Gómez · Jul 2, 2026 · Citations: 0

Automatic Metrics Multilingual
  • RUN1 and RUN2 used a LangGraph-based multi-agent workflow combining Gemini 2.5 Flash and RigoChat-7B-v2, parallel generation strategies, internal quality signals, Event-Condition-Action routing, controlled editing and traceable decisions.
  • These results indicate that, in this task setting, signal-guided multi-agent routing outperformed the linear regeneration baseline.
Agentic generation of verifiable rules for deterministic, self-expanding reaction classification

Daniel Armstrong, Maarten Dobbelaere, Valentas Olikauskas, Helena Avila, Octavian Susanu, Jérôme Waser · Jul 1, 2026 · Citations: 0

General
  • Here we present a fully automated pipeline in which a multi-agent framework of large language models (LLMs) classifies reactions and writes the rules themselves across 665,901 US patent reactions, generating each rule under a verification…
  • It expands a standard taxonomy from 68 to 14,073 classes without human curation.
From Personas to Plot: Character-Grounded Multi-Agent Story Generation for Long-Form Narratives

Aayush Aluru, Chloe Ho, Muhammad Hammouri, Kerry Luo, Myra Malik, Ryan Lagasse · Jul 1, 2026 · Citations: 0

Pairwise PreferenceRubric Rating General
  • MAGNET, a multi-agent goal-driven narrative engine for storytelling, generates stories with persona-grounded character agents that propose actions based on a shared world state and evolving story goals, while ATLAS is a graph-based pipeline…
  • At 100 pages, MAGNET reduced annotations and hallucinations by 41 and 50%, respectively, compared to the single model baseline and by 34 and 45%, respectively, compared to IBSEN, with pairwise rubric evaluation showing similar results.
Multi-Agentic System Leveraging Open-Source LLMs to Mitigate Disinformation Threats

Sebastian Kula, Martin Tamajka · Jun 29, 2026 · Citations: 0

General
  • However, the sheer scale of the problem renders manual fact-checking and human-based verification inadequate, underscoring the necessity for automated methods to detect and debunk disinformation.
  • This article proposes a novel approach based on a multi-agent system that emulates the decision-making processes of human annotators engaged in disinformation detection tasks.
DAIN: Dynamic Agent-Based Interaction Network for Efficient and Collaborative Multimodal Reasoning

Xinxin Chen, Yuchen Li, Zihan Wang, Haoyu Zhang, Ruixin Liu, Mingyuan Zhao · Jun 29, 2026 · Citations: 0

Automatic Metrics General
  • We introduce the Dynamic Agent-based Interaction Network (DAIN), which reconceptualizes multimodal fusion as a dynamic, multi-agent collaborative process.
  • The framework is guided by a multi-objective loss function that jointly optimizes task accuracy, agent specialization, and operational efficiency through sparse activation and communication regularization.