F1 Metric Papers

Research Utility Snapshot

Top Papers Reporting This Metric

• Distill and Align Decomposition for Enhanced Claim Verification

  Jabez Magomere, Elena Kochkina, Samuel Mensah, Simerjot Kaur, Fernando Acero · Feb 25, 2026

  Human EvalAutomatic Metrics General

  Across six evaluation settings, our trained 8B decomposer improves downstream verification performance to (71.75%) macro-F1, outperforming prompt-based approaches ((+1.99), (+6.24)) and existing RL methods ((+5.84)).

• Multi-dimensional Assessment and Explainable Feedback for Counselor Responses to Client Resistance in Text-based Counseling with LLMs

  Anqi Li, Ruihan Wang, Zhaoming Chen, Yuqian Chen, Yu Lu · Feb 25, 2026

  Automatic Metrics Medicine

  Although current NLP research has examined overall counseling quality and general therapeutic skills, it fails to provide granular evaluations of high-stakes moments where clients exhibit resistance.

• MixSarc: A Bangla-English Code-Mixed Corpus for Implicit Meaning Identification

  Kazi Samin Yasar Alam, Md Tanbir Chowdhury, Tamim Ahmed, Ajwad Abrar, Md Rafid Haque · Feb 25, 2026

  Human EvalAutomatic Metrics Coding

  We benchmark transformer-based models and evaluate zero-shot large language models under structured prompting.

• Small Language Models for Privacy-Preserving Clinical Information Extraction in Low-Resource Languages

  Mohammadreza Ghaffarzadeh-Esfahani, Nahid Yousefian, Ebrahim Heidari-Farsani, Ali Akbar Omidvarian, Sepehr Ghahraei · Feb 24, 2026

  Automatic Metrics MedicineMultilingual

  Extracting clinical information from medical transcripts in low-resource languages remains a significant challenge in healthcare natural language processing (NLP).

• PVminer: A Domain-Specific Tool to Detect the Patient Voice in Patient Generated Data

  Samah Fodeh, Linhai Ma, Yan Wang, Srivani Talakokkul, Ganesh Puthiaraju · Feb 24, 2026

  Automatic Metrics MedicineCoding

  Patient-generated text such as secure messages, surveys, and interviews contains rich expressions of the patient voice (PV), reflecting communicative behaviors and social determinants of health (SDoH).

• A Benchmark for Deep Information Synthesis

  Debjit Paul, Daniel Murphy, Milan Gritta, Ronald Cardenas, Victor Prokhorov · Feb 24, 2026

  Human EvalAutomatic Metrics Coding

  Large language model (LLM)-based agents are increasingly used to solve complex tasks involving tool use, such as web browsing, code execution, and data analysis.

• Prompt-Level Distillation: A Non-Parametric Alternative to Model Fine-Tuning for Efficient Reasoning

  Sanket Badhe, Deep Shah · Feb 24, 2026

  Automatic Metrics Law

  These expressive instructions render the decision-making process transparent, allowing for full human verification of logic, making this approach ideal for regulated industries such as law, finance, and content moderation, as well as high-v

• Voices of the Mountains: Deep Learning-Based Vocal Error Detection System for Kurdish Maqams

  Darvan Shvan Khairaldeen, Hossein Hassani · Feb 24, 2026

  Automatic Metrics General

  On the full 50-song evaluation at a 0.750 threshold, recall was 39.4% and precision 25.8% .

• An artificial intelligence framework for end-to-end rare disease phenotyping from clinical notes using large language models

  Cathy Shyr, Yan Hu, Rory J. Tinker, Thomas A. Cassini, Kevin W. Byram · Feb 23, 2026

  Automatic Metrics Medicine

  Existing artificial intelligence approaches typically optimize individual components of phenotyping but do not operationalize the full clinical workflow of extracting features from clinical text, standardizing them to Human Phenotype Ontolo

• How to Train Your Deep Research Agent? Prompt, Reward, and Policy Optimization in Search-R1

  Yinuo Xu, Shuo Lu, Jianjie Cheng, Meng Wang, Qianlong Xie · Feb 23, 2026

  Automatic Metrics General

  Deep Research agents tackle knowledge-intensive tasks through multi-round retrieval and decision-oriented generation.

• Personalized Prediction of Perceived Message Effectiveness Using Large Language Model Based Digital Twins

  Jasmin Han, Janardan Devkota, Joseph Waring, Amanda Luken, Felix Naughton · Feb 23, 2026

  Automatic Metrics General

  Perceived message effectiveness (PME) by potential intervention end-users is important for selecting and optimizing personalized smoking cessation intervention messages for mobile health (mHealth) platform delivery.

• PerSoMed: A Large-Scale Balanced Dataset for Persian Social Media Text Classification

  Isun Chehreh, Ebrahim Ansari · Feb 22, 2026

  Automatic Metrics General

  Data collection involved 60,000 raw posts from various Persian social media platforms, followed by rigorous preprocessing and hybrid annotation combining ChatGPT-based few-shot prompting with human verification.

• Retrieval Augmented Enhanced Dual Co-Attention Framework for Target Aware Multimodal Bengali Hateful Meme Detection

  Raihan Tanvir, Md. Golam Rabiul Alam · Feb 22, 2026

  Automatic Metrics CodingMultilingual

  Hateful content on social media increasingly appears as multimodal memes that combine images and text to convey harmful narratives.

• Vichara: Appellate Judgment Prediction and Explanation for the Indian Judicial System

  Pavithra PM Nair, Preethu Rose Anish · Feb 20, 2026

  Human EvalAutomatic Metrics Law

  Vichara surpasses existing judgment prediction benchmarks on both datasets, with GPT-4o mini achieving the highest performance (F1: 81.5 on PredEx, 80.3 on ILDC_expert), followed by Llama-3.1-8B.

• Context-Aware Mapping of 2D Drawing Annotations to 3D CAD Features Using LLM-Assisted Reasoning for Manufacturing Automation

  Muhammad Tayyab Khan, Lequn Chen, Wenhe Feng, Seung Ki Moon · Feb 20, 2026

  Automatic MetricsSimulation Env General

  When deterministic scoring cannot resolve an ambiguity, the system escalates to multimodal and constrained large-language-model reasoning, followed by a single human-in-the-loop (HITL) review step.

• Click it or Leave it: Detecting and Spoiling Clickbait with Informativeness Measures and Large Language Models

  Wojciech Michaluk, Tymoteusz Urban, Mateusz Kubita, Soveatin Kuntur, Anna Wroblewska · Feb 20, 2026

  Automatic Metrics Coding

  Clickbait headlines degrade the quality of online information and undermine user trust.

• Utility-Preserving De-Identification for Math Tutoring: Investigating Numeric Ambiguity in the MathEd-PII Benchmark Dataset

  Zhuqian Zhou, Kirk Vanacore, Bakhtawar Ahtisham, Jinsook Lee, Doug Pietrzak · Feb 18, 2026

  Automatic Metrics Math

  To address this challenge, we investigate the "numeric ambiguity" problem and introduce MathEd-PII, the first benchmark dataset for PII detection in math tutoring dialogues, created through a human-in-the-loop LLM workflow that audits upstr

• Enhancing Building Semantics Preservation in AI Model Training with Large Language Model Encodings

  Suhyung Jang, Ghang Lee, Jaekun Lee, Hyunjun Lee · Feb 17, 2026

  Automatic Metrics General

  Accurate representation of building semantics, encompassing both generic object types and specific subtypes, is essential for effective AI model training in the architecture, engineering, construction, and operation (AECO) industry.

• Extracting Consumer Insight from Text: A Large Language Model Approach to Emotion and Evaluation Measurement

  Stephan Ludwig, Peter J. Danaher, Xiaohao Yang, Yu-Ting Lin, Ehsan Abedin · Feb 17, 2026

  Automatic Metrics Coding

  Accurately measuring consumer emotions and evaluations from unstructured text remains a core challenge for marketing research and practice.

• A Geometric Analysis of Small-sized Language Model Hallucinations

  Emanuele Ricco, Elia Onofri, Lorenzo Cima, Stefano Cresci, Roberto Di Pietro · Feb 16, 2026

  Automatic Metrics General

  Hallucinations -- fluent but factually incorrect responses -- pose a major challenge to the reliability of language models, especially in multi-step or agentic settings.

• Curriculum Learning and Pseudo-Labeling Improve the Generalization of Multi-Label Arabic Dialect Identification Models

  Ali Mekky, Mohamed El Zeftawy, Lara Hassan, Amr Keleg, Preslav Nakov · Feb 12, 2026

  Automatic Metrics Coding

  Being modeled as a single-label classification task for a long time, recent work has argued that Arabic Dialect Identification (ADI) should be framed as a multi-label classification task.

• Human Values in a Single Sentence: Moral Presence, Hierarchies, and Transformer Ensembles on the Schwartz Continuum

  Víctor Yeste, Paolo Rosso · Jan 20, 2026

  Automatic Metrics Coding

  We study sentence-level detection of the 19 human values in the refined Schwartz continuum in about 74k English sentences from news and political manifestos (ValueEval'24 corpus).

• Event Detection with a Context-Aware Encoder and LoRA for Improved Performance on Long-Tailed Classes

  Abdullah Al Monsur, Nitesh Vamshi Bommisetty, Gene Louis Kim · Jan 17, 2026

  Automatic Metrics Coding

  The current state of event detection research has two notable re-occurring limitations that we investigate in this study.

• CAST: Character-and-Scene Episodic Memory for Agents

  Kexin Ma, Bojun Li, Yuhua Tang, Liting Sun, Ruochun Jin · Jan 14, 2026

  Automatic Metrics General

  Episodic memory is a central component of human memory, which refers to the ability to recall coherent events grounded in who, when, and where.

• WISE: Web Information Satire and Fakeness Evaluation

  Gaurab Chhetri, Subasish Das, Tausif Islam Chowdhury · Dec 30, 2025

  Automatic Metrics General

  This study develops WISE (Web Information Satire and Fakeness Evaluation) framework which benchmarks eight lightweight transformer models alongside two baseline models on a balanced dataset of 20,000 samples from Fakeddit, annotated as eith

• PRoH: Dynamic Planning and Reasoning over Knowledge Hypergraphs for Retrieval-Augmented Generation

  Xiangjun Zai, Xingyu Tan, Xiaoyang Wang, Qing Liu, Xiwei Xu · Oct 14, 2025

  Automatic Metrics General

  Experiments across multiple domains demonstrate that PRoH achieves state-of-the-art performance, surpassing the prior SOTA model HyperGraphRAG by an average of 19.73% in F1 and 8.41% in Generation Evaluation (G-E) score, while maintaining s

• Peeking inside the Black-Box: Reinforcement Learning for Explainable and Accurate Relation Extraction

  Xinyu Guo, Zhengliang Shi, Minglai Yang, Mahdi Rahimi, Mihai Surdeanu · Oct 7, 2025

  Human EvalAutomatic Metrics General

  Finally, human evaluation shows that our best model generates relational keywords closely aligned with gold labels, increasing human explanation quality ratings by 54% (relative).

• Hybrid Deep Searcher: Scalable Parallel and Sequential Search Reasoning

  Dayoon Ko, Jihyuk Kim, Haeju Park, Sohyeon Kim, Dahyun Lee · Aug 26, 2025

  Automatic Metrics General

  Large reasoning models (LRMs) combined with retrieval-augmented generation (RAG) have enabled deep research agents capable of multi-step reasoning with external knowledge retrieval.

• Persona-driven Simulation of Voting Behavior in the European Parliament with Large Language Models

  Maximilian Kreutner, Marlene Lutz, Markus Strohmaier · Jun 13, 2025

  Automatic MetricsSimulation Env Coding

  Large Language Models (LLMs) display remarkable capabilities to understand or even produce political discourse but have been found to consistently exhibit a progressive left-leaning bias.

• EmoGRACE: Aspect-based emotion analysis for social media data

  Christina Zorenböhmer, Sebastian Schmidt, Bernd Resch · Mar 19, 2025

  Automatic Metrics General

  While sentiment analysis has advanced from sentence to aspect-level, i.e., the identification of concrete terms related to a sentiment, the equivalent field of Aspect-based Emotion Analysis (ABEA) is faced with dataset bottlenecks and the i

• Glycemic-Aware and Architecture-Agnostic Training Framework for Blood Glucose Forecasting in Type 1 Diabetes

  Saman Khamesian, Asiful Arefeen, Maria Adela Grando, Bithika M. Thompson, Hassan Ghasemzadeh · Feb 20, 2025

  Automatic Metrics Medicine

  Managing Type 1 Diabetes (T1D) demands constant vigilance as individuals strive to regulate their blood glucose levels and avoid dysglycemia, including hyperglycemia and hypoglycemia.

• Just KIDDIN: Knowledge Infusion and Distillation for Detection of INdecent Memes

  Rahul Garg, Trilok Padhi, Hemang Jain, Ugur Kursuncu, Ponnurangam Kumaraguru · Nov 19, 2024

  Automatic MetricsSimulation Env General

  Experimental results from our study on two hate speech benchmark datasets demonstrate superior performance over the state-of-the-art baselines across AU-ROC, F1, and Recall with improvements of 1.1%, 7%, and 35%, respectively.

Other Metric Hubs