Precision Metric Papers

Research Utility Snapshot

Top Papers Reporting This Metric

• Dynamic Personality Adaptation in Large Language Models via State Machines

  Leon Pielage, Ole Hätscher, Mitja Back, Bernhard Marschall, Benjamin Risse · Feb 25, 2026

  Simulation Env Medicine

  This work demonstrates the feasibility of modular, personality-adaptive architectures for education, customer support, and broader human-computer interaction.

• Small Language Models for Privacy-Preserving Clinical Information Extraction in Low-Resource Languages

  Mohammadreza Ghaffarzadeh-Esfahani, Nahid Yousefian, Ebrahim Heidari-Farsani, Ali Akbar Omidvarian, Sepehr Ghahraei · Feb 24, 2026

  Automatic Metrics MedicineMultilingual

  Extracting clinical information from medical transcripts in low-resource languages remains a significant challenge in healthcare natural language processing (NLP).

• An Expert Schema for Evaluating Large Language Model Errors in Scholarly Question-Answering Systems

  Anna Martin-Boyle, William Humphreys, Martha Brown, Cara Leckey, Harmanpreet Kaur · Feb 24, 2026

  Automatic Metrics General

  Current evaluation metrics for testing LLM reliability are primarily automated approaches that prioritize efficiency and scalability, but lack contextual nuance and fail to reflect how scientific domain experts assess LLM outputs in practic

• OrthoDiffusion: A Generalizable Multi-Task Diffusion Foundation Model for Musculoskeletal MRI Interpretation

  Tian Lan, Lei Xu, Zimu Yuan, Shanggui Liu, Jiajun Liu · Feb 24, 2026

  Automatic Metrics Medicine

  Our evaluation demonstrates that OrthoDiffusion achieves excellent performance in the segmentation of 11 knee structures and the detection of 8 knee abnormalities.

• Voices of the Mountains: Deep Learning-Based Vocal Error Detection System for Kurdish Maqams

  Darvan Shvan Khairaldeen, Hossein Hassani · Feb 24, 2026

  Automatic Metrics General

  On the full 50-song evaluation at a 0.750 threshold, recall was 39.4% and precision 25.8% .

• Case-Aware LLM-as-a-Judge Evaluation for Enterprise-Scale RAG Systems

  Mukul Chhabra, Luigi Medrano, Arush Verma · Feb 23, 2026

  Automatic Metrics Coding

  Enterprise Retrieval-Augmented Generation (RAG) assistants operate in multi-turn, case-based workflows such as technical support and IT operations, where evaluation must reflect operational constraints, structured identifiers (e.g., error c

• An artificial intelligence framework for end-to-end rare disease phenotyping from clinical notes using large language models

  Cathy Shyr, Yan Hu, Rory J. Tinker, Thomas A. Cassini, Kevin W. Byram · Feb 23, 2026

  Automatic Metrics Medicine

  Existing artificial intelligence approaches typically optimize individual components of phenotyping but do not operationalize the full clinical workflow of extracting features from clinical text, standardizing them to Human Phenotype Ontolo

• Nacrith: Neural Lossless Compression via Ensemble Context Modeling and High-Precision CDF Coding

  Roberto Tacconelli · Feb 23, 2026

  Automatic Metrics Coding

  An out-of-distribution (OOD) evaluation on a document published after the model's training cutoff confirms these gains are not memorization artifacts, achieving 0.723 bpb on unseen text.

• Pyramid MoA: A Probabilistic Framework for Cost-Optimized Anytime Inference

  Arindam Khaled · Feb 23, 2026

  Automatic Metrics Math

  In this work, we propose "Pyramid MoA", a hierarchical Mixture-of-Agents architecture that uses a lightweight Router to dynamically escalate queries only when necessary.

• PerSoMed: A Large-Scale Balanced Dataset for Persian Social Media Text Classification

  Isun Chehreh, Ebrahim Ansari · Feb 22, 2026

  Automatic Metrics General

  Data collection involved 60,000 raw posts from various Persian social media platforms, followed by rigorous preprocessing and hybrid annotation combining ChatGPT-based few-shot prompting with human verification.

• TriTopic: Tri-Modal Graph-Based Topic Modeling with Iterative Refinement and Archetypes

  Roman Egger · Feb 22, 2026

  Automatic Metrics General

  In benchmarks across 20 Newsgroups, BBC News, AG News, and Arxiv, TriTopic achieves the highest NMI on every dataset (mean NMI 0.575 vs.

• MoBiQuant: Mixture-of-Bits Quantization for Token-Adaptive Elastic LLMs

  Dongwei Wang, Jinhee Kim, Seokho Han, Denis Gudovskiy, Yohei Nakata · Feb 21, 2026

  Automatic Metrics General

  Changing runtime complexity on cloud and edge devices necessitates elastic large language model (LLM) deployment, where an LLM can be inferred with various quantization precisions based on available computational resources.

• Why Agent Caching Fails and How to Fix It: Structured Intent Canonicalization with Few-Shot Learning

  Abhinaba Basu · Feb 21, 2026

  Automatic Metrics Multilingual

  Personal AI agents incur substantial cost via repeated LLM calls.

• AAVGen: Precision Engineering of Adeno-associated Viral Capsids for Renal Selective Targeting

  Mohammadreza Ghaffarzadeh-Esfahani, Yousof Gheisari · Feb 21, 2026

  Automatic Metrics General

  Adeno-associated viruses (AAVs) are promising vectors for gene therapy, but their native serotypes face limitations in tissue tropism, immune evasion, and production efficiency.

• The Convergence of Schema-Guided Dialogue Systems and the Model Context Protocol

  Andreas Schlapbach · Feb 21, 2026

  Automatic Metrics Coding

  This paper establishes a fundamental convergence: Schema-Guided Dialogue (SGD) and the Model Context Protocol (MCP) represent two manifestations of a unified paradigm for deterministic, auditable LLM-agent interaction.

• Context-Aware Mapping of 2D Drawing Annotations to 3D CAD Features Using LLM-Assisted Reasoning for Manufacturing Automation

  Muhammad Tayyab Khan, Lequn Chen, Wenhe Feng, Seung Ki Moon · Feb 20, 2026

  Automatic MetricsSimulation Env General

  When deterministic scoring cannot resolve an ambiguity, the system escalates to multimodal and constrained large-language-model reasoning, followed by a single human-in-the-loop (HITL) review step.

• CUICurate: A GraphRAG-based Framework for Automated Clinical Concept Curation for NLP applications

  Victoria Blake, Mathew Miller, Jamie Novak, Sze-yuan Ooi, Blanca Gallego · Feb 20, 2026

  Automatic Metrics Medicine

  The framework was evaluated on five lexically heterogeneous clinical concepts against a manually curated benchmark and gold-standard concept sets.

• The Anxiety of Influence: Bloom Filters in Transformer Attention Heads

  Peter Balogh · Feb 19, 2026

  Automatic Metrics General

  Some transformer attention heads appear to function as membership testers, dedicating themselves to answering the question "has this token appeared before in the context?" We identify these heads across four language models (GPT-2 small, me

• Evaluating Extremely Low-Resource Machine Translation: A Comparative Study of ChrF++ and BLEU Metrics

  Sanjeev Kumar, Preethi Jyothi, Pushpak Bhattacharyya · Feb 19, 2026

  Automatic Metrics Multilingual

  This work presents a comparative analysis of BLEU, an n-gram-based metric, and ChrF++, a character-based metric, for MT evaluation in ELRL settings.

• Quecto-V1: Empirical Analysis of 8-bit Quantized Small Language Models for On-Device Legal Retrieval

  Subrit Dikshit · Feb 18, 2026

  Automatic MetricsSimulation Env LawCoding

  The rapid proliferation of Large Language Models (LLMs) has revolutionized Natural Language Processing (NLP) but has simultaneously created a "resource divide." State-of-the-art legal intelligence systems typically rely on massive parameter

• PREFER: An Ontology for the PREcision FERmentation Community

  Txell Amigó, Shawn Zheng Kai Tan, Angel Luu Phanthanourak, Sebastian Schulz, Pasquale D. Colaianni · Feb 18, 2026

  Automatic Metrics General

  Precision fermentation relies on microbial cell factories to produce sustainable food, pharmaceuticals, chemicals, and biofuels.

• CGRA-DeBERTa Concept Guided Residual Augmentation Transformer for Theologically Islamic Understanding

  Tahir Hussain, Saddam Hussain Khan · Feb 16, 2026

  Automatic Metrics General

  The qualitative evaluation noted better extraction and discrimination and theological precision.

• OpenLID-v3: Improving the Precision of Closely Related Language Identification -- An Experience Report

  Mariia Fedorova, Nikolay Arefyev, Maja Buljan, Jindřich Helcl, Stephan Oepen · Feb 13, 2026

  Automatic Metrics Multilingual

  We call this extended system OpenLID-v3 and evaluate it against GlotLID on multiple benchmarks.

• Unleashing Low-Bit Inference on Ascend NPUs: A Comprehensive Evaluation of HiFloat Formats

  Pengxiang Zhao, Hui-Ling Zhen, Xing Li, Han Bao, Weizhe Lin · Feb 13, 2026

  Automatic Metrics General

  As LLMs scale, low-bit floating-point formats like MXFP and NVFP4 offer new opportunities for precision and efficiency.

• WISE: Web Information Satire and Fakeness Evaluation

  Gaurab Chhetri, Subasish Das, Tausif Islam Chowdhury · Dec 30, 2025

  Automatic Metrics General

  This study develops WISE (Web Information Satire and Fakeness Evaluation) framework which benchmarks eight lightweight transformer models alongside two baseline models on a balanced dataset of 20,000 samples from Fakeddit, annotated as eith

• SciTS: Scientific Time Series Understanding and Generation with LLMs

  Wen Wu, Ziyang Zhang, Liwei Liu, Xuenan Xu, Jimin Zhuang · Sep 26, 2025

  Automatic Metrics Coding

  To address these gaps, we introduce SciTS, a benchmark spanning 12 scientific domains and 43 tasks, with over 50k+ instances, both univariate and multivariate signals ranging from $10^0$ to $10^7$ in length and up to 10~MHz in frequency.

• Unveiling Decision-Making in LLMs for Text Classification : Extraction of influential and interpretable concepts with Sparse Autoencoders

  Mathis Le Bail, Jérémie Dentan, Davide Buscaldi, Sonia Vanier · Jun 30, 2025

  Automatic Metrics Coding

  These concepts are linear combinations of neuron activations that correspond to human-interpretable features.

• Reshaping MOFs text mining with a dynamic multi-agents framework of large language model

  Zuhong Lin, Daoyuan Ren, Kai Ran, Jing Sun, Songlin Yu · Apr 26, 2025

  Automatic Metrics Coding

  Accurately identifying the synthesis conditions of metal-organic frameworks (MOFs) is essential for guiding experimental design, yet remains challenging because relevant information in the literature is often scattered, inconsistent, and di

• Pretraining Language Models for Diachronic Linguistic Change Discovery

  Elisabeth Fittschen, Sabrina Li, Tom Lippincott, Leshem Choshen, Craig Messner · Apr 7, 2025

  Automatic Metrics General

  This has engendered growing interest in their use in humanistic disciplines, such as historical linguistics and literary studies.

• Breaking the HISCO Barrier: Automatic Occupational Standardization with OccCANINE

  Christian Møller Dahl, Torben Johansen, Christian Vedel · Feb 21, 2024

  Automatic Metrics Coding

  This paper introduces OccCANINE, an open-source tool that maps occupational descriptions to HISCO codes.

• Improving Denoising Diffusion Models via Simultaneous Estimation of Image and Noise

  Zhenkai Zhang, Krista A. Ehinger, Tom Drummond · Oct 26, 2023

  Automatic Metrics Math

  This paper introduces two key contributions aimed at improving the speed and quality of images generated through inverse diffusion processes.

Other Metric Hubs