OpenTrain AI
No verified implementation yetPyTorch Adam optimizer docsPretrained Models Available

Arcee Trinity Large Technical Report

Varun Singh, Lucas Krauss, Sami Jaghouar, Matej Sirovatka, Charles Goddard +21 more

February 19, 2026arXiv: 2602.17004
0 repos~a few days to reproduce
arXiv PDF

Abstract

We present the technical report for Arcee Trinity Large, a sparse Mixture-of-Experts model with 400B total parameters and 13B activated per token. Additionally, we report on Trinity Nano and Trinity Mini, with Trinity Nano having 6B total parameters with 1B activated per token, Trinity Mini having 26B total parameters with 3B activated per token. The models' modern architecture includes interleaved local and global a...

Results & Benchmarks

TaskDatasetMetricValue
TransformerC4 (zh) C/TDeepSeek R11.54

Hardware Requirements

  • Expect multi-day setup/compute for meaningful reproduction based on current guidance.

Best Implementation

Maintained implementation evidence is not confirmed for this paper yet.

Use the Implementation Status and Reproduction Path sections below for the current action plan.

Reproduction Path

Follow this baseline workflow to decide if this paper is worth immediate prototyping.

  1. 1

    No maintained paper-verified implementation was found; start with the closest related repositories below.

  2. 2

    Compare repo methods against the paper equations/algorithm before trusting metrics.

  3. 3

    Create a minimal baseline implementation from the paper and use adjacent repos as references.

Framework baselines

Time to first repro: a few daysAdjacent implementations are not paper-verifiedRecommended repository is adjacent and not paper-verified.

Related Implementations

These are not paper-verified. Use them as reference points when no direct implementation is available.

Additional Implementations

No additional verified repositories beyond the primary recommendation.

Hugging Face Artifacts

No direct paper-linked artifacts were found. Showing strongest curated related artifacts.

Curated Related

Research Context