OpenTrain AI
Historical implementation onlynone

On the Multilingual Capabilities of Very Large-Scale English Language Models

August 1, 2021arXiv: 2108.13349
1 repo~a few days to reproduce
arXiv PDF

Abstract

Results & Benchmarks

TaskDatasetMetricValue
Natural language processingGPT-3: AdaF15.26
Natural language processingGPT-3: BabbageF110.08
Natural language processingGPT-3: CurieF116.66

Hardware Requirements

  • Expect multi-day setup/compute for meaningful reproduction based on current guidance.

Best Implementation

Only a historical official implementation is available.

Use with caution for new projects; verify against current tooling and maintained community alternatives.

temu-bsc/gpt3-queries
Historical officialStars: 0
  • Only historical official repository was found: temu-bsc/gpt3-queries.
  • No maintained paper-verified implementation met reliability thresholds.

Reproduction Path

  1. 1

    No maintained paper-verified implementation was found; start with the closest related repositories below.

  2. 2

    Compare repo methods against the paper equations/algorithm before trusting metrics.

  3. 3

    Create a minimal baseline implementation from the paper and use adjacent repos as references.

Time to first repro: a few daysAdjacent implementations are not paper-verifiedRecommended repository is adjacent and not paper-verified.Adjacent implementation match confidence is low.No direct maintained implementation is currently verified.

Related Implementations

These are not paper-verified. Use them as reference points when no direct implementation is available.

Additional Implementations

No additional verified repositories beyond the primary recommendation.

Hugging Face Artifacts

No trustworthy direct or curated related Hugging Face artifacts were found yet.