Free Lunch for Few-shot Learning: Distribution Calibration
Shuo Yang, Lu Liu, Min Xu
Paper appears method- or tooling-adjacent to AI workflows with partial ecosystem coverage.
Learning from a limited number of samples is challenging since the learned model can easily become overfitted based on the biased distribution formed by only a few training examples. In this paper, we calibrate the distribution of these few-sample classes by transferring statistics from the classes with sufficient examples, then an adequate number of examples can be sampled from the calibrated distribution to expand ...
the inputs to the classifier. We assume every dimension in the feature representation follows a Gaussian distribution so that the mean and the variance of the distribution can borrow from that of similar classes whose statistics are better estimated with an adequate number of samples. Our method can be built on top of off-the-shelf pretrained feature extractors and classification models without extra parameters. We show that a simple logistic regression classifier trained using the features sampled from our calibrated distribution can outperform the state-of-the-art accuracy on two datasets (~5% improvement on miniImageNet compared to the next best). The visualization of these generated features demonstrates that our calibrated distribution is an accurate estimation.
Results & Benchmarks
No concrete benchmark grounding is available yet. Treat the page as context or an implementation starting point only.
Learning from a limited number of samples is challenging since the learned model can easily become overfitted based on the biased distribution formed by only a few training examples.
Implementation Evidence Summary
ShuoYang-1998/Few_Shot_Distribution_Calibration is the closest maintained adjacent implementation (Strong overlap with paper title keywords). It is not paper-verified; validate algorithm and evaluation setup against the paper before trusting reported metrics. Community adoption signal: 475 GitHub stars.
Reproduction Risks
- Adjacent implementations are not paper-verified
- Recommended repository is adjacent and not paper-verified.
- Adjacent implementation match confidence is low.
Hardware Notes
Expect multi-day setup/compute for meaningful reproduction based on current guidance.
Evidence disclosure
Evidence graph: 3 refs, 3 links.
Utility signals: depth 70/100, grounding 75/100, status medium.
Implementation Status
There is no verified maintained implementation yet. Use this baseline plan to decide whether to prototype now or defer.
- No maintained paper-verified implementation was found; start with the closest related repositories below.
- Compare repo methods against the paper equations/algorithm before trusting metrics.
- Create a minimal baseline implementation from the paper and use adjacent repos as references.
Reproduction readiness
Hardware requirements
- Expect multi-day setup/compute for meaningful reproduction based on current guidance.
No verified implementation available
- · No maintained repository has been identified for this paper. Check adjacent implementations or HF artifacts below.
No benchmark numbers could be verified. You will not be able to validate reproduction correctness against published numbers.
Closest related implementations
These are not paper-verified. Use them as reference points when no direct implementation is available.
- ShuoYang-1998/Few_Shot_Distribution_CalibrationAdjacentConfidence: LowStars: 475
Strong overlap with paper title keywords
Hugging Face artifacts
No trustworthy direct or curated related Hugging Face artifacts were found yet.
Continue with targeted Hugging Face searches derived from the paper title and method context:
Datasets
Spaces
Tip: start with models, then check datasets/spaces if you need evaluation data or demos.
Direct artifact matches are currently sparse. Use targeted Hugging Face searches to quickly locate candidate models, datasets, and demos.
Research context
174
Citations
34
References
Tasks
Classifier (UML), Computer science, Pattern recognition (psychology), Calibration, Variance (accounting), Gaussian, Feature (linguistics), Statistics
Methods
None detected
Domains
Artificial intelligence, Machine learning, Mathematics
Evaluation & Human Feedback Data
Open this paper in HFEPX to review benchmark signals, evaluation modes, and human-feedback protocol context.
Open in HFEPXExplore Similar Papers
Jump to Paper2Code search queries derived from this paper's research context.
Related papers
-
Search on Paper2Code
Avoidance of Feature Interactions at Run-Time (2006) Semantic similarity
-
Search on Paper2Code
Observed feature PlZPZ correspondkto model feature BOTTOM-SIDE In the model Observed feature P5-P6 corresponds to model feature TOP-FACE In the model Observed feature P4-P5 couesponds to model feature TOP-SIDE Observed feature P3-Pfi* corresponds to model feature SIDE-FACE-B In the model In the model (1987) Semantic similarity
-
Search on Paper2Code
Avoidance of Feature Interactions at Run-Time (2006) Semantic similarity
-
Search on Paper2Code
Automobile Form Feature and Feature Line (2007) Semantic similarity
-
Search on Paper2Code
Accurate roughness measurements by dynamic calibration, VFM-uncertainty calculations and a special calibration specimen (2005) Semantic similarity
-
Search on Paper2Code
Application Study on Feature Modeling for Box Part (2008) Semantic similarity
Need human evaluators for your AI research? Scale annotation with expert AI Trainers.