M.Tech Thesis: Confidence-Aware Curriculum Knowledge Distillation for Resource-Constrained TinyML
Developed a confidence-aware knowledge distillation pipeline to train lightweight TinyML computer vision student models. Used Monte Carlo Dropout to drive an adaptive curriculum learning strategy and dynamically adjust distillation weighting during training. Optimized student model performance under strict memory and computational constraints with repeated experimentation across training runs. • Implemented confidence-aware curriculum learning using Monte Carlo Dropout • Designed dynamic loss weighting tied to confidence signals and model constraints • Trained and validated lightweight CNN students distilled from a high-capacity teacher • Measured accuracy improvements for resource-constrained TinyML deployment