Project: engineX-transformerBT (Jan 2025 - Present)
Created a custom Transformer model for English-to-Afaan Oromo translation, involving dataset preparation and training-related pipeline engineering. Designed tokenization and learning-rate scheduling components aligned with foundational Transformer training approaches. Contributed to NLP improvements for underrepresented African languages through model experimentation and evaluation. • Trained a Transformer from scratch in PyTorch for translation. • Implemented tokenization pipelines and a learning rate scheduler. • Built components supporting translation/localization tasks. • Worked on NLP advancement efforts for low-resource language data.