AI-Powered Programmable Communications Gateway — Spring 2025
Architected an ASR post-processing engine to dynamically parse, correct, and rewrite noisy spoken transcripts into structured text formats such as emails, currency notation, and numbers. Implemented an optimized multi-candidate scoring pipeline using an INT8 quantized DistilBERT Masked-LM executed in ONNX Runtime to reduce tail latency. Engineered batched pseudo-likelihood ranking to score candidate token sequences efficiently and bypass CPU bottlenecks. • Built transcript parsing and rewrite rules for structured outputs • Ran vectorized multi-candidate scoring with ONNX Runtime and DistilBERT • Implemented batched pseudo-likelihood token sequence ranking • Deployed regex-based threshold short-circuiting for high-confidence matches