Creatium — Engineer (LLM pipeline, fine-tuning, and red-teaming for document extraction)
Engineered an LLM pipeline for document extraction on K-12 image-heavy inputs, optimizing end-to-end latency and supporting mixed upload formats. Conducted supervised fine-tuning and preference-alignment of an open-source LLM using a three-stage alignment approach to improve task performance. Deployed the trained model on Cerebrium and integrated it into a modular LLM API for production use. • Used vision LLMs for document understanding and extraction • Applied SFT→DPO→GRPO alignment with Unsloth and TRL • Implemented RAG and extraction tool routing via a lightweight orchestrator • Red-teamed guardrails using 1,100+ adversarial prompts and LLM-as-a-judge evaluation