Kairos — AI-Powered Intelligent Calendar Web App (LLM extraction, ambiguity resolution, and evaluation feedback collection)
Developed an AI-integrated pipeline to extract structured calendar event data from free-form text, using LLM JSON mode and tool calling with regex fallback and confidence-scored outputs. Designed an ambiguity resolver to collect explicit accept/modify/reject feedback and support an inter-annotator-style review flow. Implemented and documented failure modes such as hallucinated dates, over-refusal on ambiguous input, and confidence miscalibration to inform preference-ranking and evaluation practices. • Ingested user text and produced structured event fields with confidence scoring • Collected user feedback (accept/modify/reject) per extracted event • Logged model/user interaction metadata to PostgreSQL for quality analysis • Built an agent dialogue system with tool definitions and SSE streaming for step-wise reasoning visualization