Context-Aware PII and Entity Annotation for LLM Privacy Gateways
Engineered and curated a high-quality, fine-grained NER dataset designed to train token-classification models (such as GLiNER and Qwen architectures) for zero-trust AI prompt sanitization. The core objective was the precise identification, annotation, and redaction of complex Named Entities and Personally Identifiable Information (PII) embedded within diverse, unstructured user prompts. Key Responsibilities & Methodology: Schema Design & Annotation: Developed and executed a rigorous labeling schema spanning standard entities (Names, Locations, Organizations) and complex technical entities (API keys, cryptographic hashes, IP addresses, proprietary source code snippets, and financial metadata). Context-Aware Disambiguation: Resolved edge cases where overlapping entities existed, ensuring the model could differentiate between benign technical prose and sensitive data leak risks based on surrounding context. Quality Assurance & Benchmarking: Conducted iterative data auditing and conflict resolution to maintain a high Inter-Annotator Agreement (IAA) score. Used the labeled dataset to benchmark downstream token-classification models, ensuring robust generalization and minimal false-positive rates in automated data redaction.