Text Annotation Quality Checker (AI training readiness)
Developed a text annotation quality-control utility to validate annotation fields and enforce label consistency. Detected missing annotation fields, unsupported labels, and duplicate record IDs to improve dataset reliability. Measured inter-annotator agreement for shared task IDs to monitor consistency. • Validated required fields and schema compliance • Flagged unsupported labels and duplicate record identifiers • Computed exact inter-annotator agreement for shared items • Confirmed validation and agreement logic with unit tests