Analyst / Business Analyst (AI evaluation/data quality oriented work) | Open Capital Advisors | Kenya & East Africa
Evaluated complex, ambiguous datasets and compared outputs using consistent, defensible criteria aligned with AI model evaluation workflows. Performed rubric-based assessment, error taxonomy development, and quality drift monitoring to ensure reliable labeling decisions. Maintained traceability and reproducibility so evaluation outcomes were auditable and repeatable across iterations. • Rubric-based output comparison and side-by-side evaluation • Prompt/criteria analysis to identify ambiguities and propose refinements • Error pattern taxonomy and systematic flagging • Gold-example creation with justification documentation