AI Data Annotator & Code Evaluator (Python code assessment and RLHF-style evaluation)
Evaluated and ranked AI-generated code responses for correctness, quality, and instruction-following accuracy using DataAnnotation platform rubrics. Labeled structured text data and authored written rationales to justify model response quality judgments. Applied software engineering expertise to detect subtle logic errors, edge cases, and code style issues, including hallucinated or off-topic outputs.• Compared two model outputs in an RLHF-style preference evaluation and selected the better response• Checked adherence to user instructions and prompt requirements as part of instruction-following evaluation• Assessed code for completeness, clarity, and correctness across Python-related tasks• Wrote consistent, guideline-aligned feedback using provided rubric criteria