AI/LLM Analyst - Innodata
You evaluate and annotate AI and LLM-generated outputs, assessing factual accuracy, response quality, and alignment with user intent. You design and develop prompts to stress-test AI systems and identify edge cases across reasoning, perception, and language understanding. You analyze and compare model responses using structured rubrics to provide feedback that refines model behavior. • Conduct quality evaluation of AI/LLM outputs • Build prompt suites for robustness testing • Use rubrics and scoring to compare responses • Collaborate to maintain consistent quality for generative AI pipelines