AI response evaluation
During this evaluation you will be presented with a prompt used to ask general questions to AI models. You will also be provided with 3 different AI model responses to each prompt. The job is to evaluate each of the 3 model responses and to judge which AI model response is best. The best response is rated on 6 individual dimensions plus an overall rating. The dimensions are as follows: Instruction Following: How well the model response adhered to prompt requirements. Truthfulness: Factual correctness and completeness of the model response. Correctness: Whether the technical claims and reasoning in the model response is logically sound. Writing Quality: Whether the AI model response was delivered in a useful, digestible way. Verbosity: How well you liked the length / chattiness of the model’s response. Overall Quality: Your holistic assessment of how well the model response is considering all dimensions.