Challenging AI Models through Complex Data Science Prompts: Adversarial Generation and Multi-Model Evaluation
Scope: The project involves generating complex data science prompts to challenge AI models until they fail. Categories include data visualization, manipulation, cleaning, feature engineering, matrix operations, statistical analysis, and model fine-tuning. Prompts are refined until they are specific and difficult enough to cause model errors. Data Labelling: Annotations cover data visualization, manipulation, cleaning, feature engineering, matrix operations, statistical analysis, and model fine-tuning, ensuring precise and accurate prompts. Size and Complexity: Large-scale project with numerous complex prompts across various data science categories, requiring advanced understanding and detailed annotations. Quality Measures: Ensures specificity and relevance of prompts, validates their complexity, continuous refinement based on model performance, peer reviews, automated checks, and regular feedback loops to maintain high standards.