Freelance AI Trainer & Data Annotation Specialist (Freelance AI Training, Evaluation & Domain Annotation) at DataAnnotation.tech.
Task: Based on Date of Purchase as per Fixed Assets Register, compute MACRS Depreciation for the current calendar year and Section 1231 Gains & Losses Goal: The LLM Pass % on the rubrics (that I created) to be below 70%. If LLM score is above 70%, It would mean that I did not design a complex scenario. Process: Created real-looking vendor invoices, IRS Tax Forms for previous years, real looking notarised Gift Deed, real looking valuation report of the asset etc Outcome: On 3 different runs, the mean score of thje LLM was 50%, much bellow the targeted 70% rate.