Cybersecurity Researcher & Lab Architect (Independent/Academic) — preparing rubric-driven RLHF/red-teaming evaluations
Developed and operated a virtual cybersecurity lab to simulate network attack scenarios for accurate, rubric-based evaluation of LLM outputs in adversarial contexts. Produced structured threat documentation and workflow reports that support consistent annotation judgments across high-volume cybersecurity datasets. Applied research on fraud and identity theft methods to assess whether AI-generated security guidance is accurate, safe, or harmful. • Simulated attack and manipulation scenarios relevant to adversarial LLM testing • Produced documentation to standardize evaluations and labeling criteria • Assessed harmfulness and safety of AI-generated cybersecurity content • Supports red-teaming prompt/response evaluation using domain expertise