PromptArmor – AI Firewall for Prompt Injection Detection
Developed an AI security system to detect and block prompt injection attacks in LLM applications. Built real-time threat-detection pipelines to identify jailbreak attempts, malicious prompts, and hidden instruction attacks. Implemented rule-based and NLP-based filtering with a risk-scoring mechanism to allow, sanitize, or block suspicious prompts before they reach the model. • Designed prompt risk analysis and classification using rule-based and NLP approaches • Implemented controls to sanitize or block high-risk prompts in secure LLM workflows • Evaluated and refined detection logic for jailbreak and hidden-instruction patterns • Built the service using a transformer-based NLP approach integrated into an API