Conduct comprehensive security verification of AI-driven applications using the OWASP AI Security Verification Standard (AISVS) framework's 13-category structured checklist. Follow the full procedure in plays/ai-security-verification.md.
Steps
-
Training Data Governance & Bias Management — Assess data quality, provenance, bias detection, and governance controls throughout the data lifecycle.
-
User Input Validation — Evaluate input sanitization, prompt injection defenses, adversarial input detection, and boundary validation mechanisms.
-
Model Lifecycle Management & Change Control — Review model versioning, deployment controls, rollback capabilities, and change management processes.
-
Infrastructure, Configuration & Deployment Security — Examine deployment security, container hardening, network controls, and infrastructure configuration.
-
Access Control & Identity — Verify authentication mechanisms, authorization controls, privilege management, and identity governance.
-
Supply Chain Security for Models, Frameworks & Data — Assess third-party model security, dependency management, and supply chain integrity.
-
Model Behavior, Output Control & Safety Assurance — Evaluate output validation, safety guardrails, behavior monitoring, and harmful content prevention.
-
Memory, Embeddings & Vector Database Security — Review vector database security, embedding protection, memory isolation, and context management.
-
Autonomous Orchestration & Agentic Action Security — Assess agent coordination security, tool access controls, and autonomous decision-making safeguards.
-
Adversarial Robustness & Attack Resistance — Test resilience against adversarial examples, evasion attacks, and model extraction attempts.
-
Privacy Protection & Personal Data Management — Verify privacy controls, data minimization, consent management, and regulatory compliance.
-
Monitoring, Logging & Anomaly Detection — Evaluate security monitoring, audit logging, anomaly detection, and incident response capabilities.
-
Human Oversight and Trust — Assess human-in-the-loop controls, explainability mechanisms, and trust calibration measures.
Output
Use the finding format from templates/finding.md. Produce:
- AISVS Compliance Assessment — Verification status across all 13 categories
- Security Control Evaluation — Detailed analysis of implemented controls
- Gap Analysis — Missing or inadequate security measures
- Risk-Based Prioritization — Critical findings requiring immediate attention
- Compliance Roadmap — Structured plan to achieve AISVS compliance
- Verification Evidence — Documentation supporting compliance claims
OWASP References
- OWASP AI Security Verification Standard (AISVS)
- OWASP Top 10 for LLM Applications 2025
- OWASP AI Security and Privacy Guide
- OWASP Application Security Verification Standard (ASVS)
- OWASP AI Testing Guide
- Full procedure:
plays/ai-security-verification.md