Skip to content

benavlabs/vibe-check

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

vibe-check

Security checklist for vibe coded apps.

License


AI optimizes for making your code work, not for making it safe. Carnegie Mellon tested this: 61% of AI-generated code is functionally correct, only 10.5% is secure. This repo exists to close that gap.


How it works

Three layers, no overlap:

  1. AGENTS.md — Security rules your AI tool reads while it writes code. Copy into your project root. Prevents vulnerabilities from being created.
  2. AI-CHECKLIST.md — A prompt that tells your AI to audit your entire project. It investigates your codebase, writes reports, creates fix plans, implements them, and verifies.
  3. manual-checklist.md — Tests you run yourself for the things AI can't catch.

Setup

Step 1: Copy the rules file into your project

Cursor, Copilot, Codex, Windsurf, or Gemini CLI:

cp AGENTS.md /path/to/your/project/AGENTS.md

Claude Code:

cp AGENTS.md /path/to/your/project/CLAUDE.md

Not sure? Copy both:

cp AGENTS.md /path/to/your/project/AGENTS.md
cp AGENTS.md /path/to/your/project/CLAUDE.md

Commit it. Your AI tool reads it automatically from now on.

Step 2: Run the AI security audit

Give AI-CHECKLIST.md to your AI coding assistant:

Run the security audit defined in AI-CHECKLIST.md against this project.
Go through each vulnerability one at a time.

It will investigate your codebase for each of the 17 vulnerability categories, create reports, write fix plans, implement fixes, and verify. Results go in a security/ folder in your project.

Step 3: Run the manual checks

Open manual-checklist.md and go through each test. These verify things like: can you access another user's data, is your .env exposed, can login be brute-forced.

If you only do 5, do the first 5. They cover what took down every company on the list.

What this covers

17 most common vulnerabilities found in vibe coded apps, based on documented breaches and security research:

# Vulnerability Severity
1 Misconfigured database (no Row Level Security) Critical
2 Unprotected API routes (no auth middleware) Critical
3 Committed secrets (.env on GitHub) Critical
4 Broken access control (IDOR) Critical
5 Secret API keys in frontend code Critical
6 Server-Side Request Forgery (SSRF) High
7 Missing CSRF protection High
8 Missing security headers Medium
9 Wildcard CORS High
10 No rate limiting Medium
11 SQL injection High
12 Cross-site scripting (XSS) High
13 Unverified Stripe webhooks High
14 Insecure file uploads Medium
15 Verbose error messages Low
16 Weak password hashing Medium
17 Hallucinated packages (slopsquatting) High

Items 1–5 are what took down every real company on this list. None required a sophisticated attack.

⚠️ Warning: This will not make your app bulletproof. It covers the basics that have actually taken down vibe coded apps in production. When you have real traction and real user data, hire a pentester. No checklist replaces someone actively trying to break your stuff.

Skip the checklist entirely

This repo helps you fix what you already built. If you're starting something new, consider starting from a foundation that already passes all 17 checks out of the box.

FastroAI is a production-ready full-stack template (FastAPI + Astro + Stripe + PydanticAI) built by the same team behind this checklist. Auth with CSRF and rate limiting, Stripe webhooks with signature verification and idempotency, security headers, parameterized queries, production validation that blocks deployment if your secrets are weak or debug mode is on. 90%+ test coverage. You vibe-code the product on top of it, not the foundation.

Sources

Based on documented incidents and security research:

Contributing

Found something that should be on this list? Open a PR. Include what the vulnerability is, how to test for it, and how to fix it.

License

MIT

Contact

Benav Labs – benav.io github.com/benavlabs

Releases

No releases published

Packages

 
 
 

Contributors