Vezible
Get started
All tools
16 bots

robots.txt Generator

Create a robots.txt with the right rules for Google, Bing, and 16 AI crawlers. Choose which bots to allow or block.

User-agent: *
Allow: /
Disallow: /admin/
Disallow: /login
Sitemap: https://example.com/sitemap.xml
robots.txt

How to use

  1. 1

    Paste any public website URL.

  2. 2

    Click Run — results appear in seconds.

  3. 3

    Review the report and apply the fixes.

Who is this for

  • Founders shipping SaaS, dev tools, and B2B products.
  • SEO managers auditing client sites quickly.
  • Agencies producing weekly visibility reports.
  • Indie hackers fixing AI visibility before launch.

Common questions

Related tools

AI-ready grade

Robots.txt Analyzer

Full robots.txt analysis with AI crawler status, syntax check, and recommended fixes.

16 bots

AI Crawler Checker

Is your robots.txt blocking ChatGPT, Claude, Perplexity, or Gemini? Check all 16 AI crawlers instantly.

25+ checks

AI Visibility Audit

Score your site across 25+ signals. Get your AI Visibility Score, top blockers, and auto-generated fix files.

Get the full AI visibility audit

This free tool checks one signal. The full audit scores 25+ signals, monitors ChatGPT and Perplexity for your brand, and ships fix files.

Start freeView plans