Blog

Is Your Website Visible to ChatGPT? A 5-Point Check

22 November 2026 · 2 min read

When someone asks ChatGPT "what's a good tool for X", the answer comes from pages its crawlers could fetch and understand. If your site blocks them, or hides its content behind JavaScript, you are not in the running. Here's how to check, in five steps.

1. Read your robots.txt

Open yoursite.com/robots.txt and look for these user agents:

  • GPTBot and OAI-SearchBot (OpenAI)
  • ClaudeBot and Claude-SearchBot (Anthropic)
  • PerplexityBot (Perplexity)
  • Google-Extended (Gemini training)

A Disallow: / under any of them blocks that assistant. Some hosting providers and CDNs add these rules for you, so check even if you never wrote them.

2. Know the difference between training and search bots

Some bots collect data to train models; others fetch pages live to answer a question. You can block training while allowing search. For example, blocking GPTBot but allowing OAI-SearchBot keeps you out of training data while still letting ChatGPT search cite you. Decide on purpose rather than by accident.

3. Check that your content is in the HTML

Most AI crawlers don't run JavaScript. If your site is a single-page app that ships an empty <div id="root">, they see a blank page. View the page source (not the inspector) and search for a sentence from your homepage. If it's not there, add server-side rendering or prerendering for your key pages.

4. Add an llms.txt file

/llms.txt is a short Markdown file at the root of your site: one line on what you do, then links to your most important pages with a sentence each. It is cheap to add and gives assistants a clean summary instead of making them guess from your navigation.

5. Make your pages easy to quote

Assistants prefer pages that answer a question directly: a clear heading, a one-paragraph answer, then details. Add structured data (Organization, Product or FAQ schema) so facts like your name, price and features are machine-readable.

Check it in one go

RankHoot tests access for each major AI crawler, looks for llms.txt, and flags pages that only render with JavaScript, all in the same scan as your SEO checks.

Check your site in 20 seconds

RankHoot runs 60+ SEO, AI search, speed and security checks and gives you copy-paste fixes.

Scan my site