Reading robots.txt, fetching the page without JavaScript, checking structured data…
An example report for svelte.dev, re-checked daily. Enter your own site above to see how it compares, or compare SvelteKit with other frameworks.
One problem stops assistants from reading or quoting this page. Fix it first.
201 words in the HTML, loaded in 0.6 s.
| Crawler | Used for | Type | This page |
|---|---|---|---|
| OAI-SearchBot | ChatGPT search | AI search | Allowed |
| GPTBot | OpenAI model training | Training | Allowed |
| ChatGPT-User | ChatGPT, when a user asks | User request | n/a |
| Claude-SearchBot | Claude search | AI search | Allowed |
| ClaudeBot | Anthropic model training | Training | Allowed |
| Claude-User | Claude, when a user asks | User request | Allowed |
| PerplexityBot | Perplexity search | AI search | Allowed |
| Perplexity-User | Perplexity, when a user asks | User request | n/a |
| Googlebot | Google Search, AI Overviews and AI Mode | AI search | Allowed |
| Google-Extended | Gemini training (not Search) | Training | Allowed |
| Applebot-Extended | Apple model training | Training | Allowed |
| CCBot | Open dataset used by many models | Training | Allowed |
Blocking training crawlers is a choice and doesn't affect AI search. What each crawler does
No structured data found.
Fix: Add JSON-LD: Organization on the home page, Article with author and dates on articles, Product or SoftwareApplication on product pages.
How to fix it201 words in the HTML. That's thin for an assistant to quote from.
Fix: Add the substance people need on the page itself: the answer, the details, the numbers.
How to fix it0 of 2 subheadings are phrased as questions.
Fix: Phrase some H2s as the questions people ask, with a one or two sentence answer right below each.
How to fix itNo machine-readable date or author found. Assistants use dates and authorship to judge whether a page is current and who stands behind it.
Fix: Show "Updated [date]" and the author, and add datePublished, dateModified and author to the Article JSON-LD.
How to fix itThe page has no canonical link.
Fix: Give every page a unique title under 60 characters, a description of 150 or so, and a canonical link to itself.
No sitemap found in robots.txt or at /sitemap.xml.
Fix: Publish a sitemap and add a Sitemap: line to robots.txt.
Every AI search and answer crawler is allowed.
How to fix itReturns HTTP 200 with no noindex or nosnippet rules.
How to fix itFound /llms.txt.
How to fix itIt scores 64 out of 100. One problem stops assistants from reading or quoting this page. Fix it first.
None. Its robots.txt lets in every AI crawler this check looks at.
It was last checked on October 30, 2026 and is re-checked once a day.
This check shows whether they can. Surfacepath Pro will ask them your customers' questions every week and show whether you're mentioned, cited, or replaced by a competitor.