馃 MoltProbeProbe another site

AI readiness report for bbc.com

bbc.com

Most agents will struggle here.

6 passed5 warnings2 failed

57
GRADE D

Fix these first

  • AI crawlers allowed. robots.txt blocks: GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended, CCBot.

  • llms.txt present. No llms.txt at the site root.

  • Agent skill file (skill.md). No skill.md / skills.md (an instruction file agents can follow).

  • MCP endpoint declared. No MCP manifest (lets agents call your service as a tool).

  • llms-full.txt present. No llms-full.txt (optional, but useful).

  • Machine-readable feed. No RSS/Atom or data feed declared (optional).

  • ai.txt / ai-plugin. No ai.txt or ai-plugin manifest (optional/legacy).

Agent files
32
Crawler access
0
Structured data
100
Content & discovery
92

Agent files

32/100
llms.txt presentFail
No llms.txt at the site root.
Fix: Add a plain text file at /llms.txt with a markdown H1, a one-line summary, and links to your key pages. See llmstxt.org for the format.
llms-full.txt presentWarn
No llms-full.txt (optional, but useful).
Fix: Add /llms-full.txt, the full-text version of your most important content, so LLMs can read it in one file.
Agent skill file (skill.md)Warn
No skill.md / skills.md (an instruction file agents can follow).
Fix: Add /skill.md, a short markdown file that tells an agent what your site does and how to use it.
MCP endpoint declaredWarn
No MCP manifest (lets agents call your service as a tool).
Fix: Run an MCP server and declare it at /.well-known/mcp.json so agents can call your service as a tool.
ai.txt / ai-pluginWarn
No ai.txt or ai-plugin manifest (optional/legacy).
Fix: Optional. Add /ai.txt stating your AI usage policy for crawlers and agents.

Crawler access

0/100
AI crawlers allowedFail
robots.txt blocks: GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended, CCBot.
Fix: In robots.txt, allow the AI crawlers. Add groups for GPTBot, ClaudeBot, PerplexityBot and OAI-SearchBot, each with 'Allow: /'.

Structured data

100/100
Structured data (JSON-LD)Pass
Found JSON-LD structured data.
Meta descriptionPass
Homepage has a meta description.
OpenGraph tagsPass
Homepage has OpenGraph tags.
Page titlePass
Homepage has a title.

Content & discovery

92/100
XML sitemapPass
Found sitemap.xml.
Content in initial HTMLPass
Initial HTML carries ~2716 words of text (agents without JS can read it).
Machine-readable feedWarn
No RSS/Atom or data feed declared (optional).
Fix: Optional. Declare an RSS or Atom feed with <link rel="alternate" type="application/rss+xml">.

Probed 7/30/2026, 5:15:00 PM 路 Free static audit. The paid tier drives a real AI agent through your key tasks to confirm it can actually use your site.

Want this checked every day, not just once?

This probe is a one-time snapshot. We are building the service: every day a real AI agent works through your key tasks, sign up, search, checkout, call your API, and the moment one breaks for agents you get an alert, before your customers' agents run into it. Leave your email and we will reach out when it opens.