Guides
Practical, sourced and dated explanations to make your small business website readable to AI assistants.
- Should you block AI crawlers? A plain guide to robots.txt and AI bots
Which AI bots train on your site, which power AI search, which ignore robots.txt, and what changed at Cloudflare in September 2026. - What is llms.txt, and does your small business need one?
What the file is, who actually reads it according to Google, OpenAI, Anthropic and Perplexity, and whether your site needs one.