llms.txt generator

The first heading must be an H1 containing the project or site name. It is the only required section. A summary blockquote, explanatory text and H2 sections containing Markdown link lists are optional. We separate format errors from advice about useful additions. A section named Optional conventionally holds secondary links.

No. Some sites provide llms-full.txt as an expanded content file. The llmstxt.org format describes llms.txt, so we report the full file’s availability and size limit without applying the short file’s structure rules to it. A missing full file is not an llms.txt format error.

No. robots.txt describes crawler access rules, and a sitemap lists pages for discovery. llms.txt provides a curated introduction and references. It neither grants access nor overrides crawler restrictions. Use the AI crawler checker to inspect access separately.

Only HTTP 404 and 410 are labeled broken. Other error responses are shown as restricted or server errors. Timeouts, private destinations and network failures remain unverified. Requests have a ten-second ceiling, including redirects. Links beyond the first 20 and truncated files are explicitly marked as outside the complete check.

The website address is sent to our API so it can read public pages. We do not ask a model to generate text. Successful results can be held in memory for five minutes, and requests are limited to ten per hour per IP address. Pasted text and draft edits stay in this page and are lost when you reload. Copy or download them before leaving.