llms.txt for AI discovery

llms.txt is an emerging convention — like robots.txt, but for AI. It’s a plain-text index at the root of your site that tells answer engines what you are and points them at your key pages. AskThis generates it from your onboarding scan.

Two files

AskThis serves two versions, both public and text/plain:

# Index: your site summary + a curated list of key pages
curl https://api.askthis.io/api/v1/sites/cq_8f2a/llms.txt

# Full: the index plus a one-line summary of each page inlined
curl https://api.askthis.io/api/v1/sites/cq_8f2a/llms-full.txt

They’re built from your scanned pages (title, URL, page type, and each page’s AI Graph summary), following the llmstxt.org format: an H1 site name, a short description, then sections of links.

Serving it from your domain

Point your site’s /llms.txt at the generated file, two ways:

• Proxy / redirect https://yoursite.com/llms.txt to the AskThis endpoint (cache-friendly, always current).
• Snapshot the output into a static file you deploy, and refresh it after big content changes.