What's in v0.3.3

New features

robots.txt and sitemap.xml for agent and crawler discoverability

CamelMind now extends documentation discoverability with robots.txt and sitemap.xml, complementing the existing llms.txt endpoint.

• robots.txt defines crawl rules and Content Signals for AI and search crawlers.
• sitemap.xml lists public documentation URLs for search indexing.
• Both endpoints automatically respect page-level RBAC, site-wide authentication, and documentation version settings.

No configuration is required. Both endpoints are enabled by default. See Agent and Crawler Discoverability for details.

Improvements

Expand llms.txt to all documentation versions

The llms.txt endpoint is now available for every documentation version. If your site has multiple versions, each version has its own index at /{version}/llms.txt (for example, /v2/llms.txt), generated from that version's nav.yml.

Improve Vale checks for MDX

We added the vale-preprocess.mjs script to improve how Vale parses MDX files. You can now preprocess an MDX file and run the Vale check with a single command:

node scripts/vale-preprocess.mjs content/[path-to-mdx-file]

Run RAG Check across every doc

You can now run a site-wide RAG diagnostic across every page in your navigation tree. The report identifies pages that fall below your specified score threshold in a single pass:

npx tsx scripts/rag-check-report.ts [threshold]

See Run RAG Check across every doc for details.

Document updates

We added instructions for making offline packages and PDF exports available to users on your documentation site. See Prepare Offline Packages and PDFs for details.