Documentation
SEO and indexing
Public crawler surfaces and metadata conventions for the website.
Public indexes
The website exposes crawler-friendly indexes for traditional search engines and LLM-oriented crawlers.
The canonical public app is apps/web. The docs app has its own robots.txt, sitemap.xml and llms.txt.
Metadata contract
Pages should provide:
- a stable canonical URL
- localized alternates when content exists in more than one locale
- Open Graph and Twitter metadata
- structured JSON-LD for article and content pages where applicable
- a warm theme color that matches the Cursor-inspired site theme
Private or operational routes should not be indexed. Admin, API and reset-password surfaces are covered by X-Robots-Tag headers or route metadata.
Content routes
Localized content lives under:
After adding, removing or translating content, regenerate MDX output before type-checking.
Validation
Use the production build, not only development mode, for SEO-sensitive changes.
Route-level crawler files should return HTTP 200 locally after next start.