peter
8dea56f1c5
The public landing had no meta description and no robots.txt (the SPA fallback returned index.html for /robots.txt, so crawlers saw an invalid file). Add a description + basic OG tags to index.html and a real robots.txt that allows the landing but disallows the API/auth/watch surfaces. Lighthouse (dev): SEO 83->100.
8 lines
238 B
Plaintext
8 lines
238 B
Plaintext
# Siftlode is mostly a private, login-gated app; only the public landing and legal
|
|
# pages are worth indexing. Allow crawling but keep bots out of the API surface.
|
|
User-agent: *
|
|
Allow: /
|
|
Disallow: /api/
|
|
Disallow: /auth/
|
|
Disallow: /watch/
|