Skip to content

Agent readiness: robots.txt, content signals, api-catalog, auth.md - #59

Merged
kastnerp merged 1 commit into
mainfrom
agent-readiness
Oct 19, 2026
Merged

kastnerp merged 1 commit into
mainfrom
agent-readiness

Conversation

@kastnerp

Copy link
Copy Markdown
Member

Adds the files AI agents look for at the site root, on top of main only (dev has 88 unpublished commits that this does not touch):

  • robots.txt: explicit AI crawler groups, Content-Signal (search, ai-input, ai-train all yes, as today), and an absolute sitemap URL (the live one had a doubled //)
  • /.well-known/api-catalog (RFC 9727; include: [".well-known"] in _config.yml), listing the AIJ validation-data API
  • /auth.md: the site needs no authentication

🤖 Generated with Claude Code

…talog, auth.md

- robots.txt: explicit AI crawler groups, Content-Signal (search, ai-input, ai-train),
  and an absolute sitemap URL (it had a doubled or relative base).
- /.well-known/api-catalog (RFC 9727; _config.yml include) listing the AIJ validation-data API.
- /auth.md: the site needs no authentication.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
@netlify

netlify Bot commented Oct 19, 2026 •

Copy link
Copy Markdown

✅ Deploy Preview for sustainableurbansystems ready!

Name Link
🔨 Latest commit 951df7a
🔍 Latest deploy log https://app.netlify.com/projects/sustainableurbansystems/deploys/6ad62454ebd468cdb20519bb
😎 Deploy Preview https://deploy-preview-59--sustainableurbansystems.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.
Lighthouse
Lighthouse
1 paths audited
Performance: 66
Accessibility: 98
Best Practices: 92
SEO: 92
PWA: -
View the detailed breakdown and full score reports

To edit notification comments on pull requests, go to your Netlify project configuration.

@kastnerp
kastnerp merged commit 77ab786 into main Oct 19, 2026
10 checks passed
@kastnerp
kastnerp deleted the agent-readiness branch October 19, 2026 15:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant