Tag
#standards (15)
Agent-Readable Web Standards
conceptA family of plain-text conventions at well-known paths that let machine readers understand how a site or repository wants to be read — the protocol surface of the Independent Internet.
AGENTS.md
analysisAn open Markdown format at a repository's root carrying the build, test, style, and security context a coding agent needs.
AGENTS.md
sourceAn open Markdown format at a repository's root carrying the build, test, style, and security context a coding agent needs.
design.md
analysisAn early Markdown convention for declaring a project's design system to design-aware coding agents.
design.md
sourceAn early Markdown convention for declaring a project's design system to design-aware coding agents.
IETF
entityThe Internet Engineering Task Force — the open, consensus-driven body that standardizes the internet's core protocols through the RFC series.
Jeremy Howard
entityData scientist and educator who proposed llms.txt, extending the agent-readable web standards from crawling to inference.
llms.txt
analysisA proposed standard for a curated, LLM-shaped manifest at a site's root — telling language models what to read at inference time.
llms.txt
sourceA proposed standard for a curated, LLM-shaped manifest at a site's root — telling language models what to read at inference time.
RFC 10008: The HTTP QUERY Method
sourceIETF Standards Track specification defining the QUERY method for HTTP — a safe, idempotent request that carries its query in the message body and returns the result of processing it.
robots.txt — Robots Exclusion Protocol
analysisThe original machine-readable web standard: a plain-text file at a site's root telling crawlers which paths they may visit. Advisory, not enforced.
robots.txt — Robots Exclusion Protocol
sourceThe original machine-readable web standard: a plain-text file at a site's root telling crawlers which paths they may visit. Advisory, not enforced.
Sitemaps Protocol (sitemap.xml)
analysisThe positive complement to robots.txt: an XML file declaring what URLs exist on a site and what the operator wants crawled first.
Sitemaps Protocol (sitemap.xml)
sourceThe positive complement to robots.txt: an XML file declaring what URLs exist on a site and what the operator wants crawled first.
The Governance of Agent-Readable Standards
analysisThe five agent-readable web standards differ sharply in who governs them — and that trajectory is the real story.