All Wiki

Tag

#standards (15)

Agent-Readable Web Standards

concept

A family of plain-text conventions at well-known paths that let machine readers understand how a site or repository wants to be read — the protocol surface of the Independent Internet.

AGENTS.md

analysis

An open Markdown format at a repository's root carrying the build, test, style, and security context a coding agent needs.

AGENTS.md

source

An open Markdown format at a repository's root carrying the build, test, style, and security context a coding agent needs.

design.md

analysis

An early Markdown convention for declaring a project's design system to design-aware coding agents.

design.md

source

An early Markdown convention for declaring a project's design system to design-aware coding agents.

IETF

entity

The Internet Engineering Task Force — the open, consensus-driven body that standardizes the internet's core protocols through the RFC series.

Jeremy Howard

entity

Data scientist and educator who proposed llms.txt, extending the agent-readable web standards from crawling to inference.

llms.txt

analysis

A proposed standard for a curated, LLM-shaped manifest at a site's root — telling language models what to read at inference time.

llms.txt

source

A proposed standard for a curated, LLM-shaped manifest at a site's root — telling language models what to read at inference time.

RFC 10008: The HTTP QUERY Method

source

IETF Standards Track specification defining the QUERY method for HTTP — a safe, idempotent request that carries its query in the message body and returns the result of processing it.

robots.txt — Robots Exclusion Protocol

analysis

The original machine-readable web standard: a plain-text file at a site's root telling crawlers which paths they may visit. Advisory, not enforced.

robots.txt — Robots Exclusion Protocol

source

The original machine-readable web standard: a plain-text file at a site's root telling crawlers which paths they may visit. Advisory, not enforced.

Sitemaps Protocol (sitemap.xml)

analysis

The positive complement to robots.txt: an XML file declaring what URLs exist on a site and what the operator wants crawled first.

Sitemaps Protocol (sitemap.xml)

source

The positive complement to robots.txt: an XML file declaring what URLs exist on a site and what the operator wants crawled first.

The Governance of Agent-Readable Standards

analysis

The five agent-readable web standards differ sharply in who governs them — and that trajectory is the real story.