Robots Exclusion Protocol User Agent Purpose Extension
draft-illyes-rep-purpose-00
| Document | Type |
Expired Internet-Draft
(aipref WG)
Expired & archived
|
|
|---|---|---|---|
| Author | Gary Illyes | ||
| Last updated | 2025-04-21 (Latest revision 2024-10-18) | ||
| RFC stream | Internet Engineering Task Force (IETF) | ||
| Intended RFC status | (None) | ||
| Formats | |||
| Additional resources | Mailing list discussion | ||
| Stream | WG state | Candidate for WG Adoption | |
| Document shepherd | (None) | ||
| IESG | IESG state | Expired | |
| Consensus boilerplate | Unknown | ||
| Telechat date | (None) | ||
| Responsible AD | (None) | ||
| Send notices to | (None) |
This Internet-Draft is no longer active. A copy of the expired Internet-Draft is available in these formats:
Abstract
The Robots Exclusion Protocol defined in [RFC9309] specifies the user-agent rule for targeting automatic clients either by prefix matching their self-defined product token or by a global rule * that matches all clients. This document extends [RFC9309] by defining a new rule for targeting automatic clients based on the clients' purpose for accessing the service.
Authors
(Note: The e-mail addresses provided for the authors of this Internet-Draft may no longer be valid.)