WaybookBot

A small crawler reading public information about places along cycling routes.

Waybook is a route guide for cyclists. WaybookBot reads public websites about cafés, restaurants, sights and other places along a route. It gathers practical details, descriptive information and image references to help riders decide where to stop. Published place information links back to its sources.

It identifies itself with the user agent WaybookBot/0.1 (+https://waybook.cc/bot). Our venue crawler honors robots.txt, spaces requests to the same host by at least two seconds, and reads a limited selection of relevant pages. It never fills in a form, never creates an account, and never reads anything behind a login.

Verify a request

Signed requests carry Signature, Signature-Input and Signature-Agent: "https://waybook.cc" headers. We use Ed25519 HTTP Message Signatures with the Web Bot Auth tag. The signature covers the request method, destination host, path, query and signature agent, and expires after one minute.

Our public keys are at the HTTPS key directory. Verify against this directory, check the signature’s key ID and validity period, and reject reused nonces. Do not trust the user agent alone or a key directory on another domain. Unsigned requests cannot be authenticated as ours.

See Web Bot Auth verification for the protocol. Publishing signatures does not by itself confer Cloudflare verified-bot status or permission to access your site.

We do not publish an IP allowlist. Do not allow an entire cloud provider’s network on our behalf. Your access rules still apply to authenticated requests.

Control access

To keep it out entirely, add to your site’s robots.txt:

User-agent: WaybookBot
Disallow: /

Questions, or want your venue removed: jakub.foglar@gmail.com. More about the project at waybook.cc.