HasThingsBot
- User agent
HasThingsBot/1.0 (+https://hasthings.com/about/crawler)- Purpose
- Collecting public event listings for a city event index.
- Frequency
- A venue calendar is fetched at most once every two hours.
Has Things reads publicly published event listings so people can see what is on in their city tonight, and republishes them as open calendar, JSON, CSV and RSS feeds under CC BY 4.0. Every event links back to the venue or ticketing page it came from.
What the crawler does:
· Identifies itself honestly with the user agent above, on every request. · Obeys robots.txt. If a path is disallowed, we do not request it — including convenience endpoints we would otherwise find useful. · Sends conditional requests, so an unchanged page costs your server a 304. · Limits concurrency and spaces requests out. · Backs off on 429 and honours Retry-After.
What it does not do:
· It does not use a headless browser, rotate user agents, or pretend to be a person. · It does not attempt to get around anti-bot measures, paywalls or logins. · It does not collect personal data. · It does not scrape content for model training.
To block it, disallow HasThingsBot in your robots.txt. To be listed differently, corrected, or not at all, use the Suggest form (it reaches a person the same day) and we will use whatever you prefer. Your listings end up on this site and in its open feeds; the feeds page says exactly what is republished and under what terms.