Crawler Information

BiennaleRadarBot

BiennaleRadarBot is the automated crawler operated by Biennale Radar, an editorial index of the global art world. It fetches public feeds, sitemaps, and pages from art institutions, galleries, auction houses, and publications to keep our exhibition and market intelligence current.

User agent

Mozilla/5.0 (compatible; BiennaleRadarBot/1.0; +https://biennaleradar.com; contact=biennale.radar+bot@gmail.com)

How it behaves

  • Identifies itself honestly on every request — it never spoofs a browser.
  • Respects robots.txt directives and per-host crawl delays.
  • Prefers RSS/Atom feeds and sitemaps over page scraping, and uses conditional requests (ETag / If-Modified-Since) to avoid refetching unchanged content.
  • Fetches only recent, public content — it does not walk archives or harvest full site histories.
  • Stores metadata and attributed excerpts under a rights model that honors each publisher's display and distribution preferences.

Request frequency

Most sources are polled between once per hour and once per day, depending on how often they publish. The bot waits between consecutive requests to the same host.

Contact / opt out

If you operate a site the bot visits and want it slowed down, excluded, or have any questions about how your content is used, email biennale.radar+bot@gmail.com. This inbox is monitored, and exclusion requests are honored. You can also block the bot with a robots.txt rule for BiennaleRadarBot.

HomeCitiesRadarBooksScheduleAbout