PrezzyListBot: how PrezzyList reads shop pages
PrezzyListBot is the program PrezzyList uses to read a shop's product page when a member adds that page to a gift list. This page explains what it does, so you can decide whether to allow it.
What it does
When a PrezzyList member adds a link to a gift on their list, PrezzyListBot fetches that one product page so the gift can show its name, price and picture. It does not crawl, follow links or index your site.
How it identifies itself
Every request carries this user agent: PrezzyListBot/1.0 (+https://prezzylist.com/bot)
Our test sites use their own address in the same format.
How it behaves
It reads and honours your robots.txt for the PrezzyListBot token (and for *). It makes at most one request a second and two at once to any site.
It waits when asked (a 429 or 503 response, honouring Retry-After) and stops after repeated errors. After 5 blocked requests in a row it leaves a site alone for 24 hours.
If a request is blocked
It may retry once with standard browser headers from the same address. It never solves captchas, never uses proxies or other addresses, and stops if the retry is also blocked.
What we keep
The product's name, price and a small copy of its main picture, credited to the shop. The page itself is kept privately for up to 7 days.
How to block us
Add this to your robots.txt and PrezzyListBot will not fetch any page on your site:
User-agent: PrezzyListBot
Disallow: /Contact
For questions, takedown requests or rate concerns, email bot@prezzylist.com.