Skip to content

AttractPartsBot

AttractPartsBot is the crawler operated by Attractor Oy for AttractParts. It reads publicly available parts listings so that people can find them, and links visitors back to your own page.

How to identify it

It sends a User-Agent containing AttractPartsBot and a contact address, and repeats that address in a From header. If you see traffic claiming to be us that does not carry both, it is not us.

How to control it

  • robots.txt is obeyed. A Disallow for AttractPartsBot or for * stops us on those paths. A Crawl-delay is honoured as a minimum, and our own floor may be slower.
  • TDM reservations are obeyed. A tdm-reservation meta tag or header, or an X-Robots-Tag: noai, stops us entirely.
  • We never bypass anything. No CAPTCHA, no login, no paywall, no bot wall. If reaching your content would require getting past a control, we stop and do not come back.
  • Ask us and we stop. Write to [email protected] — the same address our user-agent and From header carry — and we will remove your site and everything derived from it.

Our rate limits

These are the limits the crawler actually enforces, not intentions. They are applied before a request is made, counted in our own database so a restart cannot reset them, and the stricter of our floor and your Crawl-delay always wins.

  • One request at a time to any one site. We never open a second connection to you while the first is outstanding.
  • At least three seconds between requests to the same site, or your Crawl-delay if it is longer.
  • At most 28,800 requests per site per day — no more than one request every three seconds, around the clock. When that is spent we stop asking you until the next day, whatever else we are doing.
  • Sites that share an operator share one request rate. We do not open a second connection, or shorten the delay, because you run several domains. The daily limit above is counted per site.

If any of this is still too much for your server, tell us at [email protected] or say so in robots.txt, and the lower number becomes the limit.

What we store and show

Factual fields — part numbers, prices, condition, location, the vehicle a part came from — plus a link to your page. We do not reproduce your descriptions, and we show images only where a site’s policy permits it, hot-linked from your server rather than copied to ours.