ShelvBot

ShelvBot visits a single product page when someone asks Shelv to scan it, plus that site’s robots.txt and llms.txt. It does not crawl other pages and it does not follow links.

It identifies itself with this user agent:

Mozilla/5.0 (compatible; ShelvBot/1.0; +https://shelv.nl/bot)

To stop ShelvBot from scanning your site, add this to your robots.txt:

User-agent: ShelvBot
Disallow: /

Questions? Email info@shelv.nl.