DigdigBot is the crawler of Digdig, a search engine that helps shoppers find small, independent brands and buy directly from the brand's own website.
Store-level public pages: your homepage and a few pages such as About, Shipping, Ingredients, Contact, legal notice / Impressum and Terms / Privacy — six pages per store at most. In addition it may open up to two single product pages (no redirects followed), to check that ingredient lists are published and to note the page's own share image; it keeps a yes/no, a short ingredient excerpt and that page's address as the source, the image's address, and notes warning signs such as medical claims. It never keeps prices, product names or catalogue data. It never reads product listings or collections, cart, checkout or account pages, and never submits forms.
To show your brand, Digdig uses the images your site itself publishes for sharing: the site icon or the logo in
your schema.org markup, and the og:image preview image of your homepage and of the (at most two)
product pages it reads. It links to them on your site rather than copying them. To change or remove an image, email
hello@getdigdig.com; we act within 48 hours, and the crawler won't add a
removed image back.
robots.txt, including Crawl-delay (up to 60 seconds). If your
robots.txt can't be read (an error or an unreachable server), it treats the whole site as off-limits.DigdigBot/0.1 (+https://getdigdig.com/bot; contact: hello@getdigdig.com).To stop DigdigBot, add this to your robots.txt:
User-agent: DigdigBot Disallow: /
To have your brand removed from Digdig, or for any question, email hello@getdigdig.com. We act on removal requests within 48 hours.