TradentityBot
TradentityBot is a small research crawler run by Tradentity Ltd (UK). It reads public product catalogue pages to test how well software can recognise the same product across different listings.
User agent:
TradentityBot/0.1 (+https://tradentity.ai/bot; bot@tradentity.ai)
How it behaves
- It reads and obeys
robots.txton every visit. - It makes one request at a time, at least 5 seconds apart, and fetches ~1,000 product pages per site per run, plus robots.txt, sitemaps and the site’s terms page.
- It only visits public pages. It never logs in and never submits forms.
- It stops for the rest of the run on 401, 403, 429 or a challenge page; on 503 it waits once as asked, then stops. It never tries to get around blocks.
- It does not run JavaScript or use a browser.
What it collects
Product identity details only: product name, brand, size, pack, variant, the page address and any product codes and barcodes shown on the page. It does not collect prices or personal data. Collected data is used for internal testing and is not published or resold.
Contact and opt-out
To ask us to stop, or with any question, email bot@tradentity.ai. We will stop crawling your site promptly.
You can also block TradentityBot in your robots.txt:
User-agent: TradentityBot
Disallow: /