Learn more about Determ’s Web Crawler

So, you found Mediatoolkitbot among your site visitors? Don’t worry, we’re not here to mess up your traffic, but enable new opportunities for content creators and marketers.

Briefly explained, Mediatoolkit bot is an Internet bot that systematically browses the web. It searches through more than 100 million web sources for Determ, an online media monitoring tool used all across the world by experts in marketing, PR and other, various industries.

The data Mediatoolkitbot collects is very useful for the business as well as creators community as it helps marketers and communicators find relevant opportunities for advertising, while at the same time, lets content creators be found for work opportunities.

The bot searches through the content of your website to match with phrases Determ users search for. If it matches, we let our users know, so they may use that information for reporting or opening up new business opportunities. Also, because it respects robots.txt file, you can easily manage it on your website.

If you want to change the rate at which Mediatoolkit bot visits your website, you are able to decide the minimum acceptable delay between two consecutive requests from Mediatoolkit bot in your robots.txt file:

User-agent: Mediatoolkitbot
Crawl-Delay: [value]
Or, if you don’t want the bot visiting your website at all, these are the lines you should put in your server’s robots.txt file:

User-agent: Mediatoolkitbot
Disallow: /
But, make sure that your robots.txt file doesn’t have any errors, as the bot might not recognize your order in that case.

If you think that Mediatoolkitbot is someway misbehaving on your website or if you have any questions about it, please don’t hesitate to contact our support team

Skip to content