Safeguard Your Website With The Bad Bot Generator
Discover our straightforward tool designed to keep your website safe from unwanted visitors like automated chat tools and scrapers. Here is a quick guide to how it works.
- Get the latest list - Open the tool to see an updated list of bot agents and AI user agents that you might want to block.
- Find what you need - Easily sort the list by type, such as scraper or SEO crawler, or search for a specific name.
- Pick your targets - Click Add next to any bot agent you want to block, moving it to a list of bots you are focusing on.
- Select many at once - With Add All, you can choose all bots shown based on your current search or filter.
- Make your rules - Decide whether you want a `robots.txt` file or a Cloudflare WAF rule to keep the selected bot agents out.
- Copy rules quickly - Use Copy to Clipboard to grab your new set of rules for your website or Cloudflare setup.
Things To Remember
- Robots.txt - It is a simple way to tell bots not to visit your site, but not all bots will listen. It is a good starting point, but sometimes you need more security. More information on robots.txt
- Cloudflare WAF Rules - If you are making WAF rules for Cloudflare, remember there is a limit to how much you can put in one rule. You may need to split larger lists into smaller ones. Cloudflare WAF Rules | Why use Cloudflare WAF for security
Use the tool to keep your website protected in a few simple steps.
A Web Application Firewall (WAF) is a security solution designed to protect web applications by monitoring and filtering HTTP traffic between a web application and the Internet. It operates at the application layer to help protect web applications from threats including cross-site scripting, SQL injection, and other vulnerabilities that could be exploited by attackers.
Thanks
We are grateful to Gavin King for his work on Dark Visitors, which helps keep the list of bots up to date.
If you are looking for something more extensive, head over to this GitHub project for a wider Nginx bad-bot blocking stack.
Disclaimer
This tool comes with no promises. It is important to check that the generated rules work for your setup without causing issues.