Knowledgebase
How to Block bad bots and site rippers on cpanel server
| Posted by www_webhost, 10-04-2012, 02:52 PM | | As the title says all i want to know that how do I Block bad bots and site rippers on my cpanel server.
I have seen .htaccess trick to do so but that will work only for a certain user account. I want a solution that i can setup server wide.
Thanks
|
| Posted by Ramprage, 10-04-2012, 02:53 PM | | mod_security is your best bet. It's a web application firewall that has configurable rules to pretty much do anything you want.
|
| Posted by www_webhost, 10-04-2012, 02:57 PM | | we have installed mod_security and are using default rules provided by cpanel.
If you can tell me any specific rule here on this forum to block site rippers and bad bots i will be grateful.
I am a newbie so don't have much knowledge abt these rules, also we have just started up so cant spend more in buying atomic rules etc etc
|
| Posted by brianoz, 10-12-2012, 06:04 AM | | CSF is something that will help - it has rate limiting code in it, and it picks up and prevents a lot of smaller DOS/DDOS events having any impact. The files are easy to install from www.configserver.com, and if you want the company can install all its tools and harden your server against many other hacking possibilities and problems that are just as likely as DOS events.
BTW - nothing will help against a large DDOS except hardware.
|
| Posted by BestServerSupport, 10-12-2012, 06:33 AM | | I would also suggest you to install CSF firewall to block bad bots and site rippers. It is easy to configure it as a plugin with cPanel.
|
| Posted by zoid, 10-12-2012, 06:40 AM | | You want to block scrapers, correct? Unless you find a well recognisable pattern (eg. IP range) there is no real way to block them as they behave like normal browsers. If you do however a firewall might be the best solution to apply it server wide (alternatively you can also configure respective deny rules in your webserver configuration for all virtual hosts)
|
| Posted by MikeSpenclers, 10-12-2012, 07:43 AM | | Might be of help.....
stopping-and-blocking-security-scannersbots
there really is no way to stop them as they can mimic real users.
|
| Posted by LeadDogGraphicStudio, 10-16-2012, 03:06 PM | | The default rules with cPanel suck bad. They need to be updated to either the rules by Atomicorp.com or the Paid Mod_sec rules from trustwave.
Those will work for what you need. The suggestions above for CSF are good suggestions but will not eliminate bad bots and scrapers directly, they will help indirectly by providing 404 protection as well as connection limits.
|
|
 Add to Favourites
 Print this Article
|
Also Read
