Correct format for blocking IP's & useragents

Rate this topic:

Please Register to post a reply. Another benefit of registration is the ability to subscribe to and recieve notifications of new posts.

Author

Messages

Chris Smith
<20 Posts

Posts:5

05/15/2007 1:48 PM
Can someone provide the correct format used to block (multiple) ip addresses and (multiple) useragents?

John Mitchell
Posts:3238

05/15/2007 6:32 PM
Hi cj, It can use regular expressions, and the possibilities are fairly endless. If you want to block a range of IP's you could do something as simple as: 192.168.0.* Same with user agents, just putting IE in that field will block all request that have IE in their name. If you want to give me an idea of what you want to block then I can come up with a more specific expression.

Chris Smith
<20 Posts

Posts:5

05/16/2007 4:46 AM
Thanks for the reply John. The spider in question is Baiduspider. It appears to be completely ignoring the robots.txt file and is using a good deal of time and resources. Do you have something specific for this spider? TIA

John Mitchell
Posts:3238

05/16/2007 7:32 AM
You should be able to exclude just that one by setting blocked-useragents="Baiduspider" or you could block all agents with the word 'Baid' by setting blocked-useragents="Baid".

Chris Smith
<20 Posts

Posts:5

Please Register to post a reply. Another benefit of registration is the ability to subscribe to and recieve notifications of new posts.

Forums >Snapsis Product Support >PageBlaster > Correct format for blocking IP's & useragents