Jeff Mottle Posted October 7, 2012 Share Posted October 7, 2012 (edited) WE NEED YOUR HELP! A web search bot called 80legs has effectively been causing an Denial or Service (DDos) attack on our servers for 3 days We are blocking them as fast as they are hitting us with literally thousands of bots. Please send a Tweet to @80legs and tell them to stop: "Dear @80legs you are taking down @cgarchitect (174.143.68.213). Please stop crawling this site and IP immediately!" Edited October 7, 2012 by Jeff Mottle Link to comment Share on other sites More sharing options...
abhaysingh Posted October 7, 2012 Share Posted October 7, 2012 No wonder the site was so slow from past two days. Link to comment Share on other sites More sharing options...
Jeff Mottle Posted October 7, 2012 Author Share Posted October 7, 2012 Yes, it's taken us 2 days just to figure out the problem as they overwhelm the servers so much that we can't access them to figure out what is going on. Our team at Rackspace has been working this problem 24/7 for 3 days. Link to comment Share on other sites More sharing options...
Jeff Mottle Posted October 7, 2012 Author Share Posted October 7, 2012 These guys have been sued by Yelp and RyanAir to name a few due to their poor crawling practices and are notorious for taking servers down. You know they don't care when they have this message in their FAQ: Blocking our web crawler by IP address will not work. Due to the distributed nature of our infrastructure, we have thousands of constantly changing IP addresses. We strongly recommend you don't try to block our web crawler by IP address, as you'll most likely spend several hours of futile effort and be in a very bad mood at the end of it. You really should just include us in your robots.txt or contact us directly. Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now