Excessive traffic from Baidu Robot

rveram

Member
My site is in english and I'm receiving around 70+ visits from this bot (I think Baidu is a Chinese search engine ) permanently at any time of the day.

Has any of you experience this kind of behavior?

upload_2016-1-28_17-45-29.png
 

Martok

Well-known member
No need far an add-on, you can just disallow Baidu in yours robots.txt file with this:

Code:
User-agent: Baiduspider
User-agent: Baiduspider-video
User-agent: Baiduspider-image
Disallow: /
 

rainmotorsports

Well-known member
No need far an add-on, you can just disallow Baidu in yours robots.txt file with this:

Code:
User-agent: Baiduspider
User-agent: Baiduspider-video
User-agent: Baiduspider-image
Disallow: /

Did they all of a sudden start honoring this? Thought baidu had a rep for using unidentified bots from random ips after blocking regular traffic
 

rveram

Member
Thank you all for your replies, tried the robots.txt entry but it was ignored.

I decided to block their whole network using iptables

route: 180.76.0.0/16
descr: Baidu
country: CN
origin: AS55967
notify: zhangyukun@baidu.com
mnt-by: MAINT-CNNIC-AP
changed: ipas@cnnic.cn 20150806
source: APNIC

Problem solved :)
 
Top