Excessive traffic from Baidu Robot

[rveram]

My site is in english and I'm receiving around 70+ visits from this bot (I think Baidu is a Chinese search engine ) permanently at any time of the day.

Has any of you experience this kind of behavior?

 

[AndyB]

I suggest using the Robots add-on located here:

https://xenforo.com/community/resources/robots.3900/

 

[Martok]

No need far an add-on, you can just disallow Baidu in yours robots.txt file with this:

User-agent: Baiduspider
User-agent: Baiduspider-video
User-agent: Baiduspider-image
Disallow: /

 

[rainmotorsports]

No need far an add-on, you can just disallow Baidu in yours robots.txt file with this:

User-agent: Baiduspider
User-agent: Baiduspider-video
User-agent: Baiduspider-image
Disallow: /

Did they all of a sudden start honoring this? Thought baidu had a rep for using unidentified bots from random ips after blocking regular traffic

 

[whynot]

Did they all of a sudden start honoring this?

No, they didn't.

 

[kontrabass]

Baidu sees your robots.txt and spits in its general direction.

https://theadminzone.com/threads/is-baidu-ignoring-robots-txt-now.138510/#post-1036383

 

[rveram]

Thank you all for your replies, tried the robots.txt entry but it was ignored.

I decided to block their whole network using iptables

route: 180.76.0.0/16
descr: Baidu
country: CN
origin: AS55967
notify: zhangyukun@baidu.com
mnt-by: MAINT-CNNIC-AP
changed: ipas@cnnic.cn 20150806
source: APNIC

Problem solved