1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Excessive traffic from Baidu Robot

Discussion in 'Forum Management' started by rveram, Jan 28, 2016.

  1. rveram

    rveram Member

    My site is in english and I'm receiving around 70+ visits from this bot (I think Baidu is a Chinese search engine ) permanently at any time of the day.

    Has any of you experience this kind of behavior?

  2. AndyB

    AndyB Well-Known Member

    rveram likes this.
  3. Martok

    Martok Well-Known Member

    No need far an add-on, you can just disallow Baidu in yours robots.txt file with this:

    User-agent: Baiduspider
    User-agent: Baiduspider-video
    User-agent: Baiduspider-image
    Disallow: /
    rveram likes this.
  4. rainmotorsports

    rainmotorsports Well-Known Member

    Did they all of a sudden start honoring this? Thought baidu had a rep for using unidentified bots from random ips after blocking regular traffic
    Xon and whynot like this.
  5. whynot

    whynot Well-Known Member

    No, they didn't.
    rveram and AndyB like this.
  6. kontrabass

    kontrabass Well-Known Member

    Xon and rveram like this.
  7. rveram

    rveram Member

    Thank you all for your replies, tried the robots.txt entry but it was ignored.

    I decided to block their whole network using iptables

    descr: Baidu
    country: CN
    origin: AS55967
    notify: zhangyukun@baidu.com
    mnt-by: MAINT-CNNIC-AP
    changed: ipas@cnnic.cn 20150806
    source: APNIC

    Problem solved :)
    kontrabass likes this.

Share This Page