XF 2.1 Googlebot

[bevans84]

New to Xenforo, and I don't understand why Googlebot is hitting mysite/js/xf/core-compiled.js?_v=63c4a8da thousands of times per day with a 200 response code.
Is this normal behavior?

 

[Chris D]

Is there a reason why you think it wouldn't be normal?

Googlebot's job is to crawl your site and hopefully add your content to its index. core-compiled.js is loaded on every single page, 200 is the success response so if that is being hit thousands of times a day, it means Googlebot is crawling thousands of your pages a day. Perfectly normal and actually a very good sign!

 

[bevans84]

Thank you