Dang. Do you think it's Amazon bot or someone mining with AWS servers?
Dang. Do you think it's Amazon bot or someone mining with AWS servers?
The user agents were like Google Chrome.
Mozilla<span>/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML\, like Gecko) Version/8.0.2 Safari/600.2.5 (Amazonbot/0.1; +https:/</span>/developer.amazon.com/support/amazonbot)
User-agent: Amazonbot # Amazon's user agent
Disallow: /do-not-crawl/ # disallow this directory
User-agent: * # any robot
Disallow: /not-allowed/ # disallow this directory
Bogus user agent.Here's a user agent:
Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.2768.182 Safari/537.36
Another:
View attachment 311891
Likely a crawler just doing its thing.It's weird. Why would someone be hitting the Xenforo misc/style page that many times?
Yup.you mean you did set up new fresh forum & got 60k hits?
how can amazon hit 60k unknown new forum?
Yup.
I have no idea. There must be some vulnerability on this style page or something. Hoping someone here knows.
site:yourdomain.com
Nope, Googlebot uses a specific user agent. Did you see the user agent above?likely google crawler. go to google and put in
Nope, Googlebot uses a specific user agent. Did you see the user agent above?
Google doesn't use Amazon IP ranges.likely google crawler. go to google and put in
Code:site:yourdomain.com
see what is indexed.
I have never in my 15 years as a webmaster seen Google use bogus user-agents. Do you have any proof of this? I'm interested in learning more.Yes, bogus header. I'm saying your site has likely been found VIA Google from it being indexed via their bot and thereafter what transpires could be from this. I hope I've explained this better. Easiest way, given how new it is, would be to use the site:domain query.
I'm not saying Google are using bogus headers, I am saying that Google may have cached the site and then the bot/crawler that is hounding his site (which is not google, but a rouge bot/crawler/user) with queries is using a fake header by initially finding the site VIA Google, this is why I asked if his NEW site was indexed, to rule this out as a THEORY. Per user agent; "67.0.2768.182" This does not exist or at least I cannot find anything relating to it.I have never in my 15 years as a webmaster seen Google use bogus user-agents. Do you have any proof of this? I'm interested in learning more.
We use essential cookies to make this site work, and optional cookies to enhance your experience.