XF 1.2 Granting access to Adsense crawler

[Joshua]

I'm trying to give the Google Adsense crawler access to pages available only behind a login. I can't seem to find the right combination of settings...
Adsense prompts for the following info:


What I've been using is:
Restricted Directory or URL: http://mydomain.com
Login URL: http://mydomain.com
Login Method: POST
Parameter 1: login = googlecrawler
Parameter 2: password = password

Any help would be greatly appreciated! Thanks in advance!

 

[Joshua]

Obviously, I've created account 'googlecrawler' with password 'password' on my forum...

 

[Jeremy]

If they are logging in, you need to send it to /login/login (or if you don't use friendly urls. index.php?login/login).

 

[Joshua]

Thanks for the input but that doesn't work either.

 

[Mike]

Does it give you the ability to view the response from the login attempt?

 

[Joshua]

Sort of... Nothing useful to be gleaned though


Edit: Actually it's more like a lack of response from the login attempt.

 

[Joshua]

So many variables involved, I still haven't been able to narrow this down. I've turned on Friendly URLs (see my other thread posted today) and I've tried different variations like: http://www.mydomain.com, http://mydomain.com
Also setting Parameter 1 to login, username, etc

 

[CTXMedia]

Here's what I've got:

Restricted Directory or URL: http://www.cyclechat.net/members/shaun.1 ---- Must be logged in to view profiles, so Google can't see this unless the auth works!
Login URL: http://www.cyclechat.net/index.php?login/login
Login method: POST
Parameters:
login user_account_name
password xxxxxxxx
cookie_check 1

 

[Joshua]

Thanks @Clickfinity I'll give that a try. Do you think http://www.mydomain.com/members/ would work instead of a specific member? Or should it work either way?

 

[CTXMedia]

Thanks @Clickfinity I'll give that a try. Do you think http://www.mydomain.com/members/ would work instead of a specific member? Or should it work either way?

No, I think it'll only work for a specific member who has disallowed non-member viewing of their profile; you could always set-up privacy on the Google crawler account and reference its account profile in the URL!

 

[Joshua]

Thanks everyone for your help. These settings seem to be working OK now! I will update this thread if anything changes!