1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

XF 1.2 Duplicate content

Discussion in 'Troubleshooting and Problems' started by Fred., Feb 6, 2014.

  1. Fred.

    Fred. Well-Known Member

    Hi,

    I have my site on domain.com and i'm serving my images and JS from a static domain img.otherdomain.com and js.otherdomain.com. The otherdomain.com points to the same data directory on my server.

    Today i've noticed that google is indexing my forum from otherdomain.com and that my forum is available from otherdomain.com :eek:

    I've had vBulletin + vBSEO installed before and never had a problem with this.

    How can i block this so they can't access the forum from otherdomain.com?

    Rewrite rules?
    Can anyone give me some examples? I don't know exactly how to fix this.

    Thanks :)
     
  2. Jake Bunce

    Jake Bunce XenForo Moderator Staff Member

    We can use rewrite rules if you can identify the types of URLs that you want to allow on otherdomain.com. For example, if all images / js are contained in specific directories then you can use rewrites to white list those directories and redirect everything else. I just need example URLs from you.
     
  3. Fred.

    Fred. Well-Known Member

    Hi Jake,

    I have data.otherdomain.com for images.
    Example url :
    Code:
    http://data.otherdomain.com/data/avatars/m/0/3.jpg?1389192243
    js.otherdomain.com for javascript.
    Example url :
    Code:
    http://js.otherdomain.com/js/xenforo/xenforo.js?_v=1a58a291
    and att.otherdomain.com for attachments.
    Example url :
    Code:
    http://att.otherdomain.com/2014/02/515_43ae13d9c5e2c0b943c7a167ffaf0622.jpg?Expires=1391785869&Signature=Pp1vsjhn9oror0EMQ-rHv-u0JUDupSkSxpkc7CHAGk7y6tLLpQ8be4QrQfPQZCQfDBfXldCbI144Ng367N4MhzBj7IC2P5qFPNdvEsHw3t1~YAunz4f9ZCbsFGnoEv0HdFymCTF0XbJ4eUTiR0654Ggkye1Xi9Gvi5w7HbrsJX75GdEC6iLxck38XOaFyCKy4YnGES3hT0QKdzha8bRJrNsf94RmCw99FrbW0XE1knpQ61giGkGY2oF9Cg5fEMs46Z1kcZDxLdKH3S6GsxGjokpHcTY0dn2vkdSPO-vBDweFzODpjhyNkvTRnAfWQVpw0qaNydGBNC2xc1mGzEqF2Q__&Key-Pair-Id=APKAIAAQJBX2CX45RHEQ
    I use a CDN for all of these (My CDN provider Pull's the static content from my server)

    In the near future I want to switch to full SSL so it must be available over SSL too.
    All other url's can redirect to domain.com

    Thanks :)
     
  4. Jake Bunce

    Jake Bunce XenForo Moderator Staff Member

    Put at the top of the .htaccess file in your web root:

    Code:
    RewriteEngine On
    
    RewriteCond %{HTTP_HOST} ^data\.otherdomain\.com$
    RewriteRule ^data/ - [S=1]
    RewriteRule ^(.*)$ http://www.maindomain.com/$1 [R=301,L]
    
    RewriteCond %{HTTP_HOST} ^js\.otherdomain\.com$
    RewriteRule ^js/ - [S=1]
    RewriteRule ^(.*)$ http://www.maindomain.com/$1 [R=301,L]
    
    RewriteCond %{HTTP_HOST} ^att\.otherdomain\.com$
    RewriteRule ^[0-9]{4}/ - [S=1]
    RewriteRule ^(.*)$ http://www.maindomain.com/$1 [R=301,L]
    
    That should do it.
     
  5. Fred.

    Fred. Well-Known Member

    Hi Jake,

    It's in conflict with my other rewrite rules. (redirection loop)

    Code:
    RewriteEngine on
    
    RewriteCond %{HTTP_HOST} ^maindomain.com$
    RewriteRule (.*) http://www.maindomain.com$1 [R=301,L]
    
    RewriteRule f[\d]+/.+-([\d]+)/index([\d]+).html showthread.php?t=$1&page=$2 [NC,L]
    RewriteRule f[\d]+/.+-([\d]+)/ showthread.php?t=$1 [NC,L]
    RewriteRule f([\d]+)/index([\d]+).html forumdisplay.php?f=$1&page=$2 [NC,L]
    RewriteRule f([\d]+)/ forumdisplay.php?f=$1 [NC,L]
    I just tried it on 1 of my sites, i'll try it on the other one tonight. But it's probably going to be the same.
     
  6. Jake Bunce

    Jake Bunce XenForo Moderator Staff Member

    Nah that's my dumb.

    Try this:

    Code:
    RewriteEngine On
    
    RewriteCond %{HTTP_HOST} ^data\.otherdomain\.com$
    RewriteRule !^(data/.*)$ http://www.maindomain.com/$1 [R=301,L]
    
    RewriteCond %{HTTP_HOST} ^js\.otherdomain\.com$
    RewriteRule !^(js/.*)$ http://www.maindomain.com/$1 [R=301,L]
    
    RewriteCond %{HTTP_HOST} ^att\.otherdomain\.com$
    RewriteRule !^([0-9]{4}/.*)$ http://www.maindomain.com/$1 [R=301,L]
    
     
  7. Fred.

    Fred. Well-Known Member

    Great! Thanks :)
    That works perfect :D

    One more question.
    When I go to data.otherdomain.com it shows my forum index, all the forum links are pointing to the main domain. But the index is still duplicate content. Do you think there is a solution for this? Is it bad? Or should i leave it like that?
     
  8. Jake Bunce

    Jake Bunce XenForo Moderator Staff Member

    My rules should not allow the index of those subdomains to get through.
     
  9. Fred.

    Fred. Well-Known Member

    Should not :p But they do. :D
    I have no other Rewrite rules for otherdomain.com in my .htaccess :confused:
     

Share This Page