Resource icon

MetaMirror 1.6.1

No permission to download
Overview Updates (17) Reviews (24) History Discussion
Hey I can confirm it's working. Sorry for the inconvenience. Basically I was looking in the wrong folder. Remember, I said data/MetaMirrorCache

well it doesn't keep my stuff there. It keeps it in data/attachment-files

Sorry!

I guess it's just not done yet. I do see a lot has been done so far. False Alarm!

Oh wait it's not a false alarm if I'm getting a server error though.

Maybe it was just a fluke.
 
I've had it running since yesterday, and it's done almost 5,000 images so far

Code: 
z22se@z22se.co.uk [~/public_html/internal_data]# less MetaMirror.log | grep Modified | wc -l
4765

and it's only done 58,000 posts, and I've got almost 250,000

The only errors I've got have been 3 of these:

Code: 
ErrorException: Fatal Error: Maximum execution time of 120 seconds exceeded - library/MetaMirror/CronEntry.php:68
Generated By: Unknown Account, Today at 8:37 AM
Stack Trace
#0 [internal function]: XenForo_Application::handleFatalError()
#1 {main}
Request State
array(3) {
  ["url"] => string(35) "http://www.z22se.co.uk/deferred.php"
  ["_GET"] => array(0) {
  }
  ["_POST"] => array(3) {
    ["_xfRequestUri"] => string(44) "/threads/fitting-the-egr-cheater.5891/page-3"
    ["_xfNoRedirect"] => string(1) "1"
    ["_xfResponseType"] => string(4) "json"
  }
}

I run attachment store add-on as well with over 13,000 attachments before starting this.

@DRE - yours has done over 10,000 images so far:

Code: 
public_html/internal_data]# less MetaMirror.log | grep Modified | wc -l
10275
 
Last edited:
  • Like
Reactions: DRE
Think i might have found a bug, tho may well just be my install....

Ok so i'm doing a dry run as suggested.... and it comes up with a list of files no problems...

snapshot.webp

So, check the left where it shows the Post id as a clickable link..... However this point it to www.domain.com/posts/ as opposed to www.domain.com/community/posts

Probably a configuration issue from my side, however I cant for the life of me find out where it's going wrong.....

Cheers
Paul
 
ErrorException: rename(/home/blah/public_html/data/MetaMirrorCache/athumbnails25.imagebam.com_12716_427aef127157494.jpg,/home/blah/public_html/data/attachment-files/2011/04/17588_athumbnails25.imagebam.com_12716_427aef127157494.jpg): No such file or directory - library/bdAttachmentStore/Model/File.php:305 Generated By: Unknown Account, Today at 12:13 AM Stack Trace #0 [internal function]: XenForo_Application::handlePhpError(2, 'rename(/home/dr...', '/home/blah/publi...', 305, Array) #1 /home/blah/public_html/library/bdAttachmentStore/Model/File.php(305): rename('/home/blah/publi...', '/home/blah/publi...') #2 /home/blah/public_html/library/bdAttachmentStore/Model/File.php(259): bdAttachmentStore_Model_File->_externalData_moveFile('/home/blah/publi...', '/home/blah/publi...') #3 /home/blah/public_html/library/bdAttachmentStore/Model/File.php(18): bdAttachmentStore_Model_File->_externalData_saveFile(Array, '/home/blah/publi...', '2011/04/17588_5...', 'athumbnails25.i...') #4 /home/blah/public_html/library/bdAttachmentStore/XenForo/DataWriter/AttachmentData.php(118): bdAttachmentStore_Model_File->saveFile('external_data', Array, '/home/blah/publi...', '2011/04/17588_5...', 'athumbnails25.i...') #5 /home/blah/public_html/library/XenForo/DataWriter/AttachmentData.php(143): bdAttachmentStore_XenForo_DataWriter_AttachmentData->_writeAttachmentFile('/home/blah/publi...', Array) #6 /home/blah/public_html/library/XenForo/DataWriter.php(1397): XenForo_DataWriter_AttachmentData->_postSave() #7 /home/blah/public_html/library/XenForo/Model/Attachment.php(524): XenForo_DataWriter->save() #8 /home/blah/public_html/library/MetaMirror/CronEntry.php(411): XenForo_Model_Attachment->insertUploadedAttachmentData(Object(XenForo_Upload), 249, Array) #9 /home/blah/public_html/library/MetaMirror/CronEntry.php(885): MetaMirror_CronEntry::importPostAttachment(Object(Zend_Db_Adapter_Mysqli), 'athumbnails25.i...', '/home/blah/publi...', 249, 46552, 1302761579) #10 /home/blah/public_html/library/MetaMirror/CronEntry.php(1052): MetaMirror_CronEntry::updateSingleContent(Array) #11 /home/blah/public_html/library/MetaMirror/CronEntry.php(544): MetaMirror_CronEntry::runForContentType() #12 [internal function]: MetaMirror_CronEntry::runMetaMirror(Array) #13 /home/blah/public_html/library/XenForo/Model/Cron.php(356): call_user_func(Array, Array) #14 /home/blah/public_html/library/WhoHasReadAThread/Model/Cron.php(30): XenForo_Model_Cron->runEntry(Array) #15 /home/blah/public_html/library/XenForo/Deferred/Cron.php(22): WhoHasReadAThread_Model_Cron->runEntry(Array) #16 /home/blah/public_html/library/XenForo/Model/Deferred.php(198): XenForo_Deferred_Cron->execute(Array, Array, 9.99999594688, '') #17 /home/blah/public_html/library/XenForo/Model/Deferred.php(321): XenForo_Model_Deferred->runDeferred(Array, 9.99999594688, '', false) #18 /home/blah/public_html/library/XenForo/Model/Deferred.php(274): XenForo_Model_Deferred->_runInternal(Array, NULL, '', false) #19 /home/blah/public_html/deferred.php(18): XenForo_Model_Deferred->run(false) #20 {main} Request State array(3) { ["url"] => string(29) "http://8thos.com/deferred.php" ["_GET"] => array(0) { } ["_POST"] => array(4) { ["_xfRequestUri"] => string(1) "/" ["_xfNoRedirect"] => string(1) "1" ["_xfToken"] => string(8) "********" ["_xfResponseType"] => string(4) "json" } }
 
DRE said:
Yes. I did run the testing tool while MetaMirror was enabled. @MattW configured everything for me earlier. About 6 hours later I decided to test out metamirror and forgot that it was already enabled. But the fact that there are only 32 pictures in the data/MetaMirrorCache folder after 6 hours means it wasn't running at all. I'm wondering if the tests I ran is what caused images to go in there in the first place.
Click to expand...

Since you have selected "Use Attachments", then the only files that stay in the MetaMirrorCache folder will be signature images, so what you see is probably correct.

You should be able to see the attachments in the attachment browser. ACP->Applications->Attachment Browser.
 
  • Like
Reactions: DRE
Paul said:
Think i might have found a bug, tho may well just be my install....

Ok so i'm doing a dry run as suggested.... and it comes up with a list of files no problems...

View attachment 56174

So, check the left where it shows the Post id as a clickable link..... However this point it to www.domain.com/posts/ as opposed to www.domain.com/community/posts

Probably a configuration issue from my side, however I cant for the life of me find out where it's going wrong.....

Cheers
Paul
Click to expand...

The Post ID link is just to be helpful, it should not matter if it's wrong - although of course it should not be. I'd suspect your configuration, as I just use the {xen:link posts, $post } template to generate that link.

What's your Options -> Basic Board Information -> Board URL set to?
 
DRE said:
ErrorException: rename(/home/blah/public_html/data/MetaMirrorCache/athumbnails25.imagebam.com_12716_427aef127157494.jpg,/home/blah/public_html/data/attachment-files/2011/04/17588_athumbnails25.imagebam.com_12716_427aef127157494.jpg): No such file or directory - library/bdAttachmentStore/Model/File.php:305 Generated By: Unknown Account, Today at 12:13 AM Stack Trace #0 [internal function]: XenForo_Application::handlePhpError(2, 'rename(/home/dr...', '/home/blah/publi...', 305, Array) #1 /home/blah/public_html/library/bdAttachmentStore/Model/File.php(305): rename('/home/blah/publi...', '/home/blah/publi...') #2 /home/blah/public_html/library/bdAttachmentStore/Model/File.php(259): bdAttachmentStore_Model_File->_externalData_moveFile('/home/blah/publi...', '/home/blah/publi...') #3 /home/blah/public_html/library/bdAttachmentStore/Model/File.php(18): bdAttachmentStore_Model_File->_externalData_saveFile(Array, '/home/blah/publi...', '2011/04/17588_5...', 'athumbnails25.i...') #4 /home/blah/public_html/library/bdAttachmentStore/XenForo/DataWriter/AttachmentData.php(118): bdAttachmentStore_Model_File->saveFile('external_data', Array, '/home/blah/publi...', '2011/04/17588_5...', 'athumbnails25.i...') #5 /home/blah/public_html/library/XenForo/DataWriter/AttachmentData.php(143): bdAttachmentStore_XenForo_DataWriter_AttachmentData->_writeAttachmentFile('/home/blah/publi...', Array) #6 /home/blah/public_html/library/XenForo/DataWriter.php(1397): XenForo_DataWriter_AttachmentData->_postSave() #7 /home/blah/public_html/library/XenForo/Model/Attachment.php(524): XenForo_DataWriter->save() #8 /home/blah/public_html/library/MetaMirror/CronEntry.php(411): XenForo_Model_Attachment->insertUploadedAttachmentData(Object(XenForo_Upload), 249, Array) #9 /home/blah/public_html/library/MetaMirror/CronEntry.php(885): MetaMirror_CronEntry::importPostAttachment(Object(Zend_Db_Adapter_Mysqli), 'athumbnails25.i...', '/home/blah/publi...', 249, 46552, 1302761579) #10 /home/blah/public_html/library/MetaMirror/CronEntry.php(1052): MetaMirror_CronEntry::updateSingleContent(Array) #11 /home/blah/public_html/library/MetaMirror/CronEntry.php(544): MetaMirror_CronEntry::runForContentType() #12 [internal function]: MetaMirror_CronEntry::runMetaMirror(Array) #13 /home/blah/public_html/library/XenForo/Model/Cron.php(356): call_user_func(Array, Array) #14 /home/blah/public_html/library/WhoHasReadAThread/Model/Cron.php(30): XenForo_Model_Cron->runEntry(Array) #15 /home/blah/public_html/library/XenForo/Deferred/Cron.php(22): WhoHasReadAThread_Model_Cron->runEntry(Array) #16 /home/blah/public_html/library/XenForo/Model/Deferred.php(198): XenForo_Deferred_Cron->execute(Array, Array, 9.99999594688, '') #17 /home/blah/public_html/library/XenForo/Model/Deferred.php(321): XenForo_Model_Deferred->runDeferred(Array, 9.99999594688, '', false) #18 /home/blah/public_html/library/XenForo/Model/Deferred.php(274): XenForo_Model_Deferred->_runInternal(Array, NULL, '', false) #19 /home/blah/public_html/deferred.php(18): XenForo_Model_Deferred->run(false) #20 {main} Request State array(3) { ["url"] => string(29) "http://8thos.com/deferred.php" ["_GET"] => array(0) { } ["_POST"] => array(4) { ["_xfRequestUri"] => string(1) "/" ["_xfNoRedirect"] => string(1) "1" ["_xfToken"] => string(8) "********" ["_xfResponseType"] => string(4) "json" } }
Click to expand...

Were you running the test tool with MetaMirror enabled when this happened? That error could occur when the code tries to rehost the same file in the test tool and in the cron job.
 
  • Like
Reactions: DRE
Mick West said:
The Post ID link is just to be helpful, it should not matter if it's wrong - although of course it should not be. I'd suspect your configuration, as I just use the {xen:link posts, $post } template to generate that link.

What's your Options -> Basic Board Information -> Board URL set to?
Click to expand...

Hi Mick,

seems to be correct...

http://www.domain.com/community

Strange....

Cheers
Paul
 
Mick West said:
The Post ID link is just to be helpful, it should not matter if it's wrong - although of course it should not be. I'd suspect your configuration, as I just use the {xen:link posts, $post } template to generate that link.

What's your Options -> Basic Board Information -> Board URL set to?
Click to expand...

I found in the admin template "MetaMirror_index" that you are using this <a href="/posts/{$post.post_id}"> to generate the link, and when I replaced it with <a href="{xen:link posts, $post }">, it generates the link correctly.
I don't know if this is correct (as i'm not a programmer, just a board admin).
 
Mick West said:
Were you running the test tool with MetaMirror enabled when this happened? That error could occur when the code tries to rehost the same file in the test tool and in the cron job.
Click to expand...
K that's probably what it is. Thanks.
 
smimosmile said:
I found in the admin template "MetaMirror_index" that you are using this <a href="/posts/{$post.post_id}"> to generate the link, and when I replaced it with <a href="{xen:link posts, $post }">, it generates the link correctly.
I don't know if this is correct (as i'm not a programmer, just a board admin).
Click to expand...

Erm, no I'm not. I use {xen:link posts, $post }, since that template was added in MetaMirror 1.2.0

Code: 
                <xen:if is="{$i} == 1"><td class="secondaryContent" rowspan="{xen:count $post.found}"><a href="{xen:link posts, $post}" target="_blank">{$post.post_id}</a></td></xen:if>

Maybe you are using a version someone else modified to get around their own configuration problem?
 
  • Like
Reactions: DRE
I'm using the latest unmodified version 1.4.3
In my template, {xen:link posts, $post } is commented with <xen:comment>, and as I read in the faq, <xen:comment> will prevent the content from being output.
Code: 
<xen:if is="{$log}">
    <xen:foreach loop="$log" value="$post">
    <xen:comment>
        <xen:foreach loop="$post.found" key="$key" value="$found" i="$i">
            <tr>
                <xen:if is="{$i} == 1"><td class="secondaryContent" rowspan="{xen:count $post.found}"><a href="{xen:link posts, $post}" target="_blank">{$post.post_id}</a></td></xen:if>
                <td class="primaryContent">{$found}</td>
                <td class="secondaryContent">{$post.replaced.{$key}}</td>
            </tr>
        </xen:foreach>
    </xen:comment>
    <tr style="border:1px solid green;">
    <td style="border:1px solid green; width: 50px;"><a href="/posts/{$post.post_id}">{$post.post_id}</a></td>
    <td style="border:1px solid green; width: 80px;">{$post.size}</td>
    <td style="border:1px solid green; overflow-wrap: break-word; "><a href="{$post.old}">{$post.old}</a></td>
    <xen:if is="{$post.file_local}">
      <td style="border:1px solid green; overflow-wrap: break-word;"><a href="{$post.new_url}">{$post.new}</a></td>
    <xen:else />
      <td style="border:1px solid green; overflow-wrap: break-word;">{$post.new}</td>
    </xen:if>
    </tr>  
      
    </xen:foreach>
    </xen:if>
 
smimosmile said:
I'm using the latest unmodified version 1.4.3
In my template, {xen:link posts, $post } is commented with <xen:comment>, and as I read in the faq, <xen:comment> will prevent the content from being output.
Code: 
<xen:if is="{$log}">
    <xen:foreach loop="$log" value="$post">
    <xen:comment>
        <xen:foreach loop="$post.found" key="$key" value="$found" i="$i">
            <tr>
                <xen:if is="{$i} == 1"><td class="secondaryContent" rowspan="{xen:count $post.found}"><a href="{xen:link posts, $post}" target="_blank">{$post.post_id}</a></td></xen:if>
                <td class="primaryContent">{$found}</td>
                <td class="secondaryContent">{$post.replaced.{$key}}</td>
            </tr>
        </xen:foreach>
    </xen:comment>
    <tr style="border:1px solid green;">
    <td style="border:1px solid green; width: 50px;"><a href="/posts/{$post.post_id}">{$post.post_id}</a></td>
    <td style="border:1px solid green; width: 80px;">{$post.size}</td>
    <td style="border:1px solid green; overflow-wrap: break-word; "><a href="{$post.old}">{$post.old}</a></td>
    <xen:if is="{$post.file_local}">
      <td style="border:1px solid green; overflow-wrap: break-word;"><a href="{$post.new_url}">{$post.new}</a></td>
    <xen:else />
      <td style="border:1px solid green; overflow-wrap: break-word;">{$post.new}</td>
    </xen:if>
    </tr> 
     
    </xen:foreach>
    </xen:if>
Click to expand...

I apologize, it seems I can't read my own code :) The commented out code is actually from someone else's add-on I was using for syntax reference. :(
 
I'll fix it and upload a new version, incorporating this fix:

smimosmile said:
I found in the admin template "MetaMirror_index" that you are using this <a href="/posts/{$post.post_id}"> to generate the link, and when I replaced it with <a href="{xen:link posts, $post }">, it generates the link correctly.
I don't know if this is correct (as i'm not a programmer, just a board admin).
Click to expand...

Not a major problem as it just affects the test link, but still.
 
Mick West updated MetaMirror with a new update entry:

[Minor] Fix post URL in test tool for non-root installs

If you had XF installed in a non-root directory, like /forums or /community then the link given to the post in the test tool would be wrong.

This was more of an annoyance than anything, and did not affect the actual functionality of the tool. If you've already done the tests and started things running then there's no need to update.
Click to expand...

Read the rest of this update entry...
 
You must log in or register to reply here.

Similar threads

AndyB
Link manager [Paid]
Replies
7
Views
458
AndyB
AndyB
K
Duplicate Content containing hash is not embedded
Replies
2
Views
184
Kirby
K
MySiteGuy
Xenforo Proxy Service
Replies
15
Views
3K
MySiteGuy
MySiteGuy
Paul B
  • Locked
  • Sticky
  • Question Question
XenForo Cloud FAQ
Replies
0
Views
5K
Paul B
Paul B
Mouth
My migration of hosting and server to halve costs and easily expand storage
Replies
17
Views
2K
m1ne
m1ne
Top Bottom