Dead Link Management [Deleted]

au lait

Well-known member
au lait submitted a new resource:

[by PiX-house.com] Dead Link Management Extended - find all the links in posts, checks their status, and see all links in a list

Please look at the pictures and the demo!

After installation, you find the „Dead Link Managment“ in the Tools and in the Rebuild Caches section. Scroll down and set your time frame. Perhaps it is better to choose smaller time frames, cause the search takes time.

This maintenance run must be done only once, but must in the end have done the whole forum. Should it not be done, only new posted links are automatically recorded.
New links or changes will be recognized...

Read more about this resource...
 
Run into some bugs whilst running the rebuild cache:
Server Error Log
Error Info
ErrorException: Undefined offset: 1 - library/phc/DeadLinkManagement/Helper/Helper.php:223
Generated By: Unknown Account, Today at 1:31 AM
Stack Trace
#0 /home/nginx/domains/mainecoon.nl/public/forum/library/phc/DeadLinkManagement/Helper/Helper.php(223): XenForo_Application::handlePhpError(8, 'Undefined offse...', '/home/nginx/dom...', 223, Array)
#1 /home/nginx/domains/mainecoon.nl/public/forum/library/phc/DeadLinkManagement/Helper/Helper.php(140): phc_DeadLinkManagement_Helper_Helper::get_cUrl_headers('HTTP/1.1 301 Mo...')
#2 /home/nginx/domains/mainecoon.nl/public/forum/library/phc/DeadLinkManagement/Helper/Helper.php(90): phc_DeadLinkManagement_Helper_Helper::do_http_connect('http://www.vita...')
#3 /home/nginx/domains/mainecoon.nl/public/forum/library/phc/DeadLinkManagement/CronEntry/DLMCron.php(53): phc_DeadLinkManagement_Helper_Helper::StartRenewCheck(Array)
#4 [internal function]: phc_DeadLinkManagement_CronEntry_DLMCron::runCheckOld(Array)
#5 /home/nginx/domains/mainecoon.nl/public/forum/library/XenForo/Model/Cron.php(357): call_user_func(Array, Array)
#6 /home/nginx/domains/mainecoon.nl/public/forum/library/XenForo/Deferred/Cron.php(24): XenForo_Model_Cron->runEntry(Array)
#7 /home/nginx/domains/mainecoon.nl/public/forum/library/XenForo/Model/Deferred.php(294): XenForo_Deferred_Cron->execute(Array, Array, 7.9999969005585, '')
#8 /home/nginx/domains/mainecoon.nl/public/forum/library/XenForo/Model/Deferred.php(428): XenForo_Model_Deferred->runDeferred(Array, 7.9999969005585, '', false)
#9 /home/nginx/domains/mainecoon.nl/public/forum/library/XenForo/Model/Deferred.php(373): XenForo_Model_Deferred->_runInternal(Array, NULL, '', false)
#10 /home/nginx/domains/mainecoon.nl/public/forum/deferred.php(23): XenForo_Model_Deferred->run(false)
#11 {main}
Request State
array(3) {
["url"] => string(38) "http://mainecoon.nl/forum/deferred.php"
["_GET"] => array(0) {
}
["_POST"] => array(3) {
["_xfRequestUri"] => string(50) "/forum/threads/hoera-hoera-gordon-is-5-jaar.82492/"
["_xfNoRedirect"] => string(1) "1"
["_xfResponseType"] => string(4) "json"
}
}
Server Error Log
Error Info
ErrorException: Undefined offset: 1 - library/phc/DeadLinkManagement/Helper/Helper.php:223
Generated By: Axel, Yesterday at 11:19 PM
Stack Trace
#0 /home/nginx/domains/mainecoon.nl/public/forum/library/phc/DeadLinkManagement/Helper/Helper.php(223): XenForo_Application::handlePhpError(8, 'Undefined offse...', '/home/nginx/dom...', 223, Array)
#1 /home/nginx/domains/mainecoon.nl/public/forum/library/phc/DeadLinkManagement/Helper/Helper.php(140): phc_DeadLinkManagement_Helper_Helper::get_cUrl_headers('HTTP/1.1 301 Mo...')
#2 /home/nginx/domains/mainecoon.nl/public/forum/library/phc/DeadLinkManagement/Helper/Helper.php(60): phc_DeadLinkManagement_Helper_Helper::do_http_connect('http://www.vita...')
#3 /home/nginx/domains/mainecoon.nl/public/forum/library/phc/DeadLinkManagement/Deferred/DLM.php(43): phc_DeadLinkManagement_Helper_Helper::StartCheck(Array)
#4 /home/nginx/domains/mainecoon.nl/public/forum/library/XenForo/Model/Deferred.php(294): phc_DeadLinkManagement_Deferred_DLM->execute(Array, Array, 7.9999978542328, '')
#5 /home/nginx/domains/mainecoon.nl/public/forum/library/XenForo/Model/Deferred.php(428): XenForo_Model_Deferred->runDeferred(Array, 7.9999978542328, '', false)
#6 /home/nginx/domains/mainecoon.nl/public/forum/library/XenForo/Model/Deferred.php(373): XenForo_Model_Deferred->_runInternal(Array, NULL, '', false)
#7 /home/nginx/domains/mainecoon.nl/public/forum/library/XenForo/ControllerAdmin/Tools.php(159): XenForo_Model_Deferred->run(true, NULL, '', false)
#8 /home/nginx/domains/mainecoon.nl/public/forum/library/XenForo/FrontController.php(347): XenForo_ControllerAdmin_Tools->actionRunDeferred()
#9 /home/nginx/domains/mainecoon.nl/public/forum/library/XenForo/FrontController.php(134): XenForo_FrontController->dispatch(Object(XenForo_RouteMatch))
#10 /home/nginx/domains/mainecoon.nl/public/forum/admin.php(13): XenForo_FrontController->run()
#11 {main}
Request State
array(3) {
["url"] => string(55) "https://mainecoon.nl/forum/admin.php?tools/run-deferred"
["_GET"] => array(1) {
["tools/run-deferred"] => string(0) ""
}
["_POST"] => array(3) {
["redirect"] => string(60) "https://mainecoon.nl/forum/admin.php?tools/rebuild&success=1"
["execute"] => string(1) "1"
["_xfToken"] => string(8) "********"
}
}
 
Looks like the same error.

Did your internet connection had a time out while running the service ? Did you get the Server message, that there is unfinished buisenes to do ?

I had this error in the testing for au Lait, in cause of a break in the internet connection. I clicked to continue the process and it worked fine for me.
 
Looks like the same error.

Did your internet connection had a time out while running the service ? Did you get the Server message, that there is unfinished buisenes to do ?

I had this error in the testing for au Lait, in cause of a break in the internet connection. I clicked to continue the process and it worked fine for me.
I had my laptop running the cache update over night whilst using a tool to prevent it going to sleep mode. I did see an NGINX error next morning, but I am not sure what it was anymore.

I can restart it, but it goes to an NGINX error (504 Gateway timeout) after about 5 mins. Will try the new version in a couple of minutes.
 
Could not install the new version. It broke down with another NGINX error (504 Gateway timeout). I completely uninstalled the addon and installed the latest version.
The first cache build runs as we speak.
 
The first cache build broke down again with an NGINX error (504 Gateway Time-out).
Restarted the unfinished cache build. Seems it continues again.
 
This is only indirectly a problem of DLM. I think the timeout from the server is too small! Please use 50 items per page.
Or set the limit higher.

Please keep me in the loop.
I tested it today under nginx and unfortunately could not detect any problems.
 
Broke down again with 50 items per page. Had to uninstall again.
Now started the cache with 25 items per page.
 
It breaks down again after a restart. Freezes up with no progress. If I start another admin session I see the message that there are unfinished processes.
If I restart it will go back doing 50 per batch (which seems to much).

Uninstalled it and reinstalled it and restarted with 25 a batch. It is running longer now than before.
I haven't had the chance to play with the addon yet, but a first remark is that the progress of the batch is not very transparent. Please show how many messages there are and the amount of messages processed. This gives more of an idea how it is progressing.
 
If you do uninstall the addon every time - it starts again and again from the beginning.

Work with time frame!

The problem is that very many connections are established, and depending on the server / hoster this can quickly come up against limits!

Have u server error logs...?
 
I have to uninstall because the restart does not work with the previously entered settings.
The process keeps running but my log gets filled with errors:

Code:
Server Error Log
Error Info
ErrorException: file_get_contents(https://scontent-ams.xx.fbcdn.net/hphotos-xap1/v/t1.0-9/11156415_10204270187015970_4305971454372346614_n.jpg?oh=5d5420a5fd59a65cdeee7bb999f34354&oe=55DBC93F): failed to open stream: HTTP request failed! HTTP/1.1 403 Forbidden - bdImage/thumbnail.php:92
Generated By: Unknown Account, A moment ago
Stack Trace
#0 [internal function]: XenForo_Application::handlePhpError(2, 'file_get_conten...', '/home/nginx/dom...', 92, Array)
#1 /home/nginx/domains/mainecoon.nl/public/forum/bdImage/thumbnail.php(92): file_get_contents('https://sconten...')
#2 {main}
Request State
array(3) {
  ["url"] => string(290) "http://mainecoon.nl/forum/bdImage/thumbnail.php?url=https%3A%2F%2Fscontent-ams.xx.fbcdn.net%2Fhphotos-xap1%2Fv%2Ft1.0-9%2F11156415_10204270187015970_4305971454372346614_n.jpg%3Foh%3D5d5420a5fd59a65cdeee7bb999f34354%26amp%3Boe%3D55DBC93F&size=48&mode=48&hash=87dc837625f2115052086c8d35e709a8"
  ["_GET"] => array(4) {
    ["url"] => string(160) "https://scontent-ams.xx.fbcdn.net/hphotos-xap1/v/t1.0-9/11156415_10204270187015970_4305971454372346614_n.jpg?oh=5d5420a5fd59a65cdeee7bb999f34354&oe=55DBC93F"
    ["size"] => string(2) "48"
    ["mode"] => string(2) "48"
    ["hash"] => string(32) "87dc837625f2115052086c8d35e709a8"
  }
  ["_POST"] => array(0) {
  }
}
 
I have to uninstall because the restart does not work with the previously entered settings.
The process keeps running but my log gets filled with errors:

Code:
Server Error Log
Error Info
ErrorException: file_get_contents(https://scontent-ams.xx.fbcdn.net/hphotos-xap1/v/t1.0-9/11156415_10204270187015970_4305971454372346614_n.jpg?oh=5d5420a5fd59a65cdeee7bb999f34354&oe=55DBC93F): failed to open stream: HTTP request failed! HTTP/1.1 403 Forbidden - bdImage/thumbnail.php:92
Generated By: Unknown Account, A moment ago
Stack Trace
#0 [internal function]: XenForo_Application::handlePhpError(2, 'file_get_conten...', '/home/nginx/dom...', 92, Array)
#1 /home/nginx/domains/mainecoon.nl/public/forum/bdImage/thumbnail.php(92): file_get_contents('https://sconten...')
#2 {main}
Request State
array(3) {
  ["url"] => string(290) "http://mainecoon.nl/forum/bdImage/thumbnail.php?url=https%3A%2F%2Fscontent-ams.xx.fbcdn.net%2Fhphotos-xap1%2Fv%2Ft1.0-9%2F11156415_10204270187015970_4305971454372346614_n.jpg%3Foh%3D5d5420a5fd59a65cdeee7bb999f34354%26amp%3Boe%3D55DBC93F&size=48&mode=48&hash=87dc837625f2115052086c8d35e709a8"
  ["_GET"] => array(4) {
    ["url"] => string(160) "https://scontent-ams.xx.fbcdn.net/hphotos-xap1/v/t1.0-9/11156415_10204270187015970_4305971454372346614_n.jpg?oh=5d5420a5fd59a65cdeee7bb999f34354&oe=55DBC93F"
    ["size"] => string(2) "48"
    ["mode"] => string(2) "48"
    ["hash"] => string(32) "87dc837625f2115052086c8d35e709a8"
  }
  ["_POST"] => array(0) {
  }
}

The file "/mainecoon.nl/public/forum/bdImage/thumbnail.php" trying to get access to the URL https://scontent-ams.xx.fbcdn.net/h...5fd59a65cdeee7bb999f34354&oe=55DBC93F, but these do not exist!

See the error message "failed to open stream: HTTP request failed! HTTP/1.1 403 Forbidden - bdImage/thumbnail.php:92"

But this is not caused by DLM :)
 
Ugh... it seems the script to clean out those dead links did not do a thorough job :( More work to do.

It seems the setup of the cache completed successfully. Will start to play with the addon now.
 
Top Bottom