XF 2.0 ElasticSearch error logs

[JoyFreak]

Please help me identify what these mean and why I am receiving the errors? There are two pages that date back to Wednesday and all are different errors. I have attached a screenshot of the error log on the first page. Also attached spoilers of a few errors from that list.

Spoiler: Error 1

• XFES\Elasticsearch\RequestException: Elasticsearch indexing error (queued): blocked by: [FORBIDDEN/12/index read-only / allow delete (api)];
• src/addons/XFES/Elasticsearch/Api.php:387
• Generated by: Savage
• Sep 28, 2018 at 12:50 PM

Stack trace
#0 src/addons/XFES/Elasticsearch/Api.php(312): XFES\Elasticsearch\Api->request('put', 'gnonline_admin/...', '{\n "title": ...')
#1 src/addons/XFES/Elasticsearch/Api.php(330): XFES\Elasticsearch\Api->requestFromIndex('put', 'xf/thread-18452', Array)
#2 src/addons/XFES/Elasticsearch/Api.php(152): XFES\Elasticsearch\Api->requestById('put', 'thread', 18452, Array)
#3 src/addons/XFES/Search/Source/Elasticsearch.php(66): XFES\Elasticsearch\Api->index('thread', 18452, Array)
#4 src/XF/Search/Search.php(40): XFES\Search\Source\Elasticsearch->index(Object(XF\Search\IndexRecord))
#5 src/XF/Behavior/Indexable.php(46): XF\Search\Search->index('thread', Object(ThemeHouse\Bookmarks\XF\Entity\Thread), true)
#6 src/XF.php(245): XF\Behavior\Indexable->XF\Behavior\{closure}()
#7 src/XF/Mvc/Dispatcher.php(137): XF::triggerRunOnce(true)
#8 src/XF/Mvc/Dispatcher.php(41): XF\Mvc\Dispatcher->dispatchLoop(Object(XF\Mvc\RouteMatch))
#9 src/XF/App.php(1931): XF\Mvc\Dispatcher->run()
#10 src/XF.php(329): XF\App->run()
#11 index.php(13): XF::runApp('XF\\Pub\\App')
#12 {main}
Request state
array(4) {
["url"] => string(12) "/inline-mod/"
["referrer"] => string(61) "https://www.joyfreak.com/forums/mu-server-advertisements.142/"
["_GET"] => array(0) {
}
["_POST"] => array(12) {
["reason"] => string(0) ""
["starter_alert"] => string(1) "1"
["starter_alert_reason"] => string(65) "There is already an OpenMu advertisement thread. No need for two."
["ids"] => array(1) {
[0] => string(5) "18452"
}
["type"] => string(6) "thread"
["action"] => string(8) "nf_trash"
["confirmed"] => string(1) "1"
["_xfRedirect"] => string(61) "https://www.joyfreak.com/forums/mu-server-advertisements.142/"
["_xfToken"] => string(8) "********"
["_xfRequestUri"] => string(37) "/forums/mu-server-advertisements.142/"
["_xfWithData"] => string(1) "1"
["_xfResponseType"] => string(4) "json"
}
}

Spoiler: Error 2

• XFES\Elasticsearch\BulkRequestException: Elasticsearch indexing error: Elasticsearch bulk action error (first error: [thread-18452] blocked by: [FORBIDDEN/12/index read-only / allow delete (api)]
• src/addons/XFES/Elasticsearch/Api.php:408
• Generated by: Unknown account
• Sep 28, 2018 at 12:50 PM

Stack trace
#0 src/addons/XFES/Elasticsearch/Api.php(171): XFES\Elasticsearch\Api->bulkRequest('{"index":{"_ind...')
#1 src/addons/XFES/Search/Source/Elasticsearch.php(82): XFES\Elasticsearch\Api->indexBulk(Array)
#2 src/XF/Search/Source/AbstractSource.php(35): XFES\Search\Source\Elasticsearch->flushBulkIndexing()
#3 src/XF/Search/Search.php(98): XF\Search\Source\AbstractSource->disableBulkIndexing()
#4 src/XF/Search/Search.php(62): XF\Search\Search->disableBulkIndexing()
#5 src/XF/Search/Search.php(73): XF\Search\Search->indexEntities('post', Object(XF\Mvc\Entity\ArrayCollection))
#6 src/XF/Job/SearchIndex.php(43): XF\Search\Search->indexByIds('post', Array)
#7 src/XF/Job/Manager.php(241): XF\Job\SearchIndex->run(7.9999990463257)
#8 src/XF/Job/Manager.php(187): XF\Job\Manager->runJobInternal(Array, 7.9999990463257)
#9 src/XF/Job/Manager.php(76): XF\Job\Manager->runJobEntry(Array, 7.9999990463257)
#10 job.php(14): XF\Job\Manager->runQueue(false, 8)
#11 {main}
Request state
array(4) {
["url"] => string(8) "/job.php"
["referrer"] => string(61) "https://www.joyfreak.com/forums/mu-server-advertisements.142/"
["_GET"] => array(0) {
}
["_POST"] => array(0) {
}
}

Spoiler: Error 3

• XF\PrintableException: Job XF:SearchIndex: An error was triggered while indexing. See the XenForo error log for details.
• src/addons/XFES/Search/Source/Elasticsearch.php:87
• Generated by: Unknown account
• Sep 28, 2018 at 12:50 PM

Stack trace
#0 src/XF/Search/Source/AbstractSource.php(35): XFES\Search\Source\Elasticsearch->flushBulkIndexing()
#1 src/XF/Search/Search.php(98): XF\Search\Source\AbstractSource->disableBulkIndexing()
#2 src/XF/Search/Search.php(62): XF\Search\Search->disableBulkIndexing()
#3 src/XF/Search/Search.php(73): XF\Search\Search->indexEntities('post', Object(XF\Mvc\Entity\ArrayCollection))
#4 src/XF/Job/SearchIndex.php(43): XF\Search\Search->indexByIds('post', Array)
#5 src/XF/Job/Manager.php(241): XF\Job\SearchIndex->run(7.9999990463257)
#6 src/XF/Job/Manager.php(187): XF\Job\Manager->runJobInternal(Array, 7.9999990463257)
#7 src/XF/Job/Manager.php(76): XF\Job\Manager->runJobEntry(Array, 7.9999990463257)
#8 job.php(14): XF\Job\Manager->runQueue(false, 8)
#9 {main}
Request state
array(4) {
["url"] => string(8) "/job.php"
["referrer"] => string(61) "https://www.joyfreak.com/forums/mu-server-advertisements.142/"
["_GET"] => array(0) {
}
["_POST"] => array(0) {
}
}

Spoiler: Error 4

Server error log

• XFES\Elasticsearch\RequestException: Elasticsearch indexing error (queued): blocked by: [FORBIDDEN/12/index read-only / allow delete (api)];
• src/addons/XFES/Elasticsearch/Api.php:387
• Generated by: Savage
• Sep 28, 2018 at 12:48 PM

Stack trace
#0 src/addons/XFES/Elasticsearch/Api.php(312): XFES\Elasticsearch\Api->request('put', 'gnonline_admin/...', '{\n "title": ...')
#1 src/addons/XFES/Elasticsearch/Api.php(330): XFES\Elasticsearch\Api->requestFromIndex('put', 'xf/thread-18453', Array)
#2 src/addons/XFES/Elasticsearch/Api.php(152): XFES\Elasticsearch\Api->requestById('put', 'thread', 18453, Array)
#3 src/addons/XFES/Search/Source/Elasticsearch.php(66): XFES\Elasticsearch\Api->index('thread', 18453, Array)
#4 src/XF/Search/Search.php(40): XFES\Search\Source\Elasticsearch->index(Object(XF\Search\IndexRecord))
#5 src/XF/Behavior/Indexable.php(46): XF\Search\Search->index('thread', Object(ThemeHouse\Bookmarks\XF\Entity\Thread), true)
#6 src/XF.php(245): XF\Behavior\Indexable->XF\Behavior\{closure}()
#7 src/XF/Mvc/Dispatcher.php(137): XF::triggerRunOnce(true)
#8 src/XF/Mvc/Dispatcher.php(41): XF\Mvc\Dispatcher->dispatchLoop(Object(XF\Mvc\RouteMatch))
#9 src/XF/App.php(1931): XF\Mvc\Dispatcher->run()
#10 src/XF.php(329): XF\App->run()
#11 index.php(13): XF::runApp('XF\\Pub\\App')
#12 {main}
Request state
array(4) {
["url"] => string(23) "/approval-queue/process"
["referrer"] => string(40) "https://www.joyfreak.com/approval-queue/"
["_GET"] => array(0) {
}
["_POST"] => array(5) {
["queue"] => array(2) {
["user"] => array(2) {
[2119] => string(0) ""
[2120] => string(0) ""
}
["thread"] => array(1) {
[18453] => string(7) "approve"
}
}
["_xfToken"] => string(8) "********"
["_xfRequestUri"] => string(16) "/approval-queue/"
["_xfWithData"] => string(1) "1"
["_xfResponseType"] => string(4) "json"
}
}

 

[S Thomas]

https://xenforo.com/community/threa...n-12-index-read-only-allow-delete-api.146539/

 

[JoyFreak]

https://xenforo.com/community/threa...n-12-index-read-only-allow-delete-api.146539/

Its not even letting me rebuild, throws this error?

• XFES\Elasticsearch\BulkRequestException: Elasticsearch indexing error: Elasticsearch bulk action error (first error: [page-83] blocked by: [FORBIDDEN/12/index read-only / allow delete (api)]
• src/addons/XFES/Elasticsearch/Api.php:408
• Generated by: Savage
• Sep 28, 2018 at 3:15 PM

Stack trace
#0 src/addons/XFES/Elasticsearch/Api.php(171): XFES\Elasticsearch\Api->bulkRequest('{"index":{"_ind...')
#1 src/addons/XFES/Search/Source/Elasticsearch.php(82): XFES\Elasticsearch\Api->indexBulk(Array)
#2 src/XF/Search/Source/AbstractSource.php(35): XFES\Search\Source\Elasticsearch->flushBulkIndexing()
#3 src/XF/Search/Search.php(98): XF\Search\Source\AbstractSource->disableBulkIndexing()
#4 src/XF/Search/Search.php(62): XF\Search\Search->disableBulkIndexing()
#5 src/XF/Search/Search.php(85): XF\Search\Search->indexEntities('page', Object(XF\Mvc\Entity\ArrayCollection))
#6 src/XF/Job/SearchRebuild.php(57): XF\Search\Search->indexRange('page', 0, '500')
#7 src/XF/Job/Manager.php(241): XF\Job\SearchRebuild->run(8)
#8 src/XF/Job/Manager.php(187): XF\Job\Manager->runJobInternal(Array, 8)
#9 src/XF/Job/Manager.php(103): XF\Job\Manager->runJobEntry(Array, 8)
#10 src/XF/Admin/Controller/Tools.php(120): XF\Job\Manager->runByIds(Array, 8)
#11 src/XF/Mvc/Dispatcher.php(249): XF\Admin\Controller\Tools->actionRunJob(Object(XF\Mvc\ParameterBag))
#12 src/XF/Mvc/Dispatcher.php(88): XF\Mvc\Dispatcher->dispatchClass('XF:Tools', 'RunJob', 'html', Object(XF\Mvc\ParameterBag), 'tools', Object(XF\Admin\Controller\Tools), NULL)
#13 src/XF/Mvc/Dispatcher.php(41): XF\Mvc\Dispatcher->dispatchLoop(Object(XF\Mvc\RouteMatch))
#14 src/XF/App.php(1931): XF\Mvc\Dispatcher->run()
#15 src/XF.php(329): XF\App->run()
#16 admin.php(13): XF::runApp('XF\\Admin\\App')
#17 {main}
Request state
array(4) {
["url"] => string(24) "/admin.php?tools/run-job"
["referrer"] => string(48) "https://www.joyfreak.com/admin.php?tools/run-job"
["_GET"] => array(1) {
["tools/run-job"] => string(0) ""
}
["_POST"] => array(3) {
["_xfRedirect"] => string(58) "https://www.joyfreak.com/admin.php?tools/rebuild&success=1"
["_xfToken"] => string(8) "********"
["only_ids"] => string(2) "20"
}
}

 

[Xon]

You need to run this from the CLI manually;

curl -XPUT 'localhost:9200/_all/_settings?pretty' -H 'Content-Type: application/json' -d '{
    "index": {
        "blocks": {
            "read_only_allow_delete": "false"
        }
    }
}'

curl -XPUT 'localhost:9200/_settings?pretty' -H 'Content-Type: application/json' -d '{
    "index": {
        "blocks": {
            "read_only_allow_delete": "false"
        }
    }
}'

Elasticsearch is in a wedged state where it will refuse todo anything and requires intervention. The XF admin pages will not help in this regard.

 

[Ozzy47]

Which was also mentioned here and here

 

[beerForo]

You need to run this from the CLI manually;

curl -XPUT 'localhost:9200/_all/_settings?pretty' -H 'Content-Type: application/json' -d '{
    "index": {
        "blocks": {
            "read_only_allow_delete": "false"
        }
    }
}'

curl -XPUT 'localhost:9200/_settings?pretty' -H 'Content-Type: application/json' -d '{
    "index": {
        "blocks": {
            "read_only_allow_delete": "false"
        }
    }
}'

Elasticsearch is in a wedged state where it will refuse todo anything and requires intervention. The XF admin pages will not help in this regard.

Anyone suddenly getting ES errors? This did not fix it.

XFES\Elasticsearch\RequestException: Elasticsearch indexing error (queued): blocked by: [FORBIDDEN/12/index read-only / allow delete (api)]; src/addons/XFES/Elasticsearch/Api.php:409

 

[Xon]

XFES\Elasticsearch\RequestException: Elasticsearch indexing error (queued): blocked by: [FORBIDDEN/12/index read-only / allow delete (api)]; src/addons/XFES/Elasticsearch/Api.php:409

Need more of the stack trace to see what is happening. You'll need to check diskspace, after it is solved run that query and maybe restart elasticsearch, but do check the ElasticSearch logs for detailed error messages as by design the API is very limited in the error messages it will give

 

[beerForo]

See below

 

[beerForo]

Upgrading my ES then running command fixed it.