ES 2.2 Failed to reassign persistent tasks

[HybridBoy]

I have this error, out of sudden I got this errors



and my host support says this is the issue below:

[2024-06-06T06:35:31,880][WARN ][o.e.p.PersistentTasksClusterService] [ my server ] failed to reassign persistent tasks
org.elasticsearch.cluster.coordination.FailedToCommitClusterStateException: node closed
at org.elasticsearch.cluster.service.MasterService.forkQueueProcessor(MasterService.java:1292) ~[elasticsearch-8.14.0.jar:?]
at org.elasticsearch.cluster.service.MasterService$5.onCompletion(MasterService.java:1256) ~[elasticsearch-8.14.0.jar:?]
at org.elasticsearch.cluster.service.MasterService$5$1.onResponse(MasterService.java:1219) ~[elasticsearch-8.14.0.jar:?]
at org.elasticsearch.cluster.service.MasterService$5$1.onResponse(MasterService.java:1216) ~[elasticsearch-8.14.0.jar:?]
at org.elasticsearch.action.ActionListenerImplementations$RunBeforeActionListener.onResponse(ActionListenerImplementations.java:307) ~[elasticsearch-8.14.0.jar:?]
at org.elasticsearch.action.ActionListenerImplementations$RunAfterActionListener.onResponse(ActionListenerImplementations.java:269) ~[elasticsearch-8.14.0.jar:?]
at org.elasticsearch.action.ActionListenerImplementations$DelegatingResponseActionListener.onResponse(ActionListenerImplementations.java:182) ~[elasticsearch-8.14.0.jar:?]
at org.elasticsearch.cluster.service.MasterService$2.onResponse(MasterService.java:284) ~[elasticsearch-8.14.0.jar:?]
at org.elasticsearch.cluster.service.MasterService$2.onResponse(MasterService.java:281) ~[elasticsearch-8.14.0.jar:?]
at org.elasticsearch.cluster.service.MasterService$3.run(MasterService.java:451) ~[elasticsearch-8.14.0.jar:?]
=====================

From the above logs, it can be concluded that if a persistent task cannot be immediately reassigned and has caused periodic rechecks to be scheduled (on the master node at that time), then those rechecks continue to be rescheduled regardless of whether the node is still the master.

What's the solution to this fix this issue, so I can tell my host? seems this is over their knowledge

 

[Mike S]

Check this out:

Thread 'Elasticsearch 8.14'

Jun 6, 2024

Woke up this morning to see all my Elasticsearch instances down from overnight, as they have released 8.14 and cPanel automatically upgraded them.

[2024-06-06T00:16:32,277][ERROR][o.e.b.Elasticsearch ] [server.domain.co.uk] fatal exception while booting Elasticsearch java.lang.NullPointerException: Cannot invoke "org.elasticsearch.nativeaccess.Systemd.notify_ready()" because "this.systemd" is

[2024-06-06T00:16:32,277][ERROR][o.e.b.Elasticsearch ] [server.domain.co.uk] fatal exception while booting Elasticsearch java.lang.NullPointerException: Cannot invoke "org.elasticsearch.nativeaccess.Systemd.notify_ready()" because "this.systemd" is null at...

discuss.elastic.co

On my cPanel servers running Cloudlinux, I've had to run the following to get ES to start up

setfacl -m u:elasticsearch:rx /usr/lib64/redis/
setfacl -m u:elasticsearch:rx...

• MattW
• elasticsearch enhanced search
• Replies: 7
• Forum: Server configuration and hosting

• 

 

[HybridBoy]

@Mike S thank you

my hosting managed to fix the isssue, installed a previous version, seems some bug with latest version

[2024-06-06T00:16:32,277][ERROR][o.e.b.Elasticsearch ] [server.domain.co.uk] fatal exception while booting Elasticsearch java.lang.NullPointerException: Cannot invoke "org.elasticsearch.nativeaccess.Systemd.notify_ready()" because "this.systemd" is

Caused by: java.nio.file.AccessDeniedException: /usr/lib64/redis/modules at sun.nio.fs.UnixException.translateToIOException(UnixException.java:90) ~[?:?] at sun.nio.fs.UnixException.asIOException(UnixException.java:115) ~[?:?] at...

discuss.elastic.co