XF 2.2 userRenameDelete jobs get stuck in job queue

[Jake B.]

| 2001351 | userRenameDelete7709408  | XF:Atomic                             |
| 2096051 | userRenameDelete11423305 | XF:Atomic                             |
| 2098763 | userRenameDelete8878892  | XF:Atomic                             |
| 2099959 | userRenameDelete1781898  | XF:Atomic                             |
| 2100035 | userRenameDelete9923504  | XF:Atomic                             |
| 2100135 | userRenameDelete5295367  | XF:Atomic                             |
| 2100231 | userRenameDelete9738666  | XF:Atomic                             |
| 2100251 | userRenameDelete10354883 | XF:Atomic                             |
| 2100475 | userRenameDelete4870194  | XF:Atomic                             |
| 2100795 | userRenameDelete10058372 | XF:Atomic                             |
| 2100803 | userRenameDelete11584649 | XF:Atomic                             |
| 2258951 | userRenameDelete5674818  | XF:Atomic                             |
| 2259849 | userRenameDelete468206   | XF:Atomic                             |
| 2267169 | userRenameDelete4484316  | XF:Atomic                             |
| 2394321 | userRenameDelete11270361 | XF:Atomic                             |
| 2394361 | userRenameDelete8811555  | XF:Atomic                             |
| 2394445 | userRenameDelete8118977  | XF:Atomic                             |
| 2394467 | userRenameDelete501224   | XF:Atomic                             |
| 2394537 | userRenameDelete8598170  | XF:Atomic                             |
| 2394555 | userRenameDelete9716065  | XF:Atomic                             |
| 2394579 | userRenameDelete11537483 | XF:Atomic                             |
| 2394621 | userRenameDelete4814172  | XF:Atomic                             |
| 2394661 | userRenameDelete3553475  | XF:Atomic                             |
| 2420677 | userRenameDelete698889   | XF:Atomic                             |
| 2507093 | userRenameDelete5358901  | XF:Atomic                             |
| 2560281 | userRenameDelete9802063  | XF:Atomic                             |
| 2560311 | userRenameDelete11606583 | XF:Atomic                             |
| 2560339 | userRenameDelete9719913  | XF:Atomic                             |
| 2560357 | userRenameDelete11561153 | XF:Atomic                             |
| 2560417 | userRenameDelete11608095 | XF:Atomic                             |
| 2560447 | userRenameDelete11509957 | XF:Atomic                             |
| 2560495 | userRenameDelete11396581 | XF:Atomic                             |
| 2560503 | userRenameDelete6136495  | XF:Atomic                             |
| 2560563 | userRenameDelete9812637  | XF:Atomic                             |
| 2560597 | userRenameDelete5389214  | XF:Atomic                             |
| 2560629 | userRenameDelete8680203  | XF:Atomic                             |
| 2745419 | userRenameDelete9999736  | XF:Atomic                             |
| 2745431 | userRenameDelete4051718  | XF:Atomic                             |
| 2745511 | userRenameDelete3920433  | XF:Atomic                             |
| 2798805 | userRenameDelete6418186  | XF:Atomic                             |
| 2798825 | userRenameDelete5163693  | XF:Atomic                             |
| 2798955 | userRenameDelete1152569  | XF:Atomic                             |
| 2798961 | userRenameDelete11625005 | XF:Atomic                             |
| 2799057 | userRenameDelete8059266  | XF:Atomic                             |
| 2799115 | userRenameDelete8593221  | XF:Atomic                             |
| 2953047 | userRenameDelete263746   | XF:Atomic                             |
| 2970217 | userRenameDelete7892307  | XF:Atomic                             |
| 2970325 | userRenameDelete1022534  | XF:Atomic                             |
| 2970419 | userRenameDelete9552860  | XF:Atomic                             |
| 2970425 | userRenameDelete5854270  | XF:Atomic                             |
| 2970447 | userRenameDelete5399433  | XF:Atomic                             |
| 2970551 | userRenameDelete10938663 | XF:Atomic                             |
| 2970571 | userRenameDelete9420647  | XF:Atomic                             |
| 2970595 | userRenameDelete10264843 | XF:Atomic                             |
| 2970611 | userRenameDelete11410941 | XF:Atomic                             |
| 2970625 | userRenameDelete9612312  | XF:Atomic                             |
| 2973875 | userRenameDelete2385821  | XF:Atomic                             |
| 3024589 | userRenameDelete11629289 | XF:Atomic                             |
| 3142455 | userRenameDelete4171677  | XF:Atomic                             |
| 3142487 | userRenameDelete6461413  | XF:Atomic                             |
| 3142497 | userRenameDelete11642525 | XF:Atomic                             |
| 3142767 | userRenameDelete8715939  | XF:Atomic                             |
| 3142809 | userRenameDelete11635849 | XF:Atomic                             |
| 3142821 | userRenameDelete11639209 | XF:Atomic                             |
| 3151623 | userRenameDelete451694   | XF:Atomic                             |
| 3270825 | userRenameDelete6740251  | XF:Atomic                             |
| 3270959 | userRenameDelete10454581 | XF:Atomic                             |
| 3270989 | userRenameDelete10071446 | XF:Atomic                             |
| 3270991 | userRenameDelete7690410  | XF:Atomic                             |
| 3271033 | userRenameDelete1509479  | XF:Atomic                             |
| 3271163 | userRenameDelete5008566  | XF:Atomic                             |
| 3271183 | userRenameDelete8043947  | XF:Atomic                             |
| 3271283 | userRenameDelete9205923  | XF:Atomic                             |
| 3415923 | userRenameDelete3553393  | XF:Atomic                             |
| 3416029 | userRenameDelete7405446  | XF:Atomic                             |
| 3416151 | userRenameDelete5829840  | XF:Atomic                             |
| 3416167 | userRenameDelete7190731  | XF:Atomic                             |
| 3416199 | userRenameDelete5810078  | XF:Atomic                             |
| 3416207 | userRenameDelete7383070  | XF:Atomic                             |
| 3416241 | userRenameDelete8073516  | XF:Atomic                             |
| 3418689 | userRenameDelete1844729  | XF:Atomic                             |
| 3418693 | userRenameDelete4597187  | XF:Atomic                             |
| 3447097 | userRenameDelete8495098  | XF:Atomic                             |
| 3538507 | userRenameDelete10008763 | XF:Atomic                             |
| 3538523 | userRenameDelete1610623  | XF:Atomic                             |
| 3607301 | userRenameDelete11543889 | XF:Atomic                             |
| 3607333 | userRenameDelete4794919  | XF:Atomic                             |
| 3607383 | userRenameDelete9737496  | XF:Atomic                             |
| 3607417 | userRenameDelete11539941 | XF:Atomic                             |
| 3607435 | userRenameDelete9880502  | XF:Atomic                             |
| 3607493 | userRenameDelete10912683 | XF:Atomic                             |
| 3607539 | userRenameDelete6269068  | XF:Atomic                             |
| 3607553 | userRenameDelete4764505  | XF:Atomic                             |
| 3607629 | userRenameDelete9634268  | XF:Atomic                             |
| 3607849 | userRenameDelete335669   | XF:Atomic                             |
| 3631729 | userMerge627785-11681881 | XF:UserMerge                          |

I removed those jobs from the xf_job table yesterday as they were blocking other things (such as daily stats) from running, but this morning there are already a few more queued:

| 3631729 | userMerge627785-11681881               | XF:UserMerge                          |   1625059661 |          NULL |
| 3798859 | userRenameDelete9699017                | XF:Atomic                             |   1625652665 |          NULL |
| 3798879 | userRenameDelete10597155               | XF:Atomic                             |   1625652701 |          NULL |
| 3798945 | userRenameDelete9218411                | XF:Atomic                             |   1625652809 |          NULL |
| 3798957 | userRenameDelete2333096                | XF:Atomic                             |   1625652831 |          NULL |
| 3799071 | userRenameDelete5334403                | XF:Atomic                             |   1625653026 |          NULL |
| 3799119 | userRenameDelete6822086                | XF:Atomic                             |   1625653124 |          NULL |
| 3799279 | userRenameDelete11694417               | XF:Atomic                             |   1625653336 |          NULL |

For reference, it is currently 9:05AM CDT and the oldest record has been stuck since 5:11AM CDT



If there's any additional details I can provide just let me know.

 

[Chris D]

Is there any sort of add-on that might be responsible for automatically deleting or pruning user accounts?

 

[Mike]

Though we don't have the column headers, those nulls probably indicate that these haven't been run yet, so it's really just that earlier jobs are still pending. I don't think they're "stuck" exactly, but the whole user deletion/rename process can take some time to run (for various reasons), so I assume there's just a backlog from some sort of mass deletion.

I'm assuming these are not manual execute jobs, which would probably indicate this wasn't triggered from the control panel and thus it would fit with automatically deleting users.

 

[Jake B.]

Is there any sort of add-on that might be responsible for automatically deleting or pruning user accounts?

Nothing like that I don't believe. As far as I'm aware it's all done manually by their admins

Though we don't have the column headers, those nulls probably indicate that these haven't been run yet, so it's really just that earlier jobs are still pending.

Ah yeah sorry thought I copied those headers as well, but that NULL value is for the last run time. I didn't think to get those values before deleting the old ones but something was definitely blocking the crons from running for at least a couple days, and it began running again when I removed those values

I'm assuming these are not manual execute jobs, which would probably indicate this wasn't triggered from the control panel and thus it would fit with automatically deleting users.

manual_execute has a value of 1 so they appear to be manual deletions. I reached out yesterday and mentioned that they shouldn't close their browser when they get the "Processing" splash page that comes up while the job runs via their browser, and they said they've never seen it and it just goes to the user list when they delete the user.

I'm guessing these aren't being run by the CLI job runner since they were manually triggered?

For the record, here are all currently queued jobs:

mysql> select job_id, unique_key, execute_class, manual_execute, trigger_date, last_run_date from xf_job order by trigger_date asc;
+---------+------------------------------------+---------------------------------------+----------------+--------------+---------------+
| job_id  | unique_key                         | execute_class                         | manual_execute | trigger_date | last_run_date |
+---------+------------------------------------+---------------------------------------+----------------+--------------+---------------+
| 3515527 | deleteUserGroup95                  | XF:UserGroupDelete                    |              1 |   1624631124 |          NULL |
| 3631729 | userMerge627785-11681881           | XF:UserMerge                          |              1 |   1625059661 |          NULL |
| 3798859 | userRenameDelete9699017            | XF:Atomic                             |              1 |   1625652665 |          NULL |
| 3798879 | userRenameDelete10597155           | XF:Atomic                             |              1 |   1625652701 |          NULL |
| 3798945 | userRenameDelete9218411            | XF:Atomic                             |              1 |   1625652809 |          NULL |
| 3798957 | userRenameDelete2333096            | XF:Atomic                             |              1 |   1625652831 |          NULL |
| 3799071 | userRenameDelete5334403            | XF:Atomic                             |              1 |   1625653026 |          NULL |
| 3799119 | userRenameDelete6822086            | XF:Atomic                             |              1 |   1625653124 |          NULL |
| 3799279 | userRenameDelete11694417           | XF:Atomic                             |              1 |   1625653336 |          NULL |
| 3803835 | threadloomSearchIndexpostedit:post | Threadloom\Search:SearchIndex         |              0 |   1625668432 |          NULL |
|       2 | cron                               | XF\Job\Cron                           |              0 |   1625668459 |    1625668399 |
|       4 | xfUpgradeCheck                     | XF:UpgradeCheck                       |              0 |   1625726814 |    1625625603 |
+---------+------------------------------------+---------------------------------------+----------------+--------------+---------------+

It looks like the cron job was last run ~ 7 minutes ago

 

[Chris D]

I assume this sorted itself out in the end?

As these were manual_execute they'd require running as a blocking job in the browser to be processed.

 

[Jake B.]

mysql> select job_id, unique_key, execute_class, manual_execute, trigger_date, last_run_date from xf_job order by trigger_date asc;
+---------+----------------------------------------+-------------------------------+----------------+--------------+---------------+
| job_id  | unique_key                             | execute_class                 | manual_execute | trigger_date | last_run_date |
+---------+----------------------------------------+-------------------------------+----------------+--------------+---------------+
| 5268715 | userRenameDelete10783787               | XF:Atomic                     |              1 |   1630493614 |          NULL |
| 5268745 | userRenameDelete11438943               | XF:Atomic                     |              1 |   1630493697 |          NULL |
| 5268763 | userRenameDelete10128453               | XF:Atomic                     |              1 |   1630493759 |          NULL |
| 5268785 | userRenameDelete10564333               | XF:Atomic                     |              1 |   1630493778 |          NULL |
| 5268879 | userRenameDelete5085593                | XF:Atomic                     |              1 |   1630493965 |          NULL |
| 5268883 | userRenameDelete6780565                | XF:Atomic                     |              1 |   1630494003 |          NULL |
| 5268961 | userRenameDelete8887457                | XF:Atomic                     |              1 |   1630494184 |          NULL |
| 5269075 | userRenameDelete11786869               | XF:Atomic                     |              1 |   1630494365 |          NULL |
| 5269241 | userRenameDelete7752868                | XF:Atomic                     |              1 |   1630494636 |          NULL |

Not really, no. Users are still being deleted manually and the job gets stuck in the queue. I've asked around and have been told nobody is skipping any sort of processing prompt. We've just started to manually trigger these occasionally when we notice the notice at the top of the admin page about pending jobs.

Would be nice if there were a toggle on the xf:run-jobs CLI to run manual jobs as well as the others, right now it's a toggle for one or the other