Optimized List Queries by Xon 2.12.0

[Xon]

Xon submitted a new resource:

Optimized List Queries by Xon - A collection of replacement queries for getting lists of stuff aimed at large forums.

This addon is aimed at large forum with tens of thousands to hundreds of thousands or more threads in a single forum. Smaller forum do not gain much benefit from this add-on.

Forum/conversation lists:

MySQL implements 'early row lookup', when combined with LIMIT & OFFSET with a large offset, results in the large select statement pulling in more data than is required. Maybe one day MySQL will fix this. Maybe.

This causes an issue as this how conversations and threads...

Read more about this resource...

 

[Xon]

Xon updated Optimized List Queries by Xon with a new update entry:

2.0.1 - Bugfix update

• Better Thread List Page Threshold actually refer to pages instead of individual item counts

Read the rest of this update entry...

 

[DistortedDorian]

Thanks, optimizations are always greatly welcomed.

 

[nrep]

Really glad to see this for XF2 - it made a big difference on our XF1 installation .

 

[Xon]

Xon updated Optimized List Queries by Xon with a new update entry:

2.0.3 - Maintenance update

• Add resource icon
• Cleanup phrasing and allow "-1" for various thresholds to actually disable things.
• Support extending member list.

Read the rest of this update entry...

 

[nrep]

I've just upgraded a large forum and used this on XF1 and XF2 - the XF1 version made a huge difference when viewing page number #2000 of a forum, but the XF2 version only results in a slight improvement. Does the new verion implement improvements in a different way, or is it just XF2 is slower in this regard?

Not complaining about this excellent addon , indeed I'm very grateful for it . I'm just wondering if there was a reason the XF1 version was so much faster.

 

[Xon]

You'ld need to compare query time for XF1 vs XF2, to determine if it is changes in SQL query time or php overheads. Hard to tell without comparing.

It does still make a difference, just check the activation thresholds make sense.

 

[dethfire]

Is this extended to posts in a thread too?

 

[Xon]

Is this extended to posts in a thread too?

No, XenForo doesn't use limit/offset for threads in a post due to post position information.

 

[Xon]

Xon updated Optimized List Queries by Xon with a new update entry:

2.1.0 - Feature update

• Extend node list loading code to reduce query count on viewing the forum list or a forum with child nodes.
  • Removes 2-4 queries depending on the number of unique node types (forum/link forum/category/page/etc) in the node list.
  • Avoids sending a potentially huge list of node ids into MySQL queries for node type's extra content.

Read the rest of this update entry...

 

[imno007]

Get this when trying to access any node:

ErrorException: [E_NOTICE] Undefined index: entity_identifier in src/addons/SV/OptimizedListQueries/XF/Repository/Node.php at line 38

2. XF::handlePhpError() in src/addons/SV/OptimizedListQueries/XF/Repository/Node.php at line 38
4. SV\OptimizedListQueries\XF\Repository\Node->getNodeList() in src/XF/Pub/Controller/Forum.php at line 235
6. XF\Pub\Controller\Forum->actionForum() in src/addons/SV/OptimizedListQueries/XF/Pub/Controller/Forum.php at line 31
8. SV\OptimizedListQueries\XF\Pub\Controller\Forum->actionForum() in src/XF/Mvc/Dispatcher.php at line 321
10. XF\Mvc\Dispatcher->dispatchClass() in src/XF/Mvc/Dispatcher.php at line 244
12. XF\Mvc\Dispatcher->dispatchFromMatch() in src/XF/Mvc/Dispatcher.php at line 100
14. XF\Mvc\Dispatcher->dispatchLoop() in src/XF/Mvc/Dispatcher.php at line 50
16. XF\Mvc\Dispatcher->run() in src/XF/App.php at line 2177
18. XF\App->run() in src/XF.php at line 390
20. XF::runApp() in index.php at line 20

 

[imno007]

@Xon
Unfortunately, the errors are persisting even after uninstalling the addon. Any suggestions?

 

[imno007]

Alright, fortunately just rebuilding master data resolved things.

 

[Xon]

@Xon
Unfortunately, the errors are persisting even after uninstalling the addon. Any suggestions?

What version of XenForo and php?

 

[imno007]

XF 2.1.1 and PHP 7.3.1

 

[Xon]

Xon updated Optimized List Queries by Xon with a new update entry:

2.1.1 - Maintenance update

• Improve how the 'node type' cache is extended to be more resilient.

Read the rest of this update entry...

 

[Xon]

@imno007 I hit how that section of the code was being extended, should be more reliable now.

 

[Nirjonadda]

@Xon does this add-on help for Improve performance and load fast thread view?

 

[imno007]

@imno007 I hit how that section of the code was being extended, should be more reliable now.

I didn't see any of the previous errors, but certain nodes, for whatever reason, returned a 503 Service temporarily not available error every time they were clicked on, and others did not. Those errors disappeared as soon as I disabled the addon.

 

[imno007]

@Xon does this add-on help for Improve performance and load fast thread view?

This addon provides some optimized query for getting threads in a forum with large number of threads, or for conversations with a very high page count.