XenForo Wonderful Search [Paid] 1.1.0

[Katsuro]

Katsuro submitted a new resource:

XenForo Wonderful Search - An enhanced version of the XenForo search system which uses MeiliSearch as search engine

XenForo Wonderful Search is an innovative search add-on that replacing a built-in XenForo search engine by the lightweight, but hyper-relevant MeiliSearch, to provide forums a better search experience without requiring a lot of calculation resources.

MeiliSearch is a lightning-fast search engine that fits effortlessly into your apps, websites, and workflow

This add-on is an optimized analogue of...

Read more about this resource...

 

[Digital Doctor]

Cool stuff.

To help a website determine how to maximize the search experience of users, the best place to start would be to LOG actual searches. Xenforo doesnt do that.

 

[Katsuro]

Cool stuff.

To help a website determine how to maximize the search experience of users, the best place to start would be to LOG actual searches. Xenforo doesnt do that.

Yes, it's done and add-on already has this feature

 

[olgert zerbaska]

@Katsuro
Except the live search feature what’s the difference between your addon and elastic search/enhanced xf search ?
I don’t own any but I have bookmarked your resource few months ago and I would like to see a comparison

 

[Katsuro]

@Katsuro
Except the live search feature what’s the difference between your addon and elastic search/enhanced xf search ?
I don’t own any but I have bookmarked your resource few months ago and I would like to see a comparison

Main difference between ElasticSearch and MeiliSearch is the performance. As described in thread and displayed in video above, there's a huge difference between these both
There are also many new options in add-on itself, like in Similar threads widget, synonyms, per-node and per-usergroup similar threads permissions (whether show threads in node X or not)

 

[TimWilson]

I'm impressed by what I see, but has anyone here installed it?

Also, is there anywhere else to test it besides your site, @Katsuro? I don't know enough about your site's content to know what I should be searching for.

A major concern for me is performance with 3-letter words, an unfortunately perennial issue that none of my other efforts have successfully dealt with. Any comments on this solution vs. ES specifically for that?

Thanks for any insights you can provide!

 

[Katsuro]

I'm impressed by what I see, but has anyone here installed it?

Also, is there anywhere else to test it besides your site, @Katsuro? I don't know enough about your site's content to know what I should be searching for.

A major concern for me is performance with 3-letter words, an unfortunately perennial issue that none of my other efforts have successfully dealt with. Any comments on this solution vs. ES specifically for that?

Thanks for any insights you can provide!

Hello, thanks for attention

has anyone here installed it?

Yes, sure, there are many forums who ordered and using this addon. None of them had a performance degrade, instead, they liked on how does it perform on their forums

Also, is there anywhere else to test it besides your site, @Katsuro? I don't know enough about your site's content to know what I should be searching for.

A major concern for me is performance with 3-letter words, an unfortunately perennial issue that none of my other efforts have successfully dealt with.

Meilisearch is fast enough when it comes to 3-letter words and perform searching of such a content fast enough, if you want you may try to search by lua, cleo, scm and etc., this is a coding forum so almost every 3-letter words related to coding can be applied in context.

Any comments on this solution vs. ES specifically for that?

I'm not sure on how does elasticsearch perform that, but I can tell that we don't experience any issues with meilisearch in both terms of performance & search quality/results relevance. There also were many updates of meilisearch since our last update (1.10.2 vs 1.5). By the way, you can customize meilisearch relevance rules/synonyms list/ignore list, as described in topic.

So, that's all. If you have any extra questions -- you're welcome

 

[ekool]

So this requires the paid add-on as well as paying a monthly fee to https://www.meilisearch.com/pricing ?

 

[Katsuro]

So this requires the paid add-on

Yes, this is a paid add-on

paying a monthly fee to https://www.meilisearch.com/pricing ?

Not really, meilisearch is opensource and free and you can easily host it by yourself

 

[TimWilson]

Not really, meilisearch is opensource and free and you can easily host it by yourself

This is news to me! Thanks so much! @ekool, I found docs about this here: https://www.meilisearch.com/docs/learn/self_hosted/getting_started_with_self_hosted_meilisearch

I haven't finished reading it, much less tried it, but it appears doable at first glance. That said, it's going to need a lot more investigation before I get a chance to attempt it.

 

[Katsuro]

I haven't finished reading it, much less tried it, but it appears doable at first glance. That said, it's going to need a lot more investigation before I get a chance to attempt it.

Meilisearch is not that difficult tho, it's possible to deploy it using docker too. I can provide some information and help you to configure it

 

[TimWilson]

Meilisearch is not that difficult tho, it's possible to deploy it using docker too. I can provide some information and help you to configure it

Please do tell me more! I am finding this a little confusing.

 

[Katsuro]

Katsuro updated XenForo Wonderful Search with a new update entry:

Version 1.1.0 Release

• Added Meilisearch 1.10.1 support
• Added view search results permission based on nodes
• Added content deletion based on items type when rebuilding search indexes

So, also, no more Beta. It wasn't actually a beta, but I still had to upload it with beta prefix to be sure that everything works stable. More than a year passed, and, here we are.

Stay tuned!

Read the rest of this update entry...

 

[Katsuro]

Please do tell me more! I am finding this a little confusing.

Documentation of Meilisearch is available here. Deployment guideline is mostly described in this page. You probably may want to deploy it using Docker, it's here in the 'Docker' tab.
Meilisearch configuration is described here and it's possible to use envvars, configuration file or pass them as arguments

 

[TBolley]

any live demo avaible ?

 

[Katsuro]

any live demo avaible ?

Sure,

Live Search

www.blast.hk

 

[Mbx]

What kind of requirements are there for MeiliSearch vs Elasticsearch, especially for larger boards. More concrete info would be good. Like performance too.

 

[Katsuro]

What kind of requirements are there for MeiliSearch vs Elasticsearch, especially for larger boards. More concrete info would be good. Like performance too.

Hello,

FAQ - Meilisearch Documentation

Frequently asked questions

www.meilisearch.com

In case of XFWS (stands for XenForo Wonderful Search), there are many optimizations, caching features in addon, leading instance to not hang out and process every search request in a short amount of time. In thread you could've noticed a indexation benchmarks -- that's are the heaviest tasks in addon which is using more resources than usual.

In case if your forum is lighter (or almost the same like ours, at least) I can provide the benchmarks of our forum with installed MeiliSearch 1.0.1:

• AMD Epyc (8 core, no hyper-threading)
• 8GB RAM
• 100GB NVMe SSD (28% free)

Peak RAM usage was like 4GB and all processor threads were used (like 75-80%). Database size was 10.2GB, documents count was 1.3M after indexation.

With MeiliSearch 1.3.5 indexation process was more lighter & faster, every batch of 25k documents (threads/messages) was processing not longer than 10 seconds and total indexation duration was ~15 minutes.

If we talk about major difference between MeiliSearch and ElasticSearch it's obsiously the performance. MeiliSearch is better in this case and they regularly working on it.

If you need some more information -- you're welcome!

 

[Mbx]

Hello,

FAQ - Meilisearch Documentation

Frequently asked questions

www.meilisearch.com

In case of XFWS (stands for XenForo Wonderful Search), there are many optimizations, caching features in addon, leading instance to not hang out and process every search request in a short amount of time. In thread you could've noticed a indexation benchmarks -- that's are the heaviest tasks in addon which is using more resources than usual.

In case if your forum is lighter (or almost the same like ours, at least) I can provide the benchmarks of our forum with installed MeiliSearch 1.0.1:

• AMD Epyc (8 core, no hyper-threading)
• 8GB RAM
• 100GB NVMe SSD (28% free)

Peak RAM usage was like 4GB and all processor threads were used (like 75-80%). Database size was 10.2GB, documents count was 1.3M after indexation.

With MeiliSearch 1.3.5 indexation process was more lighter & faster, every batch of 25k documents (threads/messages) was processing not longer than 10 seconds and total indexation duration was ~15 minutes.

If we talk about major difference between MeiliSearch and ElasticSearch it's obsiously the performance. MeiliSearch is better in this case and they regularly working on it.

If you need some more information -- you're welcome!

My concern is larger scale boards with lets say 60 million posts. MeiliSearch seems to a good choice for smaller to mid and easier in general, but for larger setups, I am not sure.

 

[Katsuro]

My concern is larger scale boards with lets say 60 million posts. MeiliSearch seems to a good choice for smaller to mid and easier in general, but for larger setups, I am not sure.

If you don't mind, we can discuss privately installation on your board and see the results. This would also be a great demonstration of addon & Meilisearch performance