Index time for 10M posts?

[imthebest]

Hi,

I'd like to know how much time it might take to index 10M posts when using the ES add-on? The index time is the same as when using the stock search system? If so, is there any way to increase the index speed?

Thanks!

 

[AndyB]

To index Enhanced Search on my forum which has 1.4 million posts takes about 5 minutes.

 

[imthebest]

@AndyB did you changed the value of "Items to process per page" from the default 500?

 

[AndyB]

did you changed the value of "Items to process per page" from the default 500?

Sometimes I do, I can't remember the number I used, but certainly increase this number on larger forums.

Here are my notes on how to re-index Enhanced Search.

https://xenforo.com/community/threads/how-to-elasticsearch-stemming-analyzer-setup.63835/

 

[imthebest]

Thanks Andy, I'll check those notes!

Btw any of the devs could you please confirm if increasing the value of "Items to process per page" will improve the index speed? If so, how high I can set it? Can I increase it from 500 to 500,000?

 

[rdn]

Indexing speed depends on your server setup.
I increase the items to process per page to 10,000 usually without any problem.

 

[Slavik]

Indexing speed depends on your server setup.
I increase the items to process per page to 10,000 usually without any problem.

Ive set it as high as 50,000 before without issues.

 

[rdn]

Next time I will try 50K