When to rebuild index?

duderuud

Well-known member
Can anyone tell me exactly when a rebuild is necessary?

I'm asking because I'm busy converting to XF and we have a lot of posts (26mln).
Rebuilding takes ages so I want to keep that to a minimum...
 
Can anyone tell me exactly when a rebuild is necessary?

I'm asking because I'm busy converting to XF and we have a lot of posts (26mln).
Rebuilding takes ages so I want to keep that to a minimum...

How much ram do you have in the server? If you have the hardware, you can increase the batch size to 10, 20 or even 30k for reindexing and it will fly through.

I index p8ntballer with 10k batches and it does it in <5 minutes usually.
 
A rebuild after the import should be all that's required.
And what about after upgrading ES? Or change the stemming? Or another setting?

How much ram do you have in the server? If you have the hardware, you can increase the batch size to 10, 20 or even 30k for reindexing and it will fly through.

I index p8ntballer with 10k batches and it does it in <5 minutes usually.
The converter is running on a VM with 8GB of mem. The real thing will be running on 3 webservers with 16GB of mem.
(We hope to swap the DB's for new ones with SSD's and 64 or 96GB of ram btw)

Got any best practices there? Like a dedicated search server maybe?
 
Yeah ok, saw that :) But also after upgrading ES then?
Just installed the beta.

(PS. Rebuild just finished, took about 15 hours with the default settings)
 
There's no need to rebuild the index when upgrading ES as the indexed content doesn't change.
The new options just change how it is retrieved.
 
Top Bottom