• This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn more.

When to rebuild index?

duderuud

Active member
#1
Can anyone tell me exactly when a rebuild is necessary?

I'm asking because I'm busy converting to XF and we have a lot of posts (26mln).
Rebuilding takes ages so I want to keep that to a minimum...
 

Slavik

XenForo moderator
Staff member
#3
Can anyone tell me exactly when a rebuild is necessary?

I'm asking because I'm busy converting to XF and we have a lot of posts (26mln).
Rebuilding takes ages so I want to keep that to a minimum...
How much ram do you have in the server? If you have the hardware, you can increase the batch size to 10, 20 or even 30k for reindexing and it will fly through.

I index p8ntballer with 10k batches and it does it in <5 minutes usually.
 

duderuud

Active member
#5
A rebuild after the import should be all that's required.
And what about after upgrading ES? Or change the stemming? Or another setting?

How much ram do you have in the server? If you have the hardware, you can increase the batch size to 10, 20 or even 30k for reindexing and it will fly through.

I index p8ntballer with 10k batches and it does it in <5 minutes usually.
The converter is running on a VM with 8GB of mem. The real thing will be running on 3 webservers with 16GB of mem.
(We hope to swap the DB's for new ones with SSD's and 64 or 96GB of ram btw)

Got any best practices there? Like a dedicated search server maybe?
 

duderuud

Active member
#7
Yeah ok, saw that :) But also after upgrading ES then?
Just installed the beta.

(PS. Rebuild just finished, took about 15 hours with the default settings)
 

Brogan

XenForo moderator
Staff member
#8
There's no need to rebuild the index when upgrading ES as the indexed content doesn't change.
The new options just change how it is retrieved.