When to rebuild index?

[duderuud]

Can anyone tell me exactly when a rebuild is necessary?

I'm asking because I'm busy converting to XF and we have a lot of posts (26mln).
Rebuilding takes ages so I want to keep that to a minimum...

 

[Paul B]

A rebuild after the import should be all that's required.

 

[Slavik]

Can anyone tell me exactly when a rebuild is necessary?

I'm asking because I'm busy converting to XF and we have a lot of posts (26mln).
Rebuilding takes ages so I want to keep that to a minimum...

How much ram do you have in the server? If you have the hardware, you can increase the batch size to 10, 20 or even 30k for reindexing and it will fly through.

I index p8ntballer with 10k batches and it does it in <5 minutes usually.

 

[rdn]

There's no command line to rebuild index?

 

[duderuud]

A rebuild after the import should be all that's required.

And what about after upgrading ES? Or change the stemming? Or another setting?

How much ram do you have in the server? If you have the hardware, you can increase the batch size to 10, 20 or even 30k for reindexing and it will fly through.

I index p8ntballer with 10k batches and it does it in <5 minutes usually.

The converter is running on a VM with 8GB of mem. The real thing will be running on 3 webservers with 16GB of mem.
(We hope to swap the DB's for new ones with SSD's and 64 or 96GB of ram btw)

Got any best practices there? Like a dedicated search server maybe?

 

[Paul B]

And what about after upgrading ES? Or change the stemming? Or another setting?

 

[duderuud]

Yeah ok, saw that But also after upgrading ES then?
Just installed the beta.

(PS. Rebuild just finished, took about 15 hours with the default settings)

 

[Paul B]

There's no need to rebuild the index when upgrading ES as the indexed content doesn't change.
The new options just change how it is retrieved.

 

[Wildcat Media]

There's no command line to rebuild index?

I came here today to ask that very question. We had a couple of server hiccups over the past couple of months, and I want to rebuild the index overnight this weekend while traffic is down.