XF 1.1 Incomplete Import: xf_search_index

[Douglas Taylor]

Converted from vb4 to XF1.1

Import failed when during import/rebuild of the search index.

Attempted to rebuild search index and the server continued to time out.

Followed this: http://xenforo.com/community/thread...ch-index-for-a-large-site-experts-only.11195/

Accomplished this:

ALTER TABLE xf_search_index DISABLE KEYS;

And then ran the rebuild search index: successful

Attempted this:

ALTER TABLE xf_search_index ENABLE KEYS;

Server processed for 8-plus hours and eventually overloaded and started crashing.

Does anyone have any creative ideas on how to get my search index rebuilt?

Thanks!

 

[Jake Bunce]

How many posts? What kind of server?

Rebuilding the search index is an intensive process. It can take a long time on very large forums.

 

[Douglas Taylor]

1.5 million posts.

I'm on CentOS

 

[Douglas Taylor]

I'm wondering if I could just do this locally thru MAMP and re-insert it...

 

[Jake Bunce]

I'm wondering if I could just do this locally thru MAMP and re-insert it...

Nope. The fulltext indexes don't transfer when you copy a database between servers. The indexes have to be rebuilt.

edit - well maybe. I mean the indexes are built for each record that is inserted into the table (i.e. during the restore).

1.5 million posts.

I'm on CentOS

Shared or dedicated? If the server is crashing during that query then it may not have enough resources or may already be under load.

 

[Douglas Taylor]

Dedicated. 512K tmpdsk, so perhaps that might part of the problem. Kind of at wits end.

 

[Jake Bunce]

MySQL only has 512K of tmp space? Is that what you meant? That is very small and may slow down the rebuild. Try increasing it.

If you continue to have problems then I say post your my.cnf file (minus any sensitive info) and move this thread to the server forum.

 

[Douglas Taylor]

MySQL only has 512K of tmp space? Is that what you meant? That is very small and may slow down the rebuild. Try increasing it.

If you continue to have problems then I say post your my.cnf file (minus any sensitive info) and move this thread to the server forum.

Ooh, I mean 512,000,000! It's late, sorry!

 

[Douglas Taylor]

[mysqld]
set-variable = max_connections=500
log-slow-queries
safe-show-database
max_allowed_packet = 16M

And that's it.

 

[Hoffi]

Oh... I have also 1.5 Mio Posts. And on my XEON QuadCore with 16GB RAM, the Query runs about one hour. During the rebuild the Load raised up to 6.

 

[Douglas Taylor]

Did it eventually finish?