XF 1.4 Rebuilding Search Index - HTTP 403, needs constant refresh

[Formina Sage]

Whenever I attempt to rebuild my search index, it will process 1-3000 pages and then will come up with a 403 Forbidden error. I need to reload the run-deferred page and then it will pick up where it left off, only to return to the 403 error after a few thousand more pages have been processed. Is there a fix on the server or should I change the items per page/page delay settings?

 

[Mike]

This seems like a requests per second limit or something like that on your server. Your host should be able to white list it for you (or your control panel).

Alternatively, you may be able to get away with increasing the number of items per page.

 

[Formina Sage]

I increased the items per page and added a small delay and it worked without any intervention.