The xf_search table is a record of all (recent) searches carried out by visitors.
It should be cleared periodically (daily cleanup).
What date (you will need to convert the unix timestamp) is the oldest record in the table?
Disabling search for guests should cut down on the number of searches.
The table can be truncated if it is that large to reset it.