What computer are you running on? It being local will only determine the speed of the network connection. Your computer still has to do loads of work when rebuilding all the caches.
It used to take at least 5-10 minutes on my old MacBook, and my fans would go like crazy.
Liam