Have you ever tested it?

I wonder if XenForo was ever tested what is the maximum number of members and the maximum numbers of posts/threads before it starts to get "slow". Or this depends entirely on the db server?

Would really depend on the server itself. Are you just starting out your forum or have an existing, well established one?

Either way, with the right server and available resources, you should be fine for a long time to come :).