When I got started in the hosting industry 20 years ago, we would host 500+ accounts on a Pentium IV with just a couple gigs of RAM. Things have obviously changed a ton since then, PHP-based sites, database-heavy sites, etc., but you would still be amazed by what some of these new servers can do. A lot of times, the servers people buy are simply overkill for the traffic they receive.