A 404 isn't necessarily correct as it translates as not found and the page may exist.
A 403 means forbidden, which is correct as guests/robots can't feature threads.
Once a robot hits a 403, the request should not be repeated.
The standard permission system is used, so you will see the same behaviour with regards to other pages in the core software, which are forbidden to guests.