The outgoing feed obeys permissions, so if guests can't view threads in a forum then those threads won't be included in the outgoing feed for guests.
This also affects the outgoing RSS feed:
Admin CP -> Applications -> Display Node Tree -> [click the forum]
> Forum Options: Include threads from this forum when users click "What's New?"