You won't get an alert as such, no. We mark the conversation as read for all but the new user registering. The purpose isn't to notify you of new members registering. The purpose is to send pertinent information to the new user registering and open up a channel of communication directly should they require it.
If you select "Do not leave conversation" you will see it in your Conversation list, but you won't get alerted.