How to remove a user from a conversation

I've tried deleting the user from the xf_conversation_user table corresponding to the conversation ID, but that appears to have no effect (despite being successful), as the user is still listed in the front end as being a member of the conversation. How do I do this?