Me and the folks in my community love this. For awhile people wanted rep comments without actual rep points to add private commentary on posts, but this makes so much more sense.
The only thing I can think of that would make it better is somehow embedding the conversation beneath the post within the thread but so that only the participants can see.