on a side note @Mike if there is an active flagged report on a conversation message and then you removed the "Give users warnings directly" the flag would still be there but report center shows nothing.
It should appear when you go into the report system, though the number might not appear immediately. That is expected as this is cached and only updated when a report changes or when they visit the site again (get a new session).