I am trying to write an importer from a news forum to my website and the character encoding is really getting me frustrated. It seems that xenforo somehow accepts multiple types of characters. While the page and database are UTF-8, it manages to display non utf-8 characters correctly in posts, how? How does xenforo handle character encoding? As when I show some of the posts some content shows up as a black diamond with a question mark inside it. I cannot figure out how to get it to display correctly.