Not all phrases support HTML and we wouldn't generally recommend using phrases to add icons. In some places it will work, in others you may experience results like this.
There are other ways to add icons to buttons including modifying the HTML or by using CSS and in this case that's what we would recommend for this use case.
I'll update that phrase to be more correct.