Actually no, it was a noob mistake. I had the template modification switched off and edited the template directly. So I was seeing what everyone should have seen had I done the template modification right.
I've been trying this out but it does not appear to work properly with quick thread creation from the forum view in XF2.2, the insert button is not removed. No problems when using Post Thread though.