Wow, this is weird, I created another account and made a test thread (the other account was using the custom theme) With MY account which was using the unchanged default them. I "responded" to the thread I had created with the other account and the alert worked! So I don't know what was wrong...