I went ahead and disabled every add on at the same time and one by one and I'm still not getting an alert. Like I said, its only happening with threads I'm participating in. All other alerts are working properly.
This is the Alert I'm missing:
User replied to the thread Thread Name. There may be more posts after this.
Thank you all