I really thought about your message before adding the chat to my own forums. I feel like I had to do it before someone in the community started promoting his own Discord, which would be out of my control.
That's perfectly understandable, most definitely! It would be a real shame to lose traffic to a third party discord, so at least the chat you have a little bit of control over. I would strongly suggest still pushing as much activity to the forums as possible so it doesn't dry up content, just as a safety! The chat will grow on its own, most definitely, the balancing act is making sure it doesn't decimate your forum posts.