It seems to me that this has massive opportunities if done correctly. It can easily become a mass garbage production script.
I remember the auto tagger script on vbulletin creating a mess that took years to repair. This could be so much worse if we allow it to mass post freely.
Forcing it to reference all statements with citations, forum quotes and links could be one way to limit garbage answers.
It should also learn and adhere to the forum rules.
I think a first version would require checking the answers manually. LLM s tend to be verbose and elaborate, so manually checking it takes a lot of time. It's easy to assume that the text it spits out is correct. Often it turns out that is not.