XenForo AI roadmap?
- Thread starter back
- Start date
Digital Doctor
Well-known member
ES Dev Team
Well-known member
Okay but what does it do with AI? saying you integrated AI leaves that question.
Also because AI can get really expensive, the solution should work with localhosted models.
I can run something 90% as good as Deepseek R1 on a single 5090 ( bytedance Seed OSS 36B ) as of today, i don't see why i'd want to give a copy of my forum to a third party provider if i can just run a GPU and get inference for a lot less.
tonmo
Well-known member
I described what it does in the quoted text; basically I have setup a user (octobot) which responds when tagged by users who are in the Supporter user group (or Staff).
No argument that it could be done locally for self-use. Not sure how pragmatic it would be to set it up to have it function for your community's users, but it'd involve internet traffic so I think yours is a different use case from what I described.
Xpertloop is a startup comprised of people I had worked with for many years. As for my data, their service ingests it and is used solely for my purposes. The data they have is essentially what has been scrape-able by Google and other such robots (ie. public posts).
Another feature that I didn't mention in my other post is that when Octobot is tagged, the last N posts in the thread are sent along to the API so that the system has adequate context on the discussion and can respond intelligently (along with the post itself which contained the tag and query, of course). I think I've set it to 5 posts.
I'm not a developer but I essentially created my part of the script through vibe-coding (using mostly Grok but Xpertloop does offer its admins it's own private instance for such tasks as well). Stuff like, only respond when Octobot is tagged by a Supporter, ignore quoted text, and send the last 5 posts in the thread for any context, etc. It's a cloudflare worker script currently (also using XF API and webhooks) but I'd like to see if I can make it an add-on for others to use (vs CF worker). By making it an add-on, I could help others with Xpertloop onboarding, etc.
Xpertloop typically works with authors and other such content owners; I am working with them as it relates to forum discussion systems. Personally I believe this is the right kind of AI stepping stone needed for forums.
No argument that it could be done locally for self-use. Not sure how pragmatic it would be to set it up to have it function for your community's users, but it'd involve internet traffic so I think yours is a different use case from what I described.
Xpertloop is a startup comprised of people I had worked with for many years. As for my data, their service ingests it and is used solely for my purposes. The data they have is essentially what has been scrape-able by Google and other such robots (ie. public posts).
Another feature that I didn't mention in my other post is that when Octobot is tagged, the last N posts in the thread are sent along to the API so that the system has adequate context on the discussion and can respond intelligently (along with the post itself which contained the tag and query, of course). I think I've set it to 5 posts.
I'm not a developer but I essentially created my part of the script through vibe-coding (using mostly Grok but Xpertloop does offer its admins it's own private instance for such tasks as well). Stuff like, only respond when Octobot is tagged by a Supporter, ignore quoted text, and send the last 5 posts in the thread for any context, etc. It's a cloudflare worker script currently (also using XF API and webhooks) but I'd like to see if I can make it an add-on for others to use (vs CF worker). By making it an add-on, I could help others with Xpertloop onboarding, etc.
Xpertloop typically works with authors and other such content owners; I am working with them as it relates to forum discussion systems. Personally I believe this is the right kind of AI stepping stone needed for forums.
ES Dev Team
Well-known member
My bad for not reading the quoted text - didn't expect details to be there.
Okay, i get it. This is kind of like how you can tag Grok on X. But users have to pay for it.
How is uptake?
Okay, i get it. This is kind of like how you can tag Grok on X. But users have to pay for it.
How is uptake?
Last edited:
tonmo
Well-known member
exactly, like the Grok feature. I originally had a button next to the share icons in each post but just tagging octobot works best.
Users are generally skeptical, but accepting. As mentioned, I don't mind the slow adoption. It's definitely experimental. Getting the agent right is crucial. I'm thinking it's in a good place right now but need to test further without creating noise. I can test outside of my production site of course, but thread context and all that is a bit tedious to recreate, so I'm just casually working it in when it feels natural to do so.
Users are generally skeptical, but accepting. As mentioned, I don't mind the slow adoption. It's definitely experimental. Getting the agent right is crucial. I'm thinking it's in a good place right now but need to test further without creating noise. I can test outside of my production site of course, but thread context and all that is a bit tedious to recreate, so I'm just casually working it in when it feels natural to do so.
tonmo
Well-known member
Just furthering the discussion on potential for AI in xenforo -- I've implemented this feature set (through a separate partnership with Xpertloop); here's how it works:
1) I have "robot"-type user which I've enabled to handle RSS feed ingestion (i.e., news on my forum's subject matter) and now, AI responses.
2) There's a dedicated nav item which goes to a Page node for one-on-one chats with the Xpertloop API (which is customized to my forum's content and agent instructions). Chats are strictly limited to my forum's subject matter. Registered users get up to three queries per day. Supporters get "unlimited" queries. Guests must register to use. The UI is simple; essentially just a query prompt and a "clear chat" button. When the user submits, there's a "please wait" message while it works on a response.
3) The Grok-like feature is implemented as well; here's a screenshot of the icon (robot fontawesome). Users who click it go to the Page node, with the post contents dynamically sent to the API for a response (along with the last 5 posts in the thread, for additional context for the AI's response).
4) The Supporter usergroup can tag the robot user in any post, which will result in the robot providing its AI response to the thread publicly.
Thoughts on these features / use cases? I think it will be helpful to gel this kind of information summoning with the forum user experience, and helps users understand when they're interacting with real people vs. an AI robot.
1) I have "robot"-type user which I've enabled to handle RSS feed ingestion (i.e., news on my forum's subject matter) and now, AI responses.
2) There's a dedicated nav item which goes to a Page node for one-on-one chats with the Xpertloop API (which is customized to my forum's content and agent instructions). Chats are strictly limited to my forum's subject matter. Registered users get up to three queries per day. Supporters get "unlimited" queries. Guests must register to use. The UI is simple; essentially just a query prompt and a "clear chat" button. When the user submits, there's a "please wait" message while it works on a response.
3) The Grok-like feature is implemented as well; here's a screenshot of the icon (robot fontawesome). Users who click it go to the Page node, with the post contents dynamically sent to the API for a response (along with the last 5 posts in the thread, for additional context for the AI's response).
4) The Supporter usergroup can tag the robot user in any post, which will result in the robot providing its AI response to the thread publicly.
Thoughts on these features / use cases? I think it will be helpful to gel this kind of information summoning with the forum user experience, and helps users understand when they're interacting with real people vs. an AI robot.
Similar threads
