Strongly recommend integrating AI functionality
- Thread starter sniper756
- Start date
Digital Doctor
Well-known member
Sounds pie in the sky. Give examples ?
smallwheels
Well-known member
By whome? And on which foundation? It might be the case that you would like to see an AI integration - but that is very far from "it is recommended". There are some people that would like to see AI in XenForo while for others it would be a reason to look for a different forum software.
sniper756
Active member
The ima app mentioned above can use AI (such as DeepSeek) to generate exclusive answers for users' private databases, independent of the entire network database. Try it or Check the functions of this app on Xiaohongshu.
Algorithms and AI-powered apps occupy most of users' time, and ordinary communities only survive in the cracks.
I hope XenForo gets better and better and remains technically advanced. But frankly, community software without algorithm recommendations and AI is really outdated.
Below are my previous recommendations based on algorithmic recommendations.
smallwheels
Well-known member
This reads like an AI generated answer, given the combination of tone, lacking substance, dramafulness and complete lack of understandable and useful content.
Mendalla
Well-known member
As I always say with requests like this, either an add-on or something that is easily disabled. Not everyone will want this so don't force it on people.
The AI thread summaries I see on a Circle site that I am on rarely offer anything that I can't get just by reading the post and comments.
The AI thread summaries I see on a Circle site that I am on rarely offer anything that I can't get just by reading the post and comments.
It most certainly isn't. IMHO most users who are happy with recommendations and AI answers will not visit forums any longer sooner or later - and those who still want to use forums don't want AI assistence, they want to talk to humans.
This is the key selling point for forums, so adding user-facing AI features might in fact be counter productive.
beerForo
Well-known member
If they do delve into AI for search perhaps it could be added to the Enhanced Search add-on. Right now the way similar threads works is by title and the first few words of the post, but an AI summary of the entire thread could help in choosing that thread instead of starting your own.
sniper756
Active member
Algorithm-based content recommendations and AI-generated responses are not divorced from human interaction. Let's wait two to three years and see what features the major mainstream community software will have.
Think about why algorithm-based social media apps like TikTok take up the vast majority of users' time.
Masetrix
Well-known member
As soon as human forum or social media users fear that AI will answer their questions, they will return to more places where real people can answer their questions.
The internet as a whole will experience a hype that is the opposite of what it used to be.
smallwheels
Well-known member
Think about the diffences between Tiktok and a forum. If you prefer TikTok - why don't you become a creator and consumer there?
smallwheels
Well-known member
BTW: DeepSeek is a Chinese company. South Korea, Italy, Taiwan and Australia have already taken action against them due to privacy concerns. Germany is about to start an investigation to ban it from the app stores. In the US, employees of several institutions like i.e. NASA and minsetry of defense are not allowed to use it. So problaby far from a good recommendation. For privacy reasons and as probably the use of XF would possibly fall under regulation in these countries if DeepSeek was integrated. Integrating DeepSeek into XF would thus be suicidal.
Mendalla
Well-known member
I don't actually have an issue with this one and, done right, I would implement it.
The AI piece, I can take or leave but I am still not a fan of LLMs. I had a thread about AI on social sites already and my users reaction was very much "don't" so it would never happen on my current site.
But if I was spinning up a new site and the capability was there? I would see if there is a use case. But I am not ready to advocate for it in base. @beerForo mentioned it as an enhancement for Enhanced Search and that makes more sense to me.
Chromaniac
Well-known member
was just wondering how much storage space and resources would a locally hosted open source llm require to just locally process the content of the forum and provide a Q&A interface for responding to queries right on the forum.
smallwheels
Well-known member
Depends. I.e. the biggest version of Metas Llama (LLaMA 3.1 405B) requires 750GB to 2TB of disc space, the whole repository is 4,9TB. However, there are smaller versions. You should also not ignore the other hardware requirements, namely VRAM:
Meta Llama AI Requirements [What you Need to Use It] 💻
The release of Meta’s Llama family of models has been nothing short of revolutionary, democratizing access to state-of-the-art AI. However, for developers and AI enthusiasts eager to run these powerful tools on their own hardware, a significant challenge has emerged: finding clear, consolidated...
llamaimodel.com
But depending from what you want to achieve and do it might get smaller than this. Also, there ist Llama 4 in the meantime which problably needs more ressources.
Llama 3.1 - 405B, 70B & 8B with multilinguality and long context
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
huggingface.co
meta-llama/Llama-3.1-405B · What is the size of the whole repo?
It seems like my 2TB SSD is not ready for this...
huggingface.co
What Is the Size of LLaMA 3.1 405B?
LLaMA 3.1 405B is one of the most advanced large language models (LLMs) developed by Meta AI, and its size is a key factor that influences…
Getting the models
You can get the Meta Llama models directly from Meta or through Hugging Face or Kaggle.
www.llama.com
