ChatGPT Search Engine

[Alpha08]

https://openai.com/index/introducing-chatgpt-search/

Thoughts on this? I'm hoping it will at least give some good competition to Google as I am sick of the in your face ads, favoring of big media companies, etc...


Also it might be a good idea to whitelist their search engine user agent and IP ranges so Cloudflare's aggressive bot blocking/AI scraper and crawler features don't accidentally block it.

https://platform.openai.com/docs/bots/overview-of-openai-crawlers

 

[Suzanne O]

No thanks.

 

[smallwheels]

Also it might be a good idea to whitelist their search engine user agent and IP ranges

No. The opposite is true. At least for me. AI companies are parasites that suck the blood (knowledge) out of your forum and market it for their own benefit and fame w/o giving anything back. A user in search for answers that gets his question answered by an AI (with the knowledge it pulled out of your forum) won't visit your forum, will not become a member, won't start a discussion. Forums live from active members - AIs are vampires that drain out forums.

Thus I blocked AIs where ever possible w/o too much extra effort (robots.txt) and w/o implications to the forum performance (thus until now w/o blocking via htaccess). As many AIs don't respect robots.txt (no matter what they claim) I have moved a lot of unique content that was very hard work to create behind the registration wall.

What interest should I have to feed AIs? Nil - rather the opposite.

I don't use cloudflare - no need at the size of my forum and another potential monopoly that may turn against you at some point.

 

[javakhir]

bad thing is: it will only show top 1-2 webs, while google shows hundreds, users may like it, because it has an accurate result.
for now, al does not have all answers, there are many missing content on requests, means, they are still crawling & getting their content, I won't be suprised, if in 1-3 years AI search takes over Google.

again, it depends on forum tematic, niche you have. personally me, do not afraid of it, 'cause I sell files that AI won't get for free.

 

[Mr Lucky]

I won't be suprised, if in 1-3 years AI search takes over Google.

I think it will be a case of Google being clever enough to know "if you can't beat them, join them" It already shows "generative" ai results. at the top. Here you can see the ai results beating my own forum on a long tail search but without giving the any kind of a useful answer. Granted it's a bit annoying that Google shows the exact snippet from my forum that does give the answer, so maybe there not even any need to click through to the site

 

[Kleazy]

To see if chatgpt indexed your own forum already or not you have to ask indirectly.

Ask on topics where the unique answer can only be found within your own forum community.

Not sure if there is a no AI indexing flag one can set in the headers or htaccess similar to search engines. Plus no guaranty that request gets honored.

One could set their forum to private. Membership only to keep indexing spiders out.
Cost: less new users will discover those forums.

Xenforo.com is in the GPT index for better or worse.

 

[Mr Lucky]

Not sure if there is a no AI indexing flag one can set in the headers or htaccess similar to search engines.

That would be robots.txt no? OpenAI say they honour the robots.txt tags

 

[Wildcat Media]

I think it will be a case of Google being clever enough to know "if you can't beat them, join them" It already shows "generative" ai results. at the top. Here you can see the ai results beating my own forum on a long tail search but without giving the any kind of a useful answer. Granted it's a bit annoying that Google shows the exact snippet from my forum that does give the answer, so maybe there not even any need to click through to the site

View attachment 313715

Good to know about key heights, actually. Although I'm only down to one inoperative soprano (needs a complete repad), having sold off the others (including a Mk. VII tenor). I may need to buy another EWI Solo; tried one for a month but couldn't get used to electronic key reactions vs. physical on woodwinds. (Can't rest fingers on top of the keys in other words.)

Anyhoose, yeah, I block AI bots in Cloudflare as best I can. It's such a risk though. If you do train their AI, they steal your content without giving a direct attribution. (And that's not even artificial intelligence--it's simply rewording results in a conversational language; there are no decisions being made, in other words, something which "intelligence" implies.) If you don't let them access, then you risk not showing up better in search results.

For my part, I got so tired of the AI overview that I set up new search providers in my browers that access the Web tab in Google's results directly, bypassing the overview page. So nice to have "standard" Google back.

 

[Kleazy]

Good to know about key heights, actually. Although I'm only down to one inoperative soprano (needs a complete repad), having sold off the others (including a Mk. VII tenor). I may need to buy another EWI Solo; tried one for a month but couldn't get used to electronic key reactions vs. physical on woodwinds. (Can't rest fingers on top of the keys in other words.)

Anyhoose, yeah, I block AI bots in Cloudflare as best I can. It's such a risk though. If you do train their AI, they steal your content without giving a direct attribution. (And that's not even artificial intelligence--it's simply rewording results in a conversational language; there are no decisions being made, in other words, something which "intelligence" implies.) If you don't let them access, then you risk not showing up better in search results.

For my part, I got so tired of the AI overview that I set up new search providers in my browers that access the Web tab in Google's results directly, bypassing the overview page. So nice to have "standard" Google back.

Do you mind explaining how to get google back?

Depending on context default google is not trustworthy.

 

[Wildcat Media]

The easiest way is to click the Web tab at the top.

Because I like ot search from the address bar in Chrome or Edge, I added a search engine and set it as the default. In Chrome, adding a search engine with these details will default to the Web tab. Note that if you add this, you will need to edit the regular Google entry by changing the shortcut to something else (I changed it to goo.gl).

Name: Google (Web)
Shortcut: google.com
URL: {google:baseURL}/search?udm=14&q=%s

Same results as a Google search but only contains web search results, not the mixed experience of the default Google homepage wity videos, images, shopping, etc.

This is how my "Search engines" page in Chrome looks now:

There are better, more complete instructions elsewhere.

 

[cpvr]

No thanks.

It’s still a source of traffic for your site. Some of their results are being powered by Bing.

To view this content we will need your consent to set third party cookies.
For more detailed information, see our cookies page.

Accept third party cookies

The results will provide links to your content as well.

If a user searches something on chatgpt and accesses your site, they’ll appear under your Google analytics as a referral from “chatgpt.com”

If you’re already ranking well on Google, you’re more than likely doing well on Chatgpt unless you’re blocking their bots.

ChatGPT Search makes Microsoft Bing an SEO priority

Here’s why Microsoft Bing is about to become your new SEO sidekick in 2025 – and how to make the most of it.

searchengineland.com

this for real?​

ChatGPT Search just put a spotlight on Bing’s index, making it something SEO managers need to examine in ways they probably never have.

Why Microsoft Bing? And why now?

• ChatGPT uses Bing’s index, so if Bing doesn’t have your page, neither does ChatGPT. It’s not time to panic, but it’s definitely time to get a little cozy with Bing – because ignoring it could mean lost visibility.
• ChatGPT Search uses its own algorithm, so it’s less about Bing rankings affecting ChatGPT Search rankings, but more about the URLs and page content missing from the Bing index will likely cause you not to rank in ChatGPT.

It’s a good idea to implement Bing webmaster’s tools if you don’t use it already.

Bing Webmaster Tools

Sign in or signup for Bing Webmaster Tools and improve your site’s performance in search. Get access to free reports, tools and resources.

www.bing.com

 

[frm]

That would be robots.txt no? OpenAI say they honour the robots.txt tags

They say they honor them, but have they always honored them? It'd be interesting to know if the other versions, that they presumably work off of, ever scraped your site in the past. But surely they'll never reveal that.

A lot of forums date back to the beginning of the internet to when OpenAI began training their model, so they probably already got enough data to honor it now.

 

[Suzanne O]

It’s still a source of traffic for your site. Some of their results are being powered by Bing.

To view this content we will need your consent to set third party cookies.
For more detailed information, see our cookies page.

Accept third party cookies

The results will provide links to your content as well.

If a user searches something on chatgpt and accesses your site, they’ll appear under your Google analytics as a referral from “chatgpt.com”

If you’re already ranking well on Google, you’re more than likely doing well on Chatgpt unless you’re blocking their bots.

ChatGPT Search makes Microsoft Bing an SEO priority

Here’s why Microsoft Bing is about to become your new SEO sidekick in 2025 – and how to make the most of it.

searchengineland.com

this for real?​

ChatGPT Search just put a spotlight on Bing’s index, making it something SEO managers need to examine in ways they probably never have.

Why Microsoft Bing? And why now?

• ChatGPT uses Bing’s index, so if Bing doesn’t have your page, neither does ChatGPT. It’s not time to panic, but it’s definitely time to get a little cozy with Bing – because ignoring it could mean lost visibility.
• ChatGPT Search uses its own algorithm, so it’s less about Bing rankings affecting ChatGPT Search rankings, but more about the URLs and page content missing from the Bing index will likely cause you not to rank in ChatGPT.

It’s a good idea to implement Bing webmaster’s tools if you don’t use it already.

Bing Webmaster Tools

Sign in or signup for Bing Webmaster Tools and improve your site’s performance in search. Get access to free reports, tools and resources.

www.bing.com

I know but i don't want them to hack my site thanks. Gotta block them.

 

[Wildcat Media]

Because I like ot search from the address bar in Chrome or Edge, I added a search engine and set it as the default.

Quick update--this no longer works in Chrome, as they've removed the Web tab from search. Still shows up in Edge but I fear that if I update it, the Web tab will go away also.

 

[smallwheels]

this no longer works in Chrome, as they've removed the Web tab from search

OpenAI is thinking about building their own browser:

https://www.reuters.com/technology/artificial-intelligence/openai-considers-taking-google-with-browser-information-reports-2024-11-21/

 

[smallwheels]

It’s a good idea to implement Bing webmaster’s tools if you don’t use it already.

I've done that, more or less at the same time when I implemented Googles Search Console. As my forum was pretty new at that time (a bit more than two years ago) Google and Bing started with the same conditions, practiaclly from day one of my forum on. Turned out Bing indexed way faster and way more pages than google and the ranking of my forum was also better - still I got only about 10% of what I got via Google in terms of users, rather even a little less. This has been pretty consistent over time.

It changed sometime in early summer this year: Now Google has around 1,5 times as many of my pages indexed in comparison to Bing and the amount of users coming via Bing got even worse.

Google vs. Bing over the last three months:

So Bing was pretty irrelevant for me and has become completely irrelevant in the meantime, delivering only single digit klicks. They have pushed index now massively for quite some time, maybe that's one reason - however: Barely anyone seems to use Bing in comparison to Google.

Bing webmaster tools btw. explicitely say the numbers do only include search results, not chat or other things - so you won't get info if and how often ChatGPT refers to your content indexed by Bing and what may or may not be the results.

I do play around from time to time with the AI chat available on the Bing website and each time I try it out in topics where I already know the answer it turns out the outcome is horrible: Completely wrong data ans statements in at minimum half of the cases, so I prefer better not to be part of this party anyway.