Skip to content
BlakSheep Creative

AI Training Opt Out vs AI Search Visibility: What Business Owners Need to Know

By Clint Sanchez · Published · 14 min read

BlakSheep Creative featured graphic: AI Training Opt Out vs AI Search Visibility: What Business Owners Need to Know

Does Blocking AI Training Remove You From AI Answers?

Quick answer

Usually not, though it depends on the company. Microsoft treats training and AI answers as separate choices. Google has one real exception: it plans to read the new shared opt-out as blocking Google-Extended, which also covers Gemini Apps answers. Neither company honors the new signal yet, and the study being cited tested a different control.

Key takeaways

  • The shared robots.txt signal is not live. Microsoft starts honoring it February 1, 2027, and Google is aiming for early 2027.
  • The specification is a version 00 individual Internet-Draft, not a finished standard.
  • At Microsoft, training and grounding are independent, and neither changes your eligibility for regular Bing results.
  • At Google, Google-Extended covers Gemini training and Gemini Apps grounding together, so a training opt-out can reach those answers.
  • AI Overviews and AI Mode have their own Search Console control. Google says that control does not affect AI training.
  • The one-site study in circulation removed a site from AI Overviews and AI Mode. It was published before the new signal was announced, so it did not test that signal.
  • If your site uses NoArchive or NoCache, Microsoft has given you a March 1, 2027 deadline to act.

If you run a service business, you probably did not plan to have an opinion about robots.txt this year. But your web person may soon offer to "block AI," and that phrase can mean at least five different settings. Here is what each one does, so the decision is yours.

Want this handled instead of DIY?

A 15-minute call, no script, no pressure. You leave with a plan either way.

On October 30, Google and Microsoft both backed a shared way to tell AI companies not to train on your website. Within a day, business owners were being warned that using it could make them vanish from AI answers. That warning is partly right, for reasons that have little to do with the evidence being passed around with it.

The warning owners are hearing started with one widely shared argument, so that is where we will start too.

The Post That Prompted This Article

A Facebook post aimed at local business owners made the case against flipping the new switch. We removed the author's identity and promotional details because the argument is what matters here, not the person making it.

Screenshot of a Facebook post warning local business owners about a new AI training control, with the author's name, photo, promotional link and sign-off blacked out
A real Facebook post, captured October 31, 2026. Black bars cover the author's identity and promotional details. The wording is otherwise unedited.

Much of it holds up. The dates are right, it calls the study small, and it says plainly that this is not an emergency. "Training and being cited are two different things" is exactly correct.

The trouble is the bridge in the middle. It introduces the new training switch, then says a case study "showed what opting out actually does." That study never touched the training switch. The rest of this article separates the pieces.

What Google and Microsoft Actually Announced on October 30, 2026

Both companies announced support for the same signal, but on different terms. Here is what each one committed to.

Google's Search Central announcement says it plans to support a shared "policy token" in robots.txt, so site owners can state a training preference across participating AI providers in one step. Google says it aims to support this in 2027. Its crawler documentation narrows that to early 2027.

Microsoft's Bing announcement goes further. It adopts the same training signal and adds a separate page-level grounding preference, both honored as it crawls starting February 1, 2027.

OpenAI said the same day that it will honor the signal for foundational generative AI training, and that it aims to implement it "in the coming months." Its existing crawler controls stay in place. PPC Land reports that Anthropic is participating too. Anyone not participating has made you no promise.

Microsoft and Google run on separate timelinesMicrosoft dates: December 15, 2026 temporary grounding settings open in Bing Webmaster Tools. February 1, 2027 new preferences honored as Microsoft crawls. March 1, 2027 NoArchive and NoCache stop counting as training or grounding preferences. September 30, 2027 temporary grounding settings expire. Google: announced October 30, 2026, support targeted for early 2027 with no specific date. The shared draft is version 00.Microsoft and Google Run on Separate ClocksBoth announced October 30, 2026. Spacing is not to scale.MICROSOFTDec 15, 2026Temporary groundingsettings openFeb 1, 2027New preferenceshonored as it crawlsMar 1, 2027NoArchive, NoCachestop countingSep 30, 2027Temporary settingsexpireGOOGLESupport targeted for early 2027. No specific date published.Sources: Microsoft Bing Blog, Google Search Central, October 2026Microsoft and Google run on separate timelinesMicrosoft dates: December 15, 2026 temporary grounding settings open in Bing Webmaster Tools. February 1, 2027 new preferences honored as Microsoft crawls. March 1, 2027 NoArchive and NoCache stop counting as training or grounding preferences. September 30, 2027 temporary grounding settings expire. Google: announced October 30, 2026, support targeted for early 2027 with no specific date. The shared draft is version 00.Microsoft and Google Runon Separate ClocksMICROSOFTDec 15, 2026Temporary groundingsettings openFeb 1, 2027New preferenceshonored as it crawlsMar 1, 2027NoArchive, NoCachestop countingSep 30, 2027Temporary settings expireGOOGLESupport targeted for early 2027.No specific date published.Sources: Microsoft Bing Blog,Google Search Central, Oct 2026
The two timelines should not be merged. Microsoft has dates. Google has a target.

The Standard Is Not Finished

The signal comes from an Internet-Draft filed October 30, 2026. The tracker lists it as an individual draft at version 00, and the document itself says it has no formal standing in the IETF standards process. Google calls it a "draft proposal" too.

That does not make it unimportant. It does mean the wording can change, so nobody should describe it as a universal block on AI. It is a stated preference that participating companies have said they will honor.

AI Training, AI Grounding and AI Search Are Different

Most of the confusion comes from three jobs getting called "AI." Each one answers a different question about your content.

Job Plain meaning Example What you might gain or give up
Training Your content helps build a future AI model A model's learned parameters change Control over that use. Microsoft says allowing it can help improve future models, with no promise of traffic
Grounding Your page is pulled in to inform an answer as it is generated Copilot or Gemini Apps answering a question Citations and links, plus the visibility that comes with them
AI search features Your site appears inside a search engine's AI results AI Overviews and AI Mode Links and impressions inside those features

Those lines blur in practice, and they do not fall in the same place at each company. The chart below maps each control to what it changes, based on what Google and Microsoft have published.

Which AI setting changes whatWhich setting changes what. Shared training signal: trains AI models yes, Gemini Apps answers can be affected, AI Overviews and AI Mode no, Microsoft AI answers no, regular search no. Google-Extended: training yes, Gemini Apps answers yes, the rest no. Search generative AI control: only AI Overviews and AI Mode. Microsoft AI Training: training only. Microsoft AI Grounding: Microsoft AI answers only. CAN means Google plans to read a shared opt out as disallowing Google-Extended when Google-Extended is not named. Sources: Google and Microsoft documentation, October 2026.Which AI Setting Changes WhatFive controls, five jobs. Read across before anyone edits your site.Train AImodelsGemini AppsanswersAI Overviews+ AI ModeMicrosoft AIanswersRegularsearchShared training signalrobots.txt, not live until 2027YESCANNONONOGoogle-Extendedrobots.txt, works todayYESYESNONONOSearch generative AI controlSearch Console, works todayNONOYESNONOMicrosoft AI Trainingrobots.txt or page, Feb 2027YESNONONONOMicrosoft AI Groundingpage level only, Feb 2027NONONOYESNOCAN: Google plans to read a shared opt out as blocking Google-Extended unless you name Google-Extended yourself.Sources: Google Search Central and Microsoft Bing documentation, October 2026Which AI setting changes whatWhich setting changes what. Shared training signal: trains AI models yes, Gemini Apps answers can be affected, AI Overviews and AI Mode no, Microsoft AI answers no, regular search no. Google-Extended: training yes, Gemini Apps answers yes, the rest no. Search generative AI control: only AI Overviews and AI Mode. Microsoft AI Training: training only. Microsoft AI Grounding: Microsoft AI answers only. CAN means Google plans to read a shared opt out as disallowing Google-Extended when Google-Extended is not named. Sources: Google and Microsoft documentation, October 2026.Which AI SettingChanges WhatShared training signalrobots.txt, not live until 2027Train AI modelsYESGemini Apps answersCANAI Overviews + AI ModeNOMicrosoft AI answersNORegular searchNOGoogle-Extendedrobots.txt, works todayTrain AI modelsYESGemini Apps answersYESAI Overviews + AI ModeNOMicrosoft AI answersNORegular searchNOSearch generative AI controlSearch Console, works todayTrain AI modelsNOGemini Apps answersNOAI Overviews + AI ModeYESMicrosoft AI answersNORegular searchNOMicrosoft AI Trainingrobots.txt or page, Feb 2027Train AI modelsYESGemini Apps answersNOAI Overviews + AI ModeNOMicrosoft AI answersNORegular searchNOMicrosoft AI Groundingpage level only, Feb 2027Train AI modelsNOGemini Apps answersNOAI Overviews + AI ModeNOMicrosoft AI answersYESRegular searchNOCAN: Google plans to read a sharedopt out as blocking Google-Extendedunless you name Google-Extended.Sources: Google, Microsoft Bing, Oct 2026
Each row is a separate control. The only row that crosses from training into answers is the shared signal on Google, because Google-Extended covers both jobs.

Note the Regular Search column. Google says Google-Extended is not a ranking signal, and Microsoft says its preferences don't change eligibility for traditional Bing results. Blocking regular crawlers is a separate decision with far bigger consequences, so don't let the two get mixed up.

Why Google-Extended Makes the Answer More Complicated

This is the part of the warning that has real teeth, and it comes straight from Google's own documentation. The post never mentions it.

Google-Extended is one token doing two jobs. Google's documentation says it manages Gemini model training and also grounding in Gemini Apps and in Grounding with Google Search on Vertex AI. Google's announcement adds that if you opt out with the shared token and don't name Google-Extended, it plans to read that as if you had disallowed Google-Extended.

The announcement also says sites that "specifically allow Google-Extended are eligible to appear in responses and receive clicks via grounding in Gemini Apps." Put those together and a plain training opt-out looks likely to take you out of Gemini Apps answers. That is our reading of the documents, since nobody can test a signal Google does not honor yet.

Here is how the two choices would look in robots.txt, based on the syntax Google and Microsoft have published. Don't paste either one until you have made the decision on purpose.

# Option A: opt out of training with participating providers.
# Google plans to read this as disallowing Google-Extended.
User-Agent: __usage_ai-training
Disallow: /

# Option B: same as above, plus an explicit Google exception.
# Keeps Gemini Apps grounding eligibility, and also keeps Gemini training.
User-Agent: __usage_ai-training
Disallow: /

User-Agent: Google-Extended
Allow: /

As documented today, Google offers no way to split those two inside Google-Extended. You can't refuse Gemini training while keeping Gemini Apps grounding the way Microsoft lets you split the two.

What Google-Extended does not control is AI Overviews or AI Mode. Google's documentation says it "does not impact a site's inclusion in Google Search," and those features have their own Search Console control.

The shared robots.txt signal is not live. Microsoft starts honoring it February 1, 2027, and Google is aiming for early 2027.

What the Cyrus Shepard Experiment Actually Tested

The study is real and worth reading. It just tested something else.

Cyrus Shepard described it in a LinkedIn post as an "admittedly small case study." Barry Schwartz covered it for Search Engine Roundtable on October 30, 2026. Schwartz reports that Shepard used Google's Search generative AI opt-out controls to keep one site out of AI Overviews and AI Mode for a period, then compared the numbers.

Here is what he reported, for that one site:

  • AI impressions fell to zero right away. They had been about 8% of the site's total impressions.
  • AI impressions had an estimated click-through rate of about 0.9%. He got that by working backward from overall click data, so it is an estimate and not a direct measurement.
  • Regular organic clicks also fell while the site was out of the AI features, which he called the most surprising result.
  • Average position rose sitewide, which he put down to new posts and brand search. On the URLs with the most AI visibility, position dropped and then rose when AI visibility came back.

Both write-ups include the chart below. Neither labels the report, but we read it as his AI impressions, since the line hits zero while the site stayed in regular search.

Search Console line chart of impressions from July 27 to October 24, 2026, running between about 400 and 1,200 a day, flat at zero from about September 3 to about September 28, then returning to about 400 to 900 a day
Impressions chart from Cyrus Shepard's case study, as published by Search Engine Land. It shows impressions only, so it does not show the drop in organic clicks.

Shepard's explanation is a "Search SERP Halo Effect": appearing in more places on a results page makes a click somewhere more likely. It's a reasonable idea. He offered it as a possibility, and the post states it as what happened: being named "made people more likely to click."

The study and the announcement used different controlsTwo cards. What the one-site study changed: an opt-out from Google AI features, reported as the Search generative AI control in Search Console, public by October 29 and tested on one site, which removed it from AI Overviews and AI Mode. What was announced: a shared robots.txt signal, not honored until 2027, across participating AI providers, about model training. Google says of the Search control: this control does not affect AI training.Two Different SwitchesThe study did not flip the switch Google and Microsoft just announcedThe study changedOpt-out from Google AI featuresReported as the Search Console controlPublic by Oct 29, tested on one siteRemoved AI Overviews + AI ModeThe announcement coversShared robots.txt signalSet in your robots.txt fileNot honored until 2027Asks AI providers not to trainGoogle on the Search control: "This control doesn't affect AI training."The study and the announcement used different controlsTwo cards. What the one-site study changed: an opt-out from Google AI features, reported as the Search generative AI control in Search Console, public by October 29 and tested on one site, which removed it from AI Overviews and AI Mode. What was announced: a shared robots.txt signal, not honored until 2027, across participating AI providers, about model training. Google says of the Search control: this control does not affect AI training.Two Different SwitchesThe study changedOpt-out from Google AI featuresReported as the Search Console controlPublic by Oct 29, tested on one siteRemoved AI Overviews + AI ModeThe announcement coversShared robots.txt signalSet in your robots.txt fileNot honored until 2027Asks AI providers not to trainGoogle on the Search control:"This control doesn'taffect AI training."
Reported together, but they are different things. The method is as reported by Search Engine Roundtable. The quote is from Google’s Search Console Help page for the Search generative AI control.

One detail is still unsettled. Shepard's post doesn't name his method, and Search Engine Land's October 29 write-up says he didn't disclose it, so Schwartz's account is the only one we found that does. That timing matters too: the study was already public the day before Google and Microsoft made their announcements, and the chart suggests the opt-out itself ended about a month earlier, around September 28.

What the Experiment Cannot Prove

A result from one site can be a good reason to run more tests. It can't tell a plumber what will happen to their phone.

It did not test the new signal. The test appears to have finished weeks before the signal was announced, and no provider honors it yet. If Schwartz has the method right, the control used is a different mechanism too. Google's help page says of it: "This control doesn't affect AI training."

It can't show cause. One site, one before-and-after comparison, with new posts and brand searches moving during the same period. Search Engine Land notes he did not share the site's traffic volume, the test dates or the size of the click decline. The dates we mention are read off his chart, so treat them as approximate. Schwartz calls it "super limited" and says he hasn't seen anyone else produce data like it.

Google also says the control "isn't used as a ranking or inclusion signal affecting other parts of Search," so a penalty is an unlikely explanation for the drop, though not one this test can rule out.

It says nothing about leads. The study reports impressions, clicks and position. It has no calls, form fills or revenue, and nothing shows the site resembles a local service business. So the idea that invisibility is the real enemy may turn out to be true for local businesses, but this study doesn't establish it.

What it does support is narrower and still useful: if someone removes your site from AI Overviews and AI Mode, watch your regular clicks closely. For the wider pattern of stretched AI search claims, see our look at the viral stats behind AI search panic and our roundup of the worst SEO advice this year.

A Practical AI Visibility Audit for Your Business

The post suggests asking your web person for a plain yes or no on being opted out of AI answers. It's a good instinct, but one answer can't cover five controls. Ask for this instead.

  1. Read your robots.txt. Open yoursite.com/robots.txt and list every rule naming an AI crawler or token, including Google-Extended, GPTBot, OAI-SearchBot and __usage_ai-training.
  2. Check Search Console. Under Settings, look at Search generative AI. Include is the default, and a parent property can pass its setting down.
  3. Check page-level tags. Look for nosnippet, max-snippet and noindex, plus NoArchive and NoCache. Google lists the first three among the controls that limit what appears from your pages in Search.
  4. Look past your own site. Plugins, security tools and CDN settings can block crawlers without touching the settings above. Test what a crawler actually receives, for example with the URL Inspection tool in Search Console.
  5. Record each provider separately. OpenAI, for example, documents separate settings for search (OAI-SearchBot) and training (GPTBot). "We block AI" is not a useful entry.
  6. Take a baseline before any change. Note the date, who changed what and why. Pull the Generative AI performance report in Search Console and your actual calls and form fills.

Keep your Google Business Profile and website details accurate as well. That won't change any training preference, but conflicting business info can hurt AI recommendations, and it is cheap to fix. Our free AI Search Self-Check gives you prompts to run and a scorecard to fill in, and our guide to tracking AI visibility over time covers the follow-up.

One Deadline Worth Checking Now

If your site uses NoArchive or NoCache, Microsoft wants you to act. After March 1, 2027, it will stop reading those tags as training or grounding preferences, and both new preferences default to Allow. Microsoft says sites not using those tags need no transition action. Check anyway, because a tag someone added years ago could stop meaning what they intended.

“I wish we would have switched sooner. Advanced Office Care was forced to switch services when the big corporate giant we were using decided to discontinue those services. Not only did BlackSheep make the transition easy, Clint and his team also offers more for your money.”

Clay VavasseurGoogle review, 2024

Should Small Businesses Block AI Training?

There isn't a universal answer, and anyone giving you one is guessing. The evidence on what this does to a local business's leads doesn't exist yet.

So decide based on what you are protecting and what you want found. This table is our judgment, not a finding from any study.

If this describes you A reasonable starting point
Your site mostly lists services, areas and contact details, and you want to be named in answers Leave grounding and AI search features alone. Training is your call, but if you opt out, decide on purpose what to do about Google-Extended
You sell original content, research, courses or paid knowledge Blocking training is a sensible choice. Weigh the Gemini Apps tradeoff against what that content is worth
You object to AI training on principle That is a legitimate reason. Microsoft lets you refuse training and allow grounding. At Google, expect to give up Gemini Apps eligibility
A few pages are sensitive or premium, and the rest are marketing Use path or page-level settings where they exist, so one rule doesn't cover the whole site
You have no idea what is set today Run the audit above first and change nothing until you know

Keep your expectations modest either way. Microsoft says "Neither choice guarantees inclusion, traffic, or payment." Allowing everything won't get you cited by itself. As we covered in what actually earns AI citations, that comes from useful pages and a real reputation. If AI tools skip you today, the usual reasons have little to do with this signal.

Get a Clear Answer Before You Change Your Website

The announcements are real, and so is the study. They just aren't about the same switch. Nothing here needs a rushed change this week, apart from finding out what your site says today.

If you want help reading those settings and measuring the result, our answer engine optimization team and SEO service start with what is actually on your site. We can't promise citations or rankings, and nobody honest can. We can tell you what each setting does and what you would be trading.

Ready to put this to work?

Talk to the people who would actually build it.

About the author

Clint Sanchez, co-founder of BlakSheep Creative

Clint Sanchez

Co-Founder & Lead Developer · Denham Springs, LA

Clint has been designing for clients since 2008 and co-founded BlakSheep Creative in 2018. He is also a 29-year firefighter and a 23-year member of IAFF Local 557, which is where the bias toward plain answers over sales copy comes from.

  • Veteran-owned
  • Firefighter-owned
  • IAFF Local 557

More about ClintLinkedIn ↗(225) 505-3834

Common Questions About AI Training Opt-Outs and AI Search

These are the questions we expect owners to ask their web person this month. Each answer sticks to what Google and Microsoft have published as of October 31, 2026.

Does blocking AI training remove me from Google?
No. Google says Google-Extended does not affect a site's inclusion in Google Search and is not a ranking signal. Google plans to treat the shared opt-out like Google-Extended, so the same should apply once it is live. Blocking Googlebot itself is a different action, and that one can remove you from Search.
Does Google-Extended control AI Overviews?
No. Google-Extended covers Gemini model training and grounding in Gemini Apps and Vertex AI. AI Overviews and AI Mode are managed through the Search generative AI control in Search Console, along with preview controls such as nosnippet. Google's documentation treats them as separate, so check each one on its own.
Can I allow AI grounding but block training in Bing?
Yes. Microsoft says the two are independent and gives that exact example: set AI Training to Disallow and AI Grounding to Allow. Both default to Allow, so a robots.txt training opt-out alone is enough. Microsoft says these choices start applying February 1, 2027, as it crawls your pages.
What does the new robots.txt signal do?
It lets you state one training preference to participating AI companies with a single robots.txt group using the token __usage_ai-training. It expresses a preference, and it does not technically stop anyone. It comes from an early Internet-Draft, so the details can change, and each company decides how to apply it.
Will blocking AI training lower my rankings?
Google and Microsoft both say no in their documentation. Google says Google-Extended is not used as a ranking signal, and Microsoft says its preferences don't change eligibility for traditional Bing results. No one can measure the new signal yet, because neither company honors it, so watch your own numbers after any change.
How can I check my website's current AI crawler settings?
Open yoursite.com/robots.txt and look for AI crawler names and tokens. Then check Settings in Search Console for the Search generative AI control, and ask your developer about page tags, plugins and CDN rules. Write down each result by provider, because one yes or no can't describe all of them.

Your next step, without the guesswork

No surprises, clear next steps, and a fixed price before anything starts.

Tell us what you're working on

Fixed quote before we start. You talk to the people who build it.

Call (225) 505-3834

No spam, no pressure. Fixed quotes before we start.

Call nowDiscovery Call