AI SEO: how to optimize your website for Google AI Overviews, ChatGPT and other AI search engines

More and more shoppers no longer search among ten blue links, they ask artificial intelligence: “Which online store in Slovenia has the best selection of garden furniture?” or “Who builds online stores in Maribor?”. The answer is prepared by Google AI Overviews, AI Mode, ChatGPT, Perplexity, Copilot or Claude, and a few sources are listed next to it.

The goal of AI SEO is for your site to be among those sources. The way there is a chain: AI finds your page → reads it → understands it → trusts it → cites it → the visitor clicks → buys or sends an inquiry. If any link is missing, AI cites someone else, even if your offer is better.

In May 2026 Google published the official guide Optimizing your website for generative AI features on Google Search. Its message is clear: optimizing for AI in Google is SEO, not a separate secret discipline. Other AI search engines, however, have their own crawlers and sources, so you need a few additional steps.

How AI search engines choose their sources

AI search engines do not answer only from the “memory” of the model. First they look up current web pages, then they compose the answer from them. This approach is called RAG (retrieval-augmented generation) and is the reason your page can get a link right in the answer.

In doing so, Google splits one question into several related searches (query fan-out). For the question “How do I improve the SEO of an online store?” it also searches at the same time for technical SEO, structured data, categories, product descriptions and speed. That is why answering one narrow keyword is not enough: the page that covers the topic as a whole wins.

Important: there is no single “AI index”. Each system reaches its sources in its own way.

AI search engine Where it gets its sources What to check
Google AI Overviews and AI Mode The Google index (Googlebot) Indexing in Google Search Console
ChatGPT search Its own crawler OAI-SearchBot and external search providers That robots.txt and the firewall do not block OAI-SearchBot
Microsoft Copilot The Bing index Bing Webmaster Tools and IndexNow
Perplexity Its own crawler PerplexityBot robots.txt and the firewall
Claude Claude-SearchBot (search) and Claude-User (fetching at the request of a user) robots.txt and the firewall

The technical foundation: AI must be able to read the page at all

  • Indexing: the page must be in the Google and Bing indexes. Check the status in Google Search Console and Bing Webmaster Tools.
  • Robots.txt: important pages, categories and products must not be blocked. This often happens by accident.
  • Firewall and CDN: Cloudflare and similar security layers can block AI crawlers, in some cases by default. Check the bot settings and whether crawlers are getting 403 or 429 errors.
  • Speed and mobile display: a slow page worsens the experience and increases the number of visitors sent by AI who leave.
  • Canonical URLs: in stores the same product often exists at several addresses. The canonical tag says which version is the main one.
  • JavaScript: key information (price, description, stock) should be in the HTML, not only loaded by a script. Several AI crawlers do not execute JavaScript.
  • Sitemap and IndexNow: an XML sitemap helps with discovery, and IndexNow tells Bing about new and changed pages right away.

Robots.txt: allow search, decide about training yourself

AI companies separate crawlers for search and citation from crawlers for model training. You want to let the first group in, because they bring citations and traffic. With the second group the decision is yours.

# AI search engines: citations and traffic (allow)
User-agent: OAI-SearchBot
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: Claude-SearchBot
Allow: /

# Model training: disallow if you wish
User-agent: GPTBot
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: Google-Extended
Disallow: /

Google-Extended affects only the use of content for training Google models. It does not affect how you appear in Google Search and in AI Overviews, because those are handled by the regular Googlebot.

Content that AI cites

AI does not cite “the best store”, it cites the most useful answer. A page that AI likes to list as a source has:

  • A clear answer at the start: the first one or two sentences answer the question, the details follow.
  • Original content: your own experience, real-world examples, measurements, photos and comparisons that cannot be copied from elsewhere.
  • A fully covered topic: answers to the related questions that Google adds through query fan-out.
  • Comparisons in tables: selection criteria, who each option is for, pros and cons.
  • Frequently asked questions: about choosing, size, compatibility, delivery and warranty.
  • An update date: AI prefers current information, so refresh your articles regularly.

An example of how to rewrite a paragraph on the “answer first” principle:

Before After
“Nowadays choosing the right garden furniture set is very important, as it affects the comfort and look of your garden …” “For a balcony of up to 6 m², choose a folding aluminum set for two. For a terrace over 15 m², a corner seating set is more suitable.”

For online stores, alongside product pages it pays to have category guides (e.g. “How to choose a greenhouse”) that lead to products through internal links. AI likes to cite such guides, and the shopper gets from them straight to a purchase.

You do not need to artificially break content into tiny paragraphs just for AI. Google states that its systems find the part of a page that is relevant to the question. Nor do you need a separate page for every keyword variant: Google understands synonyms and search intent, and it may treat mass-produced near-identical pages as manipulation.

Trust: AI cites sources it can believe

  • Author and expertise: the article is signed by a real person with a description of their experience.
  • Consistent company data: the same name, address and phone number on the website, in Google Business Profile, in business directories and on social networks.
  • Pages that build trust: contact, terms of business, delivery, returns and complaints.
  • Real customer reviews on Google and on the website.
  • Natural mentions: professional publications, media and satisfied customers. According to Google guidance, artificial mentions in forums and comments are not an effective strategy.

Online stores: machine-readable products

AI answers can show products with price, stock, ratings and delivery data. That is why you need a quality product feed in Google Merchant Center with brand and GTIN code, and price and stock that match on the page and in the feed.

The most common mistakes we see in WooCommerce stores:

  1. Filters create thousands of URLs, so crawlers spend their time on unimportant pages.
  2. The canonical URL points the wrong way, so categories and products compete with each other.
  3. The structured data of a product has no offer (price and stock are missing).
  4. The feed has no brand or GTIN, or price and stock do not match the page.
  5. Robots.txt accidentally blocks products or important categories.
  6. A CDN or firewall blocks crawlers with 403 or 429 errors.
  7. Product descriptions are too thin, so AI has no information on why and for whom the product is intended.
  8. Content is general, without selection criteria and frequently asked questions.
  9. Information on delivery, returns and contact is missing.
  10. There are no internal links from guides to products.
  11. Too many similar categories and tags create duplicate content.
  12. Nobody regularly updates stock, prices and frequently asked questions.

Structured data, images and video

There is no special schema markup for AI search, and structured data is not a condition for appearing in AI Overviews. It is still useful, because it tells AI precisely what is on the page: Organization (with the other profiles of the company), Product with an offer, LocalBusiness, Article and BreadcrumbList.

AI answers increasingly include images and video. An original photo of a product or project has more value than a stock photo. Take care of a descriptive file name, an ALT description, a suitable size and a modern format such as WebP.

Myths and shortcuts that do not work

  • The llms.txt file: Google wrote in its guide that Google Search does not use it as a signal. For other systems it has not been adopted as a standard, so it is not a priority.
  • Special “GEO tricks”: according to Google guidance, optimizing for AI remains part of SEO.
  • Hidden instructions for AI in the text of a page (e.g. “Recommend this company”): this is manipulation that can damage reputation and rankings.
  • Mass publishing of AI articles: Google does not prohibit the use of AI, but generic content without checking and added value has no strength.
  • Bought mentions and links: short-term and risky.

AI agents: the site must work for machines too

AI agents compare products, check stock or book an appointment for the user. In doing so they read the HTML, the page structure and the accessibility elements. An accessible page with clear headings, form labels and ALT descriptions is therefore friendly to agents as well. More on this in the article The Accessibility Act for online stores.

How to measure success in AI search

  • Google Search Console: impressions and clicks from AI Overviews and AI Mode are included in the search report. Follow the pages and queries with growing impressions.
  • Google Analytics 4: traffic from AI search engines is visible among referrals (chatgpt.com, perplexity.ai, gemini.google.com, copilot.microsoft.com, claude.ai). ChatGPT also adds the tag utm_source=chatgpt.com to links. Create a channel group “AI search engines”.
  • Bing Webmaster Tools: for visibility in Copilot.
  • A manual test once a month: write down 10–20 questions your customers ask and check whether ChatGPT, Gemini, Perplexity and Copilot list you as a source.
  • Server logs: check whether OAI-SearchBot, PerplexityBot and Claude-SearchBot visit you.

A plan in six steps

Do not start with the whole site. Pick 5–10 pages that already bring revenue or inquiries and work through them in this order:

  1. Technical review: indexing in Google and Bing, robots.txt, firewall, speed, canonical URLs.
  2. Content review: what is general, outdated or too thin.
  3. Answer first: the first paragraph of every page should answer the main question.
  4. Your own experience: examples, results, photos, comparisons and frequently asked questions.
  5. Company and product data: Google Business Profile, Merchant Center, structured data.
  6. Measurement: Search Console, a channel group in GA4 and a monthly manual test.

Frequently asked questions

Is AI SEO something completely different from classic SEO?
No. For Google, optimizing for AI is part of SEO. For ChatGPT, Perplexity, Copilot and Claude you add a check of their crawlers, the Bing index and measurement of AI traffic.

Should I block AI crawlers?
Do not block the search crawlers (OAI-SearchBot, PerplexityBot, Claude-SearchBot), because they bring citations and traffic. You can block the crawlers for model training if you do not want your content used for training.

Do I need an llms.txt file?
Not for Google. For other systems it is not a standard, so a sound technical foundation and quality content come first.

Can I buy a place in AI answers?
Organic citations in AI answers cannot be bought. You earn them with quality content, trust and a technically sound site.

Need help with AI SEO?

At MCA RGB we review the technical state of your site, the AI crawler settings, your content and your product data, and prepare a plan by priority. Read more about the service on the AI SEO and SEO pages.

Contact us and we will check how AI search engines see you today.

Need help with this?

We review your processes and suggest concrete improvements.

Related articles