Quick answer
What is llms.txt and does my website need one?
llms.txt is a proposed Markdown file, placed at yoursite.com/llms.txt, that gives AI tools a short summary of a website and links to its most useful pages. It is not an official standard. Google says no AI text file is needed to appear in AI Overviews or AI Mode, so most Dubai business sites can treat it as optional.
- What it is
- A Markdown file at /llms.txt listing key pages
- Proposed by
- Jeremy Howard, 3 September 2024
- Official standard
- No, a community proposal
- Needed for Google AI features
- No, per Google Search Central
- Time to create
- Usually under an hour for a small site
llms.txt is a plain Markdown file at the root of a website, such as yoursite.com/llms.txt, that tells AI tools what the site is and where its most useful pages are. Your Dubai website does not need one to appear in Google's AI answers, but it can be a small, low-risk extra for sites with a lot of reference material.
The idea was put forward by Jeremy Howard, and the llmstxt.org proposal dates its first version to 3 September 2024. The page itself calls it a proposal. No standards body has adopted it.
What goes inside an llms.txt file?
The format is short and strict. According to the proposal, only the first line is required. The rest is a recommended order.
| Part | Required | Example for a Dubai firm |
|---|---|---|
| H1 with the site or business name | Yes | # Al Quoz Joinery Works |
| Blockquote summary | Recommended | A quote line: Custom furniture and fit-out joinery in Dubai, English and Arabic |
| Short notes, no headings | Optional | Service area, languages, how to request a quote |
| H2 sections with link lists | Recommended | ## Services, then one link per service page with a short note |
| An "Optional" H2 section | Optional | Links an AI tool can skip when it needs less context |
The proposal also suggests clean Markdown copies of key pages at the same address with .md added. Few small business sites do this, and it is not needed to start.
Does Google use llms.txt for AI Overviews?
No. Google's page on AI features and your website says there are no extra requirements to appear in AI Overviews or AI Mode. It states that you do not need to create new machine-readable files, AI text files or markup for these features.
Google's John Mueller went further in June 2025. As Search Engine Roundtable reported, he wrote "no AI system currently uses llms.txt" and said server logs showed chatbots fetching pages, not this file. That was a comment at a point in time, and use could change.
Since Google holds about 95% of UAE search, per StatCounter's October 2026 data, a Dubai business should not expect this file to change its Google traffic.
What matters more than llms.txt for AI search in Dubai?
AI tools mostly read your normal pages. Before any new file, check the basics that decide whether they can reach and understand those pages.
- Crawler access. OpenAI says sites that block OAI-SearchBot will not be shown in ChatGPT search answers. Check robots.txt and any firewall or CDN rules, as described in OpenAI's crawler documentation.
- Indexing in Google. Google says a page must be indexed and eligible for a snippet to appear as a link in AI features.
- Text, not images. Prices, areas served and opening hours written in HTML, not only inside a banner.
- Clear page structure. One topic per page, plain headings and a direct answer near the top.
- Accurate structured data. See our guide to schema markup for AI search.
These checks are part of technical SEO services in Dubai, and they help in Google, Bing and AI tools at the same time.
When is an llms.txt file worth adding for a Dubai business?
This is practical advice, not a rule from any search engine. The file makes most sense when a site has many pages and a clear set of reference material.
- A DIFC software firm with product documentation that developers load into AI coding tools.
- A training provider with a long course catalog in English and Arabic.
- A business directory or knowledge base where a short map of sections saves an AI agent time.
Mueller did leave one case open: an automated system already on your site might find such a file useful. For a five-page brochure site in Al Quoz, the file adds little, though it does no harm.
How to create llms.txt in five steps
- Open a plain text editor and write your business name as a single H1 line.
- Add one blockquote line that says what you do and where, for example "Dubai and the other emirates".
- Add H2 sections for services, guides and contact pages, each with Markdown links and a short note.
- Save it as llms.txt and upload it to the root folder of your site. On WordPress this is usually the same folder as wp-config.php.
- Open yoursite.com/llms.txt in a browser to confirm it loads, and update it when key pages change.
To see what really affects your visibility, read how AI assistants choose sources and how to check AI visibility. Our SEO agency in Dubai covers this work as part of a wider plan. If you are unsure what your site is missing, get a free audit first. No one can promise an AI tool will mention your business, with or without this file.
Questions people ask
Is llms.txt the same as robots.txt?
No. robots.txt is an established file that tells crawlers which parts of a site they may or may not fetch. llms.txt does not allow or block anything. It is a proposed summary and reading list for AI tools. To control whether ChatGPT or Perplexity can reach your pages, robots.txt is still the file that matters.
Can llms.txt hurt my Google rankings?
There is no sign that it does. Google says it does not need the file, and a plain text file at the site root is ignored by ranking systems that do not use it. The real risk is out-of-date content in the file, such as old services or wrong contact details, which could mislead a tool that does read it.
Should I write llms.txt in Arabic as well as English?
The proposal does not cover languages. A practical approach for a bilingual UAE site is one file in English that links to both the English and Arabic sections, with short notes saying which language each link is in. Keep the business name and summary consistent with your Arabic pages.
Do WordPress SEO plugins create llms.txt automatically?
Some WordPress SEO plugins now offer an option to generate the file from your pages. Check the plugin's own documentation and review the result before publishing, because an automatic list can include thin pages, tag archives or old posts you would rather not point AI tools to.
Sources
Osama Digital Marketing Agency Dubai · Last reviewed