Features
llms.txt for WordPress
llms.txt is a short text file that describes your site to AI tools and points them to your most important pages. CrawlWP publishes one for you at yoursite.com/llms.txt. Let CrawlWP write it from your site details, or write your own.
What it does
What CrawlWP llms.txt does
Turn it on, and your site has an llms.txt file. No file uploads, no FTP and no coding.
On this page
A file at /llms.txt
WordPress serves it for you. There is no file to upload.
Written for you
Leave the box empty and CrawlWP builds a default file from your site title, tagline and sitemap address.
Or write your own
Use simple Markdown: a # title, a short summary, and ## sections with your links.
Points to your sitemap
The default file links to your sitemap, so readers can find the rest of your site.
Lists your homepage
The default file includes your homepage address too.
One switch
Tick Enable llms.txt to publish it. Untick it and the file is no longer served.
Plain text
Easy to read and quick to update when your site changes.
Next to robots.txt
Both files live in the same CrawlWP settings.
Does not block anything
llms.txt describes your site. To keep AI crawlers out, use robots.txt.
Follows the llms.txt proposal
The default file uses the Markdown format the proposal describes.
Works with structured data
CrawlWP’s schema markup also helps AI tools understand who runs your site.
Free
llms.txt is part of CrawlWP Lite, the free version.
Should you publish one?
Should you publish an llms.txt file?
llms.txt was proposed in September 2024 by Jeremy Howard of Answer.AI. It is a short Markdown file that points AI tools to the pages that matter most on your site.
It is a proposal, not an official standard. Google Search does not use it, and no major AI company has committed to reading it. Some AI tools and agents may still fetch it.
It takes a minute, costs nothing and does no harm. That is why CrawlWP makes it one switch.
How it works
Add llms.txt to WordPress in three steps
It takes about a minute.
Step 1
Switch it on
On the llms.txt screen, tick Enable llms.txt. CrawlWP creates a default file straight away.
Step 2
Describe your site
Replace the default with a one-line summary and links to your most important pages, or keep the default.
Step 3
Check it
Open yoursite.com/llms.txt in your browser to see the file.
llms.txt and robots.txt
llms.txt and robots.txt do different jobs
Both are plain-text files at the root of your site, and both are edited in CrawlWP. But they do different things.
What a simple llms.txt looks like
This is the kind of file CrawlWP creates if you leave the box empty.
# Your Site Name
> A one-line description of your site
This site publishes web pages that may be used as context by language models.
## Sitemap
https://yoursite.com/wp-sitemap.xml
## Home
https://yoursite.com/Questions
llms.txt questions
Answers to the questions people ask most about llms.txt in WordPress.
What is llms.txt?
It is a short Markdown file at yoursite.com/llms.txt. It describes your site and points AI tools to your most important pages.
Is llms.txt an official standard?
No. It is a proposal from September 2024, not a standard approved by any official body.
Does Google use llms.txt?
No. Google has said that Google Search, including its AI features, does not use llms.txt. It will not help or hurt your Google rankings.
Then why publish one?
It is free, takes a minute and does no harm. Some AI tools may read it, and it lets you describe your site in your own words.
Does llms.txt block AI crawlers?
No. It describes your site to them. Blocking is a job for robots.txt.
What should go in it?
A one-line description of your site, your sitemap address, and the pages you would most like AI tools to use. Short is fine.
Where does CrawlWP publish it?
At yoursite.com/llms.txt, once you tick Enable llms.txt.
Is llms.txt free in CrawlWP?
Yes. It is part of CrawlWP Lite, the free version.
Pricing
Straightforward pricing, every feature included
Standard
For 1 Site
$59
/ year
Pro
For 5 Sites
$159
/ year
Agency
For Unlimited Sites
$259
/ year
Standard
For 1 Site
$359
once
Pro
For 5 Sites
$559
once
Agency
For Unlimited Sites
$759
once
Describe your site to AI tools in a minute
Join thousands of website owners using CrawlWP for their WordPress SEO. llms.txt is free, and one switch away.
yoursite.com
https://yoursite.com › guides › wordpress-seo
A Practical Guide to WordPress SEO in 2026
Learn how to structure, optimize and index a WordPress site so search engines find your content within hours rather than weeks.
Google · indexed
Bing · indexed
Yandex · indexed