Best Robots.txt & Crawler Directives plugins for WordPress
Plugins that create and manage robots.txt files and crawler directives to control which parts of a site search engines and other bots may access.
Read from 131,237 plugin records - figures refreshed 2 hours ago
32
Plugins classified here
Out of the plugins that have been through the classifier so far
119.6K
Combined active installs
Summed across the published bands, so read it as an order of magnitude
4.67
Average rating
Across the 28 here that carry a rating at all
Sub-categories
Also under SEO
The other sub-categories the model built under the same parent.
- SEO Suites 76
- Redirect Management 61
- URL Slug & Permalink Optimization 57
- Meta Tags & SEO Metadata 45
- XML Sitemaps 41
- Image SEO & Metadata 36
- Structured Data & Schema Markup 30
- Internal Link Building 24
- Link Monitoring & Optimization 22
- Search Engine Indexing & URL Submission 15
- Breadcrumb Navigation 14
The plugins
Plugins in Robots.txt & Crawler Directives
Ranked by active installs; plugins in the same published band share a rank. Each page has a maintenance check and the alternatives.
#1
WP Robots Txt
wp-robots-txt #1Virtual Robots.txt
pc-robotstxt #3Robots.txt Editor
robots-txt-editor #4Better Robots.txt – AI-Ready Crawl Control & Bot Governance
better-robots-txt #5Ultimate Noindex Nofollow Tool II
ultimate-noindex-nofollow-tool-ii #5noindex SEO
noindex-seo #5Hide from Search
mpress-hide-from-search #8Surbma | Yoast SEO Sitemap to robots.txt
surbma-yoast-seo-sitemap-to-robotstxt #8Block AI Crawlers
block-ai-crawlers #8mypace Custom Meta Robots
mypace-custom-meta-robots #11Magic robots.txt
magic-robots-txt #11Robots.txt rewrite
robotstxt-rewrite #11Multipart robots.txt editor
multipart-robotstxt-editor #11LLMs.txt Generator
llms-txt-generator #15AI Content Signals
ai-content-signals #15Admin Robots.txt Editor
admin-robots-txt-editor #17Hide Any Page
hide-any-page #18Search engines blocked warning
search-engines-blocked-warning #19Bisteinoff SEO Robots.txt
db-robotstxt #19AI Scrape Protect
ai-scrape-protect #19Block Archive.org via WordPress robots.txt
block-archive-org-robots-txt #22Odyssey LLMS
odyssey-llms #23Disable WP Robots
disable-wp-robots #23PRyC WP: Add noindex tag
noindex #23Search Engines Blocked in Header
search-engines-blocked-in-header #23Simple NoAI and NoImageAI
simple-noai-and-noimageai #27LLMs.txt Curator
llms-txt-curator #27CodingBunny LLMs.txt Generator
coding-bunny-llms-generator #27SiteCare – Search Engine Visibility
discourage-search-engines-notifier #27Hide Link | Really hide links to robots
hide-link #27AI Discovery Files – llms.txt & AI Visibility
ai-discovery-files #27IA SEO Generator
ia-seo-generatorThis grouping does not exist anywhere else
The directory sorts plugins by tags their authors typed. This is what a model reading each plugin produced instead - and the method page says how consistent that is.