Plugin Tag: robots.txt
-
Block eCommerce Assets via robots.txt
Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt
-
Check Search Engine Visibility on Migration
Checks if a site it's inivisible to search engines after a migration. If so, then the plugin warns you to review this setting.
-
CeeWP Robots.txt Manager
Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!
-
-
AI Deny
Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.
-
Block Common Crawl via robots.txt
Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file
-
Block Feed and Comments via robots.txt
Blocks some Feed and Comment resources in order to avoid spam bots
-
Copyright AI Content Licensing – Block AI Crawlers + Get Paid
AI content licensing for WordPress. Block AI crawlers or license your content and get paid. Works with ChatGPT, Claude, Gemini, and more.
-
-
ChatBot Blocker by CellarWeb
ChatBot Blocker by CellarWeb adds commands to the WordPress virtual robots.txt file to block various chatbots from using your site content.
-
ProAI TXT Manager for LLMS and Robots
Automatically generates and manages llms.txt and robots.txt files for your WordPress site with AI-optimized content.
-
Thin Content Manager
See the body word count to identify pages with thin content, then select pages to insert robots noindex,nofollow tags into.
-
Robots.txt Extender
Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.
-
-
Zulkaif Seo File Manager
Generate and control sitemaps, robots.txt, ads.txt, and other essential SEO files with full transparency and no silent automation.
-
Valvai – AI Traffic Control Center
Block, log and monetise AI crawlers directly from your WordPress dashboard.
-
A3 Robots Warning
Warns you of server IP address changes, so you can take care of Search Engine Visibility settings.
-
CiteBoost GEO
Optimize your WordPress site for AI search engines like ChatGPT, Claude, Gemini, and Perplexity.
-
Kandeshop LLMS.txt Generator
Create and manage an llms.txt file from your WordPress admin to guide LLM/AI crawlers. Set policies and disallow rules.
-
AWP Disallow Root Control
Disallow access to the root directory via robots.txt with an option to enable or disable.
