Plugin Tag: robots.txt
-
Block eCommerce Assets via robots.txt
(0 totale wurdearrings)Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt
-
Check Search Engine Visibility on Migration
(1 totale wurdearrings)Checks if a site it's inivisible to search engines after a migration. If so, then the plugin warns you to review this setting.
-
CeeWP Robots.txt Manager
(0 totale wurdearrings)Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!
-
Unblock CSS & JS for Googlebot
(0 totale wurdearrings)Modifies robots.txt to allow Googlebot access JS and CSS files.
-
AI Deny
(1 totale wurdearrings)Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.
-
Block Feed and Comments via robots.txt
(0 totale wurdearrings)Blocks some Feed and Comment resources in order to avoid spam bots
-
Block Common Crawl via robots.txt
(0 totale wurdearrings)Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file
-
Copyright AI Content Licensing – Block AI Crawlers + Get Paid
(0 totale wurdearrings)AI content licensing for WordPress. Block AI crawlers or license your content and get paid. Works with ChatGPT, Claude, Gemini, and more.
-
LJPL Armored robots.txt
(0 totale wurdearrings)Add some directives to your robots.txt file to keep your site safer
-
ChatBot Blocker by CellarWeb
(0 totale wurdearrings)ChatBot Blocker by CellarWeb adds commands to the WordPress virtual robots.txt file to block various chatbots from using your site content.
-
ProAI TXT Manager for LLMS and Robots
(1 totale wurdearrings)Automatically generates and manages llms.txt and robots.txt files for your WordPress site with AI-optimized content.
-
Thin Content Manager
(1 totale wurdearrings)See the body word count to identify pages with thin content, then select pages to insert robots noindex,nofollow tags into.
-
Robots.txt Extender
(0 totale wurdearrings)Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.
-
Kandeshop LLMS.txt Generator
(0 totale wurdearrings)Create and manage an llms.txt file from your WordPress admin to guide LLM/AI crawlers. Set policies and disallow rules.
-
AWP Disallow Root Control
(4 totale wurdearrings)Disallow access to the root directory via robots.txt with an option to enable or disable.
-
AI Rights Protection by SimpleFeed
(1 totale wurdearrings)Protect your rights by reviewing and blocking AI bots from using your content without compensation.
-
GoBookMart Robots Editor
(1 totale wurdearrings)A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.
-
Advanced SEO Toolkit
(0 totale wurdearrings)Advanced SEO Toolkit is a comprehensive solution for optimizing your WordPress site for search engines.
-
Block old browser versions and suspicious browsers
(0 totale wurdearrings)With the help of WhatIsMyBrowser the plugin detects old and bad browsers and denies them access. A special robots.txt denies crawling by bad bots.
-
Check System Details
(0 totale wurdearrings)Easily check your WordPress installation and server details along with database tables, installed plugins, and the active theme.