WordPress.org

Frysk

Krij WordPress
WordPress.org

Plugin Directory

Plugin Tag: crawler

Plugin Tag: crawler

  • Email Address Encoder

    (160 totale wurdearrings)

    A lightweight plugin that protects email addresses from email-harvesting robots, by encoding them into decimal and hexadecimal entities.

    Till Krüss 100.000+ aktive ynstallaasjes Teste mei 7.0.7

  • Robots.txt Editor

    (8 totale wurdearrings)

    Robots.txt for WordPress

    Processby 10.000+ aktive ynstallaasjes Teste mei 5.6.21

  • No-Bot Registration

    (28 totale wurdearrings)

    Prevent bots from creating accounts by blacklisting domains and usernames and present people with a human friendly security question.

    Arnan de Gans 2.000+ aktive ynstallaasjes Teste mei 6.9.10

  • Robots.txt rewrite

    (2 totale wurdearrings)

    Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.

    Eugen Bobrowski 1.000+ aktive ynstallaasjes Teste mei 4.7.37

  • Marquee image crawler

    (1 totale wurdearrings)

    Marquee image crawler is a continuous scrolling image plugin. This plugin crawls the images left or right.

    gopiplus 600+ aktive ynstallaasjes Teste mei 6.1.14

  • Block Archive.org via WordPress robots.txt

    (0 totale wurdearrings)

    Blocks the archive.org bots through the WordPress virtual robots.txt file.

    apasionados 400+ aktive ynstallaasjes Teste mei 6.9.10

  • Mass Ping Tool for SEO – WordPress ping list to get indexed faster on Google, Yandex, …

    (4 totale wurdearrings)

    Mass ping tool for SEO plugin is one of the fastest ways to get indexed by Google. After pinging, Google bots, crawlers will visit your website and in …

    Pagup 400+ aktive ynstallaasjes Teste mei 7.1.3

  • Bisteinoff SEO Robots.txt

    (4 totale wurdearrings)

    An easy-to-use plugin that generates and configures a proper robots.txt file, essential for effective search engine optimization (SEO).

    Denis Bisteinov 400+ aktive ynstallaasjes Teste mei 6.9.10

  • bodi0`s Bots visits counter

    (5 totale wurdearrings)

    Counts the visits from web spiders, crawlers and bots in your blog, with ability to get the blog rankings.

    Budiony Damyanov 100+ aktive ynstallaasjes Teste mei 6.1.15

  • Block Chat GPT via robots.txt

    (1 totale wurdearrings)

    Blocks the ChatGPT-User bot that is used by plugins in ChatGPT to crawl websites through the WordPress virtual robots.txt file

    apasionados 100+ aktive ynstallaasjes Teste mei 6.3.12

  • Block eCommerce Assets via robots.txt

    (0 totale wurdearrings)

    Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt

    apasionados 100+ aktive ynstallaasjes Teste mei 6.3.12

  • Warmer – Cache Warmer and Cache Preload Crawler

    (7 totale wurdearrings)

    Warm your WordPress cache with scheduled crawling, cache preloading, URL source control, logs, diagnostics, and WP-CLI.

    Atakan Oz 80+ aktive ynstallaasjes Teste mei 7.0.7

  • Findkit – Site Search

    (0 totale wurdearrings)

    Powerful cloud based search engine for your website. Search as you type, real-time index updates, and embeddable UI. Free for small websites.

    Findkit Team 70+ aktive ynstallaasjes Teste mei 7.1.0

  • Berq Markdown: Markdown Pages for AI & LLM Crawlers

    (0 totale wurdearrings)

    Increase your AI visibility. Berq Markdown serves every page as a clean Markdown file so AI assistants and LLM crawlers can read, cite, and recommend …

    BerqWP 30+ aktive ynstallaasjes Teste mei 7.0.7

  • Block Common Crawl via robots.txt

    (0 totale wurdearrings)

    Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file

    apasionados 30+ aktive ynstallaasjes Teste mei 6.3.12

  • Block Feed and Comments via robots.txt

    (0 totale wurdearrings)

    Blocks some Feed and Comment resources in order to avoid spam bots

    apasionados 20+ aktive ynstallaasjes Teste mei 6.3.12

  • Azayem Bots Tracker – Bot Visits Logger

    (0 totale wurdearrings)

    A custom plugin to log search engine bot visits and analyze their crawl budget directly inside WordPress (no external services required).

    botstracker 20+ aktive ynstallaasjes Teste mei 6.9.10

  • Crawl Hunt – Advanced SEO Optimization Tool

    (1 totale wurdearrings)

    A powerful website crawler and monitoring tool for WordPress.

    themeshopy 20+ aktive ynstallaasjes Teste mei 7.1.3

  • GlobeSign Content Markdown Mirror

    (0 totale wurdearrings)

    Makes your WordPress site AI-friendly: generates llms.txt and clean, structured Markdown mirrors of every page and post.

    globesign 10+ aktive ynstallaasjes Teste mei 7.0.7

  • Boring Cache Warmup Lite

    (2 totale wurdearrings)

    A lightweight, privacy-friendly WordPress cache warmup tool. No external services, no drama.

    chriskubisch 10+ aktive ynstallaasjes Teste mei 7.1.3