Skip to content
WordPress.org
  • News
  • Showcase
  • Hosting
    • Themes
    • Plugins
    • Patterns
    • Blocks
    • Openverse ↗︎
    • Learn WordPress
    • Documentation
    • Forums
    • Developers
    • WordPress.tv ↗︎
    • Make WordPress
    • Education
    • Photo Directory
    • Five for the Future
    • Events
    • Job Board ↗︎
    • About WordPress
    • Enterprise
    • Gutenberg ↗︎
    • Swag Store ↗︎
  • Get WordPress
Get WordPress
WordPress.org

Forums

  • Welcome to Support
  • Guidelines
  • Get involved
  • Log in
  • Welcome to Support
  • Guidelines
  • Get involved
  • Log in
Skip to content

Forums / Topic Tag: robots.txt

Topic Tag: robots.txt

1 2 3 … 23 24 25 →
    • Topic
    • Participants
    • Replies
    • Last Post
    • [WP-Optimize – Cache, Compress images, Minify & Clean database to boost page speed & performance] The problem is duplicate lines in robots.txt

      Started by: mover

    • 2
    • 8
    • 3 weeks, 3 days ago

      mover

    • [NSFW] [Yoast SEO - Advanced SEO with real-time guidance and built-in AI] robots.txt EROR

      Started by: tugrulbayirli

    • 2
    • 1
    • 2 months, 2 weeks ago

      Maybellyne

    • [SEOPress - On-site SEO & Analytics] No more sitemap link in robots.txt – ver 9.3.0.3

      Started by: crean

    • 2
    • 4
    • 4 months, 2 weeks ago

      crean

    • [PowerPress Podcasting plugin by Blubrry] Bots Crashing Podcast Site – Will Robots.txt help?

      Started by: genepensiero

    • 1
    • 0
    • 5 months, 4 weeks ago

      genepensiero

    • [Advanced Robots.txt Optimizer & Editor] Great tool

      Started by: olaosteopathy

    • 1
    • 0
    • 6 months, 3 weeks ago

      olaosteopathy

    • [Advanced Robots.txt Optimizer & Editor] Best Free Robots.txt Plugin!

      Started by: neotek9

    • 1
    • 0
    • 6 months, 3 weeks ago

      neotek9

    • [Slim SEO - A Fast & Automated SEO Plugin For WordPress] Adding lines to robots.txt file

      Started by: olistic

    • 2
    • 1
    • 8 months ago

      Anh Tran

    • [Yoast SEO - Advanced SEO with real-time guidance and built-in AI] Robots.txt not disallowing based on “Search engine visibility” setting

      Started by: pauljsilver

    • 2
    • 2
    • 8 months, 3 weeks ago

      pauljsilver

    • [The SEO Framework – Fast, Automated, Effortless.] Manually edit Robots.txt file?

      Started by: bazeboiee

    • 1
    • 0
    • 9 months ago

      bazeboiee

    • [Wordfence Security - Firewall, Malware Scan, and Login Security] Robots file Wordfence related additions (for lh=1 and logHuman=1)

      Started by: AndrogenicAlopecia

    • 2
    • 1
    • 9 months, 2 weeks ago

      wfpeter

    • [WooCommerce] Robots.txt Disallow Rules for WooCommerce Filter Parameters

      Started by: asbayrak

    • 3
    • 2
    • 9 months, 1 week ago

      LovingBro (woo-hc)

    • [All in One SEO – Powerful SEO Plugin to Boost SEO Rankings & Increase Traffic] sitemap url 404 error

      Started by: lordsummer1

    • 3
    • 2
    • 9 months, 1 week ago

      Prabhat

    • [Yoast SEO - Advanced SEO with real-time guidance and built-in AI] Lighthouse is not able to fetch robots.txt

      Started by: sanusense

    • 2
    • 1
    • 9 months, 2 weeks ago

      Maybellyne

    • [Block AI Crawlers] Thank You

      Started by: kiyasu

    • 2
    • 1
    • 10 months, 3 weeks ago

      lastsplash (a11n)

    • [Yoast SEO - Advanced SEO with real-time guidance and built-in AI] Yoast is adding Scrapy in my robots.txt without asking

      Started by: adpassion

    • 1
    • 0
    • 12 months ago

      adpassion

    • [Yoast SEO - Advanced SEO with real-time guidance and built-in AI] Yoast is adding Scrapy in my robots.txt without asking

      Started by: adpassion

    • 2
    • 1
    • 12 months ago

      Maybellyne

    • Reverted Multisite robots.txt issue

      Started by: contextquestion

    • 2
    • 2
    • 12 months ago

      contextquestion

    • [The Events Calendar] TEC docs say empty views are auto set as NOINDEX – Testing Shows Otherwise?

      Started by: Josiah

    • 3
    • 5
    • 1 year ago

      Josiah

    • [Rank Math SEO – AI SEO Tools to Dominate SEO Rankings] Rank Math SEO Disallow: /wp-includes/ is missing in the robots.txt

      Started by: canard28

    • 2
    • 3
    • 1 year ago

      Rank Math Support

    • Robots.txt Ghost File

      Started by: karanvij

    • 3
    • 1
    • 1 year, 1 month ago

      bcworkz

    • [Rank Math SEO – AI SEO Tools to Dominate SEO Rankings] URL redirects causing problems with Google

      Started by: AndyTech

    • 2
    • 1
    • 1 year, 3 months ago

      Rank Math Support

    • [The SEO Framework – Fast, Automated, Effortless.] Override robots.txt

      Started by: jp1977

    • 1
    • 0
    • 1 year, 3 months ago

      jp1977

    • [All in One SEO – Powerful SEO Plugin to Boost SEO Rankings & Increase Traffic] Unable to create robots.txt on Azure App Service

      Started by: adlpp

    • 2
    • 3
    • 1 year, 3 months ago

      adlpp

    • [XML Sitemap Generator for Google] Sitemap and robots.txt conflicts

      Started by: tombie

    • 2
    • 4
    • 1 year, 3 months ago

      tombie

    • [The SEO Framework – Fast, Automated, Effortless.] Bug in Sitemap URLs in robots.txt when using Polylang

      Started by: fidji

    • 2
    • 1
    • 1 year, 5 months ago

      Dandry

    • [Yoast SEO - Advanced SEO with real-time guidance and built-in AI] Para robots.txt no me aparece el editor de archivos

      Started by: anae15

    • 2
    • 1
    • 1 year, 5 months ago

      Mushrit Shabnam

    • [Yoast SEO - Advanced SEO with real-time guidance and built-in AI] robot.txt issue

      Started by: jayankoodal

    • 2
    • 2
    • 1 year, 5 months ago

      jayankoodal

    • [Better Robots.txt - AI-Ready Crawl Control & Bot Governance] ROBOTS.TXT Incredible product.

      Started by: igateways

    • 1
    • 0
    • 1 year, 5 months ago

      igateways

    • [Yoast SEO - Advanced SEO with real-time guidance and built-in AI] Filter Robots Text File

      Started by: Jessica

    • 2
    • 3
    • 1 year, 5 months ago

      Maybellyne

    • How To disallow PHP in Robots.txt?

      Started by: Shahvez Hassan

    • 2
    • 1
    • 1 year, 7 months ago

      threadi

  •  

1 2 3 … 23 24 25 →

Topics

Topics with no replies

Non-support topics

Resolved topics

Unresolved topics

All topics

Feeds

  • RSS Recent Posts
  • RSS Recent Topics
  • About
  • News
  • Hosting
  • Privacy
  • Showcase
  • Themes
  • Plugins
  • Patterns
  • Learn
  • Documentation
  • Developers
  • WordPress.tv ↗
  • Get Involved
  • Events
  • Donate ↗
  • Five for the Future
  • WordPress.com ↗
  • Matt ↗
  • bbPress ↗
  • BuddyPress ↗
WordPress.org
WordPress.org
  • Visit our X (formerly Twitter) account
  • Visit our Bluesky account
  • Visit our Mastodon account
  • Visit our Threads account
  • Visit our Facebook page
  • Visit our Instagram account
  • Visit our LinkedIn account
  • Visit our TikTok account
  • Visit our YouTube channel
  • Visit our Tumblr account
Code is Poetry
The WordPress® trademark is the intellectual property of the WordPress Foundation.