Robots.txt get Missing

  • Resolved spanizhfly

    (@spanizhfly)


    1 month, 3 weeks ago

    Hi guys,

    My robots.txt file keeps disappearing, even though I have excluded it from caching. Whenever I purge the cache, it returns, but after a few minutes, it disappears again. Please advise.

    Thank you.

Viewing 5 replies - 1 through 5 (of 5 total)
  • Plugin Support jbgupdraft

    (@jbgupdraft)

    1 month, 2 weeks ago

    Hi,

    Thanks for reaching out! Can you confirm the version of WP-Optimize being used on the site?

    Could you also let me know if your robots.txt file is being generated by a plugin or if it’s being manually created? I’d like to run some tests.

    I’m also wondering if you could temporarily test with WP-Optimize deactivated to see if the problem still occurs?

    Thank you!

    Thread Starter spanizhfly

    (@spanizhfly)

    1 month, 2 weeks ago

    Hi,

    Thank you for your email.

    I am using the latest version of WP-Optimize on my site. The robots.txt file is generated by Yoast, I believe. Additionally, I am using the Redis Object Cache plugin.

    After deactivating WP-Optimize, the robots.txt file appears as expected.

    Please let me know if you need any further information.

    Thanks

    Plugin Support jbgupdraft

    (@jbgupdraft)

    1 month, 2 weeks ago

    Hi,

    Thanks so much for testing that. I’ve set my site up in a similar method with Yoast and Redis but so far I haven’t been able to reproduce the issue. When the robots.txt stops working are you getting a 404 Not Found when trying to visit the robots.txt URL?

    Could you try enabling the WP-Debug mode and Debug log and check for any errors when the robots.txt URL stops working? We might see some hints in there as to why the URL isn’t working after a while.

    Thank you!

    Plugin Support jbgupdraft

    (@jbgupdraft)

    1 month, 1 week ago

    Hi,

    Just wanted to send a quick update. I’ve looked through the code and all WP-Optimize does is filter the robots.txt function for the dynamically generated robots.txt but there’s no function in our code that would cause the feature to stop working completely.

    Were you able to find anything in the WordPress debug log?

    Thank you!

    Plugin Support vupdraft

    (@vupdraft)

    1 month, 1 week ago

    We have not heard from you in a while so I am closing this ticket.

Viewing 5 replies - 1 through 5 (of 5 total)

You must be logged in to reply to this topic.