1. TechSpot is dedicated to computer enthusiasts and power users. Ask a question and give support. Join the community here.
    TechSpot is dedicated to computer enthusiasts and power users.
    Ask a question and give support.
    Join the community here, it only takes a minute.
    Dismiss Notice

Google dropping supporting for noindex, nofollow and crawl-delay directives

By jobeard
Jul 3, 2019
Post New Reply
  1. OUCH!

    In short, if you mention crawl-delay, nofollow, and noindex in your robots.txt file - Google on September 1, 2019 will stop honoring it. They currently do honor some of those implementations, even though they are "unsupported and unpublished rules" but will stop doing so on September 1, 2019.

    Google may send out notifications via Google Search Console if you are using these unsupported commands in your robots.txt files.

    see
    https://www.seroundtable.com/google-noindex-in-robots-txt-dead-27824.html
     

Add your comment to this article

You need to be a member to leave a comment. Join thousands of tech enthusiasts and participate.
TechSpot Account You may also...