Google Will Discontinue Support for Robots.txt from September 2019

NO SUPPORT FOR ROBOTS.TXT BY GOOGLE Google has recently announced to step back from supporting undocumented and unsupported rules in robots.txt as per their official statement. This announcement will come into practice officially from September 1, 2019. Google’s official tweet has said- “Today we’re saying goodbye to undocumented and unsupported rules in robots.txt If you Read more about Google Will Discontinue Support for Robots.txt from September 2019[…]