Google Updates Robots.txt Policy: Unsupported Fields Are Ignored
Google limits robots.txt support to four fields, clarifying its stance on unsupported directives.
The post Google Updates Robots.txt Policy: Unsupported Fields Are Ignored appeared first on Search Engine Journal.