.Google limits robots.txt support to 4 fields, clarifying its own viewpoint on in need of support directives.Google.com simply assists four details robots.txt areas.Unsupported directives in robots.txt will be neglected.Consider auditing your robots.txt documents taking into account this upgrade.