.Google.com limits robots.txt assistance to four industries, clarifying its standpoint on in need of support regulations.Google merely supports four certain robots.txt areas.In need of support regulations in robots.txt will definitely be overlooked.Look at auditing your robots.txt reports because of this upgrade.