.Google.com restricts robots.txt support to four areas, clarifying its standpoint on in need of support regulations.Google.com only assists 4 particular robots.txt industries.Unsupported instructions in robots.txt will definitely be neglected.Think about auditing your robots.txt files taking into account this upgrade.