In most cases, this is caused by errors in the robots.txt file. The instruction block for the SearchmetricsBot must be above the general (user agent: *) block. Please note the blank line between two instruction blocks. robots.txt Example:
User-agent: SearchmetricsBot
Disallow: /admin/
User-agent: *
Disallow: /admin/
Allow: /