User-agent: * Crawl-delay: 15 Disallow: /cgi-bin/ Disallow: /wp-admin/ Disallow: /wp-includes/ Allow: /wp-content/uploads/ Disallow: /trackback/ Disallow: /index.php Disallow: /xmlrpc.com Disallow: /wp-login.php Disallow: /wp-content/plugins/ Disallow: /comments/feed/ User-agent: Yandex Disallow: / User-agent: Baiduspider Disallow: / User-agent: AhrefsBot Disallow: / Disallow: /*blackhole Disallow: /?blackhole