#robots.txt for webserver User-agent: * Allow: *?act Allow: *?query Disallow: *? Disallow: /?c Disallow: /cgi-bin Disallow: /?print Disallow: /print Disallow: /comments Disallow: */; Disallow: */%3B Disallow: */& Disallow: */%26 Disallow: /blogs/to_publish/ Host: https://kulturologia.ru User-agent: Yandex Crawl-delay: 2 Disallow: */? Disallow: /cgi-bin Disallow: */?print Disallow: /blogs/search/?query Disallow: /comments Disallow: */; Disallow: */%3B Disallow: */& Disallow: */%26 Disallow: */> Disallow: */%3E Disallow: */< Disallow: */%3C Disallow: /blogs/to_publish/ User-agent: CFNetwork Crawl-delay: 10 User-agent: SeekportBot Disallow: /