# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: User-agent: YandexNews Allow: /rss/yandex Crawl-delay: 2 User-agent: * Allow: /rss/zen Sitemap: https://ex-press.by/sitemap.xml.gz Host: https://ex-press.by