# Block specific user agents from accessing the site User-agent: WebCopier Disallow: / User-agent: WebCopier v4.0 Disallow: / User-agent: Teleport Disallow: / User-agent: WebZip/4.0 Disallow: / User-agent: WebStripper Disallow: / User-agent: larbin Disallow: / User-agent: HTTrack Disallow: / User-agent: wget Disallow: / User-agent: curl Disallow: / User-agent: MJ12bot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: Baiduspider Disallow: / User-agent: YandexBot Disallow: / User-agent: DotBot Disallow: / User-agent: spbot Disallow: / User-agent: BLEXBot Disallow: / # Block all user agents from accessing specific directories User-agent: * Disallow: /eservis/ Disallow: /pub/ Disallow: /test/ # Specify the locations of the sitemaps Sitemap: https://www.frgal.cz/mapa-stranek.php Sitemap: https://www.frgal.cz/en/site-map.php