# robots.txt for https://www.das.cz/ sitemap: https://www.das.cz/sitemaps-3-sitemap.xml sitemap: https://www.das.cz/osobni/sitemaps-1-sitemap.xml sitemap: https://www.das.cz/firmy-a-instituce/sitemaps-2-sitemap.xml # live - don't allow web crawlers to index cpresources/ or vendor/ # User-agent: * # Disallow: / User-agent: * Disallow: /cpresources/ Disallow: /vendor/ Disallow: /.env Disallow: /cache/ # Disallow ChatGPT bot, as there's no benefit to allowing it to index your site User-agent: GPTBot Disallow: / # Disallow Google Bard and Vertex AI bots, as there's no benefit to allowing it to index your site User-agent: Google-Extended Disallow: / # Disallow Perplexity bot, as there's no benefit to allowing it to index your site User-agent: PerplexityBot Disallow: /