#GUPPYWEB3 User-agent: SemrushBot Disallow: / User-agent: DotBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: jscrawler Disallow: / User-agent: QlyzeBot Disallow: / User-agent: SerpstatBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: BacklinksExtendedBot Disallow: / User-agent: SofyaBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: SiteAuditBot Disallow: / User-agent: Screaming Frog Disallow: / User-agent: MJ12bot Disallow: / User-agent: YandexBot Disallow: / User-agent: Baiduspider Disallow: / User-agent: Sougou Disallow: / User-agent: GPTBot Crawl-delay: 30 Disallow: /de/videos/ Disallow: /en/videos/ Disallow: /es/ Disallow: /fr/ Disallow: /it/ Disallow: /tr/ Disallow: /no/ Disallow: /nl/ Disallow: /pl/ Disallow: /cs/ Disallow: /fi/ Disallow: /nl/ User-agent: Bytespider Crawl-delay: 30 Disallow: /de/videos/ Disallow: /en/videos/ Disallow: /es/ Disallow: /fr/ Disallow: /it/ Disallow: /tr/ Disallow: /no/ Disallow: /nl/ Disallow: /pl/ Disallow: /cs/ Disallow: /fi/ Disallow: /nl/ User-agent: ImagesiftBot Crawl-delay: 30 Disallow: /de/videos/ Disallow: /en/videos/ Disallow: /es/ Disallow: /fr/ Disallow: /it/ Disallow: /tr/ Disallow: /no/ Disallow: /nl/ Disallow: /pl/ Disallow: /cs/ Disallow: /fi/ Disallow: /nl/ User-agent: Amazonbot Crawl-delay: 30 Disallow: /de/videos/ Disallow: /en/videos/ Disallow: /es/ Disallow: /fr/ Disallow: /it/ Disallow: /tr/ Disallow: /no/ Disallow: /nl/ Disallow: /pl/ Disallow: /cs/ Disallow: /fi/ Disallow: /nl/ User-agent: meta-externalagent Crawl-delay: 30 Disallow: /de/videos/ Disallow: /en/videos/ Disallow: /es/ Disallow: /fr/ Disallow: /it/ Disallow: /tr/ Disallow: /no/ Disallow: /nl/ Disallow: /pl/ Disallow: /cs/ Disallow: /fi/ Disallow: /nl/ User-agent: bingbot Crawl-delay: 30 Disallow: /de/videos/ Disallow: /en/videos/ Disallow: /es/ Disallow: /fr/ Disallow: /it/ Disallow: /tr/ Disallow: /no/ Disallow: /nl/ Disallow: /pl/ Disallow: /cs/ Disallow: /fi/ Disallow: /nl/ User-agent: * Crawl-delay: 30