# The user agent named Googlebot is not allowed to crawl any URL that starts with https://asna.com/internal/ User-agent: Googlebot Disallow: /internal # Other agents can crawl the entire site User-agent: * Allow: / Sitemap: https://asna.com/sitemap.xml