# Robots.txt for www.starwars.com User-Agent: * Disallow: /7046/ Disallow: /products/ Disallow: /_xd/ Disallow: /news/page/ Disallow: /wp-content/plugins/ Disallow: /search Disallow: /watch/hls/stream/ Disallow: /watch/hls/master/ Disallow: /watch/captions/ Disallow: /embed Disallow: /embed/ Disallow: */embed Disallow: /app Disallow: /app/ Disallow: */app Disallow: /*? Disallow: /21783347309/ User-agent: dotbot Disallow: / User-agent: rogerbot Disallow: / User-agent: GPTBot Disallow: / User-agent: Google-Extended Disallow: / Sitemap: https://www.starwars.com/sitemap.xml