# The "robots.txt" file tells spiders, or robots, which files or directories # they have to ignore. # # There can be multiple user agents or robots identified. Each can # have a different list of files or folders. # # This robots.txt is not intended to exclude any robots or any files. User-agent: * Disallow: