# https://www.robotstxt.org/robotstxt.html User-agent: * Disallow: Disallow: /*.json Crawl-delay: 60 Sitemap: https://example.com/sitemap.xml