User-Agent: * Disallow: /private/ Disallow: /administrator/ Disallow: /api/ Disallow: /bin/ Disallow: /cache/ Disallow: /cli/ Disallow: /components/ Disallow: /includes/ Disallow: /installation/ Disallow: /language/ Disallow: /layouts/ Disallow: /libraries/ Disallow: /logs/ Disallow: /modules/ Disallow: /plugins/ Disallow: /tmp/ Disallow: /job/autocomplete Disallow: /countryArray.php Disallow: /*¤cies Disallow: /*&page Disallow: /*&lavel Disallow: /*&dayslise Disallow: /*?* User-Agent: Scrapy User-Agent: ia_archiver-web.archive.org User-Agent: Teleport User-Agent: Teleport User-Agent: EmailCollector User-Agent: WebBandit User-Agent: WebStripper User-Agent: Web Downloader User-Agent: WebCopier User-Agent: Offline Explorer Pro User-Agent: HTTrack Website Copier User-Agent: Offline Commander User-Agent: Leech User-Agent: WebSnake User-Agent: BlackWidow User-Agent: HTTP Weazel User-Agent: Extreme Picture Finder Disallow: / Sitemap: https://www.gradding.com/sitemap.xml