User-agent: * #Default Instructions Disallow: /lib/ Disallow: /*.php$ Disallow: /pkginfo/ Disallow: /report/ Disallow: /var/ Disallow: /catalog/ Disallow: /customer/ Disallow: /sendfriend/ Disallow: /review/ Disallow: /*SID= # To Disallow User Account and Checkout Pages Disallow: /checkout/ Disallow: /onestepcheckout/ Disallow: /customer/ Disallow: /customer/account/ Disallow: /customer/account/login/ # To Disallow CMS Directories: Disallow: /app/ Disallow: /bin/ Disallow: /dev/ Disallow: /lib/ Disallow: /phpserver/ #To Disallow Catalog and Search Pages Disallow: /catalogsearch/ Disallow: /catalog/product_compare/ Disallow: /catalog/category/view/ Disallow: /catalog/product/view/ Disallow: /tours? #To Disallow URL Filter Searches Disallow: /*?dir* Disallow: /*?dir=desc Disallow: /*?dir=asc Disallow: /*?limit=all Disallow: /*?mode* #To Disallow URL with any filters or search string Disallow: /*?* #To Disallow 404 Disallow: /no-route/ Disallow: /404/ Disallow /cms/noroute/index/ #Ticket JFDD-8669 User-agent: rogerbot Crawl-delay: 5 Sitemap: https://www.adventurefree.com.au/sitemap.xml