# Disallow any URL containing ? (eg layered navigation) to prevent search bots from indexing irrelevant pages User-agent: * Crawl-delay: 15 Allow: /media/*? Allow: /skin/*? Disallow: /*?lamp_ Disallow: /*?product_ Disallow: /index.php/ Disallow: /checkout/ Disallow: /*?brand= Disallow: /*&brand= Disallow: /*?filter_*= Disallow: /*?nav_*= Disallow: /*?price= Disallow: /*&price= Disallow: /*?supplier_*= Disallow: /*&supplier_*= User-agent: BLEXBot Disallow: /