User-agent: * Disallow: /shop/ Disallow: shop.php Disallow: category.php Disallow: product.php