|
发表于 2008 年 2 月 17 日 14:47:59
|
显示全部楼层
robots.txt
http://www.sears.ca/robots.txt
#Disallow access to cart, sign-in, errors, wishist, customer review, E mail a friend, Comparisons, Save for Later
# and your-account pages for search-engine crawlers
User-agent: *
Disallow: /gp/cart
Disallow: /gp/flex
Disallow: /gp/sign-in
Disallow: /gp/css
Disallow: /gp/errors
Disallow: /gp/item-dispatch
Disallow: /gp/registry
Disallow: /gp/product/handle-buy-box
Disallow: /gp/emailafriend
Disallow: /gp/customer-reviews
Disallow: /gp/yourstore
Disallow: /gp/comparison
Disallow: /gp/subscription
Disallow: /gp/compare-products
Disallow: /gp/vote
Disallow: /gp/save-for-later |
|