Free tools
Robots.txt Examples
Robots.txt file content for amazon.in.
Robot.txt file for: amazon.in
User-agent: * Disallow: */s?k=*&rh=n*p_*p_*p_ Disallow: /dp/product-availability/ Disallow: /dp/rate-this-item/ Disallow: /exec/obidos/account-access-login Disallow: /exec/obidos/change-style Disallow: /exec/obidos/dt/assoc/handle-buy-box Disallow: /exec/obidos/flex-sign-in Disallow: /exec/obidos/handle-buy-box Disallow: /exec/obidos/refer-a-friend-login Disallow: /exec/obidos/subst/associates/join Disallow: /exec/obidos/subst/marketplace/sell-your-collection.html Disallow: /exec/obidos/subst/marketplace/sell-your-stuff.html Disallow: /exec/obidos/subst/partners/friends/access.html Disallow: /exec/obidos/tg/cm/member/ Disallow: /gp/cart Disallow: /gp/content-form Disallow: /gp/customer-images Disallow: /gp/customer-media/upload Disallow: /gp/customer-reviews/common/du Disallow: /gp/customer-reviews/write-a-review.html Disallow: /gp/flex Disallow: /gp/gfix Disallow: /gp/history Disallow: /gp/item-dispatch Disallow: /gp/legacy-handle-buy-box.html Disallow: /gp/reader Disallow: /gp/registry/wishlist/*/reserve Disallow: /gp/richpub/listmania/createpipeline Disallow: /gp/music/clipserve Disallow: /gp/recsradio Disallow: /gp/sign-in Disallow: /gp/slides/make-money Disallow: /gp/structured-ratings/actions/get-experience.html Disallow: /gp/twitter/ Disallow: /gp/vote Disallow: /gp/voting/ Disallow: /gp/yourstore Disallow: /ap/signin Disallow: /gp/registry/wishlist/ Disallow: /wishlist/ Allow: /wishlist/universal* Allow: /wishlist/vendor-button* Allow: /wishlist/get-button* Disallow: /gp/wishlist/ Allow: /gp/wishlist/universal* Allow: /gp/wishlist/vendor-button* Allow: /gp/wishlist/ipad-install* Disallow: /registry/wishlist/ Disallow: /gp/orc/rml/ Disallow: /gp/entity-alert/external Disallow: /gp/customer-reviews/dynamic/sims-box Disallow: /review/dynamic/sims-box Disallow: /gp/redirect.html Disallow: /s?*rh=n%3A1380045031 Disallow: /gp/customer-media/actions/delete/ Disallow: /gp/customer-media/actions/edit-caption/ Disallow: /gp/dmusic/ Disallow: /gp/aag Disallow: /gp/socialmedia/giveaways Disallow: /gp/aw/so.html Disallow: /gp/pdp/profile/ Disallow: /gp/aw/help/id=201013640 Disallow: /j/ Disallow: */j/ Disallow: /junglee/ Disallow: /used/ Disallow: /gp/mobile/dp/ Disallow: /gp/aw/b/ Disallow: /gp/help/reports/infringement/jquery/handle-notice-submit.html Disallow: /gp/help/customer/handler/handle-email-submit.html Disallow: /reviews/iframe Disallow: /gp/splinter/ Disallow: /magazine/ Disallow: /gp/ask-widget/askWidget* Disallow: /ss/customer-reviews/lighthouse/ Disallow: /hz/leaderboard/top-reviewers/ Disallow: /hz/leaderboard/hall-of-fame/ Disallow: /review/top-reviewers/ Disallow: /review/top-reviewers Disallow: /review/hall-of-fame Disallow: /reviews/top-reviewers/ Disallow: /reviews/top-reviewers Disallow: /reviews/hall-of-fame Disallow: /neo/magazine/ Disallow: /hz/help/contact/*/message/$ Disallow: /-/ Disallow: /gp/aw/shoppingAids/ Allow: /-/hi/ Allow: /-/hi$ Disallow: /hz/contact-us/ajax/initiate-trusted-contact/ User-agent: EtaoSpider Disallow: / User-agent: Twitterbot Disallow: /dp/product-availability/ Disallow: /dp/rate-this-item/ Disallow: /exec/obidos/account-access-login Disallow: /exec/obidos/change-style Disallow: /exec/obidos/dt/assoc/handle-buy-box Disallow: /exec/obidos/flex-sign-in Disallow: /exec/obidos/handle-buy-box Disallow: /exec/obidos/refer-a-friend-login Disallow: /exec/obidos/subst/associates/join Disallow: /exec/obidos/subst/marketplace/sell-your-collection.html Disallow: /exec/obidos/subst/marketplace/sell-your-stuff.html Disallow: /exec/obidos/subst/partners/friends/access.html Disallow: /exec/obidos/tg/cm/member/ Disallow: /gp/cart Disallow: /gp/content-form Disallow: /gp/customer-images Disallow: /gp/customer-media/upload Disallow: /gp/customer-reviews/common/du Disallow: /gp/customer-reviews/write-a-review.html Disallow: /gp/flex Disallow: /gp/gfix Disallow: /gp/history Disallow: /gp/item-dispatch Disallow: /gp/legacy-handle-buy-box.html Disallow: /gp/reader Disallow: /gp/registry/wishlist/*/reserve Disallow: /gp/richpub/listmania/createpipeline Disallow: /gp/music/clipserve Disallow: /gp/recsradio Disallow: /gp/sign-in Disallow: /gp/slides/make-money Disallow: /gp/structured-ratings/actions/get-experience.html Disallow: /gp/twitter/ Disallow: /gp/vote Disallow: /gp/voting/ Disallow: /gp/yourstore Disallow: /ap/signin Disallow: /gp/registry/wishlist/ Disallow: /wishlist/ Allow: /wishlist/universal* Allow: /wishlist/vendor-button* Allow: /wishlist/get-button* Disallow: /gp/wishlist/ Allow: /gp/wishlist/universal* Allow: /gp/wishlist/vendor-button* Allow: /gp/wishlist/ipad-install* Disallow: /registry/wishlist/ Disallow: /gp/orc/rml/ Disallow: /gp/entity-alert/external Disallow: /gp/customer-reviews/dynamic/sims-box Disallow: /review/dynamic/sims-box Disallow: /gp/redirect.html Disallow: /s?*rh=n%3A1380045031 Disallow: /gp/customer-media/actions/delete/ Disallow: /gp/customer-media/actions/edit-caption/ Disallow: /gp/dmusic/ Disallow: /gp/aag Disallow: /gp/socialmedia/giveaways Disallow: /gp/aw/so.html Disallow: /gp/pdp/profile/ Disallow: /gp/aw/help/id=201013640 Disallow: /j/ Disallow: */j/ Disallow: /junglee/ Disallow: /used/ Disallow: /gp/mobile/dp/ Disallow: /gp/aw/b/ Disallow: /gp/help/reports/infringement/jquery/handle-notice-submit.html Disallow: /gp/help/customer/handler/handle-email-submit.html Disallow: /reviews/iframe Allow: /minitv Allow: /minitv/ct/comedy Allow: /minitv/ct/mini-movies Allow: /minitv/ct/web-series Allow: /minitv/tp/* Disallow: /minitv/st/* User-agent: AmazonAdBot Disallow: User-agent: GPTBot Disallow: / User-agent: CCBot Disallow: / User-Agent: PerplexityBot Disallow: /