generator

Suppose You want to Disallow two directories at your website i.e. some-directory and another-directory located at: http://www.yourwebsite.com/some-directory http://www.yourwebsite.com/another-directory to be crawled by search engines and Allow all other directories and page of whole website to be indexed and crawled then here is how to do it in a right way.