How to avoid search engines from crawling your website?

Apr 14, 2015 - by kurinchilamp / Linux Server / Post Comment

Your answer is to create a robots.txt file in the root of your web directory and to have the code setting given below in the file.

User-agent: * Disallow: /

You can read more about Robots exclusion protocol, here

TECHNOLOGY DEV STACK

Following are some of the technologies that we use to build and maintain solutions for our clients.