09/05/2016 by Nitesh

Disallow Search Engine Crawlers to Index Websites

When working for any client, we all showcase the work on a development server that is available on a public domain and easily accessible to client. With Search Engines crawling the internet at a huge speed, it’s likely that Search Engine Crawler aka Robots like Google, Bing, yahoo will index the development webpages that we…

Continue Reading »