I have one problem
I have domain name for example www.testing.com
and new.testing.com
so i do not want to new.testing.com display in any search engine. I have added one robots.txt to the new.testing.com. And both site has same parent directory
--httpdoc
----testing.com
----new.testing.com
So i want to know that can i handle both site using one robots.txt of testing.com is it possible???
Please suggest me solution if possible.
The best thing you could do is to add separate robots.txt files. Put one in each directory. You should have
After adding robots.txt file to new.testing.com, you should add following code to keep search engines away.
User-agent: *
Disallow: /