why we use Robot.txt in SEO ?

View previous topic View next topic Go down

why we use Robot.txt in SEO ?

Post by kavitajain9782 on Tue Feb 03, 2015 5:52 pm

Hi


Please tell me why we use Robot.txt in SEO ?

_________________
Vashikaran for love | Vashikaran baba ji | Powerful vashikaran mantra

kavitajain9782
platinum
platinum

Posts : 91
Earned : 395
Credit : 0
Join date : 2014-06-11

View user profile

Back to top Go down

Re: why we use Robot.txt in SEO ?

Post by Radianinfosystems on Thu Mar 05, 2015 6:30 pm

The location of robots.txt is very important. It must be in the main directory because otherwise user agents (search engines) will not be able to find it – they do not search the whole site for a file named robots.txt. Instead, they look first in the main directory and if they don't find it there, they simply assume that this site does not have a robots.txt file and therefore they index everything they find along the way. So, if you don't put robots.txt in the right place, do not be surprised that search engines index your whole site.

Web designing in Erode

_________________
Web Design in Erode | Auto trading in India | Get City info | SEO in India

Radianinfosystems
gold member
gold member

Posts : 36
Earned : 84
Credit : 0
Join date : 2015-03-05

View user profile http://www.radianinfosystems.in

Back to top Go down

View previous topic View next topic Back to top


 
Permissions in this forum:
You cannot reply to topics in this forum