Affiliates
Latest topics
» What is organic result in seo...???
Wed Apr 25, 2018 6:00 pm by komaljain0012

» What is Indexing in seo..???
Wed Apr 25, 2018 5:54 pm by komaljain0012

» What is organic result in seo ...????
Tue Apr 24, 2018 10:20 pm by sameergupta12

» What is Web Hosting..???
Tue Apr 24, 2018 10:17 pm by sameergupta12

» What is organic result in seo...???
Mon Apr 23, 2018 7:07 pm by kalmakuran

» What is a Web server..????
Mon Apr 23, 2018 7:02 pm by kalmakuran

» Most popular search engines?
Sat Apr 21, 2018 7:43 pm by angilpari1122

» which year was Google founded..?
Fri Apr 20, 2018 10:20 pm by rajshreedixit01

» common SEO mistakes..?
Sat Apr 14, 2018 9:25 pm by angilpari1122


why we use Robot.txt in SEO ?

Go down

why we use Robot.txt in SEO ?

Post by kavitajain9782 on Tue Feb 03, 2015 5:52 pm

Hi


Please tell me why we use Robot.txt in SEO ?

kavitajain9782
platinum
platinum

Posts : 116
Earned : 520
Credit : 0
Join date : 2014-06-11

View user profile

Back to top Go down

Re: why we use Robot.txt in SEO ?

Post by Radianinfosystems on Thu Mar 05, 2015 6:30 pm

The location of robots.txt is very important. It must be in the main directory because otherwise user agents (search engines) will not be able to find it – they do not search the whole site for a file named robots.txt. Instead, they look first in the main directory and if they don't find it there, they simply assume that this site does not have a robots.txt file and therefore they index everything they find along the way. So, if you don't put robots.txt in the right place, do not be surprised that search engines index your whole site.

Web designing in Erode

Radianinfosystems
gold member
gold member

Posts : 36
Earned : 84
Credit : 0
Join date : 2015-03-05

View user profile http://www.radianinfosystems.in

Back to top Go down

Back to top


 
Permissions in this forum:
You cannot reply to topics in this forum