Affiliates
Latest topics
» What is organic result in seo...???
Yesterday at 6:00 pm by komaljain0012

» What is Indexing in seo..???
Yesterday at 5:54 pm by komaljain0012

» What is organic result in seo ...????
Tue Apr 24, 2018 10:20 pm by sameergupta12

» What is Web Hosting..???
Tue Apr 24, 2018 10:17 pm by sameergupta12

» What is organic result in seo...???
Mon Apr 23, 2018 7:07 pm by kalmakuran

» What is a Web server..????
Mon Apr 23, 2018 7:02 pm by kalmakuran

» Most popular search engines?
Sat Apr 21, 2018 7:43 pm by angilpari1122

» which year was Google founded..?
Fri Apr 20, 2018 10:20 pm by rajshreedixit01

» common SEO mistakes..?
Sat Apr 14, 2018 9:25 pm by angilpari1122


What is the use of robots.txt?

Go down

What is the use of robots.txt?

Post by artijain1900 on Fri Sep 23, 2016 8:41 pm

Hello Guys,


I would like to know that What is the use of robots.txt? tell me ..

artijain1900
platinum
platinum

Posts : 57
Earned : 285
Credit : 0
Join date : 2014-04-16

View user profile

Back to top Go down

Re: What is the use of robots.txt?

Post by bangalorewebguru on Sat Sep 24, 2016 8:27 pm

It is great when search engines frequently visit your site and index your content but often there are cases when indexing parts of your online content is not what you want. For instance, if you have two versions of a page (one for viewing in the browser and one for printing), you'd rather have the printing version excluded from crawling, otherwise you risk being imposed a duplicate content penalty.

bangalorewebguru
platinum
platinum

Posts : 1199
Earned : 4877
Credit : 4
Join date : 2013-10-15
Age : 25
Location : Bangalore

View user profile

Back to top Go down

Back to top


 
Permissions in this forum:
You cannot reply to topics in this forum