Affiliates
Latest topics
» What is Crawling
Yesterday at 9:48 pm by nidhijain1221

» What is a Domain
Yesterday at 9:43 pm by nidhijain1221

» Best Airline In India....?
Yesterday at 2:42 pm by angilpari1122

» Heading tags
Mon Dec 11, 2017 9:46 pm by sameergupta12

» Organic result
Mon Dec 11, 2017 9:39 pm by sameergupta12

» Do-Follow link
Sat Dec 09, 2017 10:06 pm by komaljain0012

» important to the human body?
Sat Dec 09, 2017 4:18 pm by nishajain1421

» difference between .in and .com...?
Thu Dec 07, 2017 3:38 pm by vishakhajain

» percentage of water covered ,on earth..?
Thu Dec 07, 2017 2:43 pm by ShrutiDesai


What is the use of robert.txt file ?

View previous topic View next topic Go down

What is the use of robert.txt file ?

Post by Joyadelfin on Mon Jul 25, 2016 7:52 pm

Hello friends,


I would like to know that What is the use of robert.txt file ? tell me guys..

Joyadelfin
platinum
platinum

Posts : 52
Earned : 257
Credit : 0
Join date : 2015-06-11

View user profile

Back to top Go down

Re: What is the use of robert.txt file ?

Post by Advaitaahomesale on Wed Jul 27, 2016 7:52 pm

The robots exclusion protocol (REP) or robots.txt is a text file which webmasters create to instruct robots (especially search engine robots) how to crawl and index pages on our website.

Advaitaahomesale
platinum
platinum

Posts : 59
Earned : 121
Credit : 0
Join date : 2016-03-23
Age : 24

View user profile http://www.advaitaahomes.com/

Back to top Go down

Re: What is the use of robert.txt file ?

Post by Sankara Vignesh on Thu Aug 18, 2016 8:42 pm

The file which is instructing to the search engine bot not to crawl this page within our website.

Sankara Vignesh
platinum
platinum

Posts : 122
Earned : 358
Credit : 0
Join date : 2015-07-28

View user profile

Back to top Go down

Re: What is the use of robert.txt file ?

Post by jackfernandos on Tue Sep 06, 2016 6:46 pm

robots.txt is a plain text file webmaster create to instruct search engine robots how to crawl and indexed of their website.

jackfernandos
platinum
platinum

Posts : 82
Earned : 164
Credit : 0
Join date : 2016-08-11

View user profile

Back to top Go down

Re: What is the use of robert.txt file ?

Post by bangalorewebguru on Mon Oct 10, 2016 7:35 pm

Robots.txt is a text (not html) file you put on your site to tell search robots which pages you would like them not to visit. Robots.txt is by no means mandatory for search engines but generally search engines obey what they are asked not to do. It is important to clarify that robots.txt is not a way from preventing search engines from crawling your site

bangalorewebguru
platinum
platinum

Posts : 1115
Earned : 4481
Credit : 4
Join date : 2013-10-15
Age : 30
Location : Bangalore

View user profile http://www.bangalorewebguru.co.in/

Back to top Go down

Re: What is the use of robert.txt file ?

Post by zinavo on Mon Oct 24, 2016 2:23 pm

Robert.txt file when search engines frequently visit your site and index your content but often there are cases when indexing parts of your online content is not what you want. For instance, if you have two versions of a page (one for viewing in the browser and one for printing), you'd rather have the printing version excluded from crawling, otherwise you risk being imposed a duplicate content penalty.

zinavo
platinum
platinum

Posts : 105
Earned : 318
Credit : 3
Join date : 2016-10-11

View user profile

Back to top Go down

Re: What is the use of robert.txt file ?

Post by Sponsored content


Sponsored content


Back to top Go down

View previous topic View next topic Back to top

- Similar topics

 
Permissions in this forum:
You cannot reply to topics in this forum