Affiliates
Latest topics
» how many national festival in India..?
Yesterday at 4:12 pm by ranisharma1531

» What is the benefits of google Webmaster..?
Yesterday at 2:19 pm by sonamsharma

» 7 major problems of the world...?
Tue Oct 17, 2017 4:10 pm by nishajain1421

» Happy Diwali Everyone...
Tue Oct 17, 2017 2:40 pm by ShrutiDesai

» Slogans on Saving the earth..?
Mon Oct 16, 2017 8:45 pm by anshitajain1212

» Importance of trees ?
Sat Oct 14, 2017 7:39 pm by angilpari1122

» Most popular search engine in India...?
Fri Oct 13, 2017 2:31 pm by ShrutiDesai

» love marriage or arranged marriage...?
Thu Oct 12, 2017 3:59 pm by ranisharma1531

» which party is good for India
Tue Oct 10, 2017 10:01 pm by kavitajain9782


What is the use of robert.txt file ?

View previous topic View next topic Go down

What is the use of robert.txt file ?

Post by Joyadelfin on Mon Jul 25, 2016 7:52 pm

Hello friends,


I would like to know that What is the use of robert.txt file ? tell me guys..

Joyadelfin
platinum
platinum

Posts : 52
Earned : 257
Credit : 0
Join date : 2015-06-11

View user profile

Back to top Go down

Re: What is the use of robert.txt file ?

Post by Advaitaahomesale on Wed Jul 27, 2016 7:52 pm

The robots exclusion protocol (REP) or robots.txt is a text file which webmasters create to instruct robots (especially search engine robots) how to crawl and index pages on our website.

Advaitaahomesale
platinum
platinum

Posts : 59
Earned : 121
Credit : 0
Join date : 2016-03-23
Age : 24

View user profile http://www.advaitaahomes.com/

Back to top Go down

Re: What is the use of robert.txt file ?

Post by Sankara Vignesh on Thu Aug 18, 2016 8:42 pm

The file which is instructing to the search engine bot not to crawl this page within our website.

Sankara Vignesh
platinum
platinum

Posts : 117
Earned : 348
Credit : 0
Join date : 2015-07-28

View user profile

Back to top Go down

Re: What is the use of robert.txt file ?

Post by jackfernandos on Tue Sep 06, 2016 6:46 pm

robots.txt is a plain text file webmaster create to instruct search engine robots how to crawl and indexed of their website.

jackfernandos
platinum
platinum

Posts : 82
Earned : 164
Credit : 0
Join date : 2016-08-11

View user profile

Back to top Go down

Re: What is the use of robert.txt file ?

Post by bangalorewebguru on Mon Oct 10, 2016 7:35 pm

Robots.txt is a text (not html) file you put on your site to tell search robots which pages you would like them not to visit. Robots.txt is by no means mandatory for search engines but generally search engines obey what they are asked not to do. It is important to clarify that robots.txt is not a way from preventing search engines from crawling your site

bangalorewebguru
platinum
platinum

Posts : 1115
Earned : 4481
Credit : 4
Join date : 2013-10-15
Age : 29
Location : Bangalore

View user profile http://www.bangalorewebguru.co.in/

Back to top Go down

Re: What is the use of robert.txt file ?

Post by zinavo on Mon Oct 24, 2016 2:23 pm

Robert.txt file when search engines frequently visit your site and index your content but often there are cases when indexing parts of your online content is not what you want. For instance, if you have two versions of a page (one for viewing in the browser and one for printing), you'd rather have the printing version excluded from crawling, otherwise you risk being imposed a duplicate content penalty.

zinavo
platinum
platinum

Posts : 105
Earned : 318
Credit : 3
Join date : 2016-10-11

View user profile

Back to top Go down

Re: What is the use of robert.txt file ?

Post by Sponsored content


Sponsored content


Back to top Go down

View previous topic View next topic Back to top

- Similar topics

 
Permissions in this forum:
You cannot reply to topics in this forum