Affiliates
Latest topics
» What are backlinks
Fri Feb 23, 2018 9:33 pm by komaljain0012

» What are LSI keywords
Fri Feb 23, 2018 9:29 pm by komaljain0012

» What is long tail keyword
Thu Feb 22, 2018 6:58 pm by kalmakuran

» What is Crawling
Thu Feb 22, 2018 6:46 pm by kalmakuran

» What is Page Title
Thu Feb 22, 2018 6:20 pm by nidhijain1221

» 10 Most Famous Historical Monuments of India...?
Thu Feb 22, 2018 2:28 pm by angilpari1122

» Is YouTube important for marketing?
Wed Feb 21, 2018 5:08 pm by Sankara Vignesh

» How important are keywords in content marketing?
Wed Feb 21, 2018 5:03 pm by Sankara Vignesh

» What are paid results
Wed Feb 21, 2018 4:57 pm by Sankara Vignesh


What is the use of robert.txt file ?

Go down

What is the use of robert.txt file ?

Post by Joyadelfin on Mon Jul 25, 2016 7:52 pm

Hello friends,


I would like to know that What is the use of robert.txt file ? tell me guys..

Joyadelfin
platinum
platinum

Posts : 52
Earned : 257
Credit : 0
Join date : 2015-06-11

View user profile

Back to top Go down

Re: What is the use of robert.txt file ?

Post by Advaitaahomesale on Wed Jul 27, 2016 7:52 pm

The robots exclusion protocol (REP) or robots.txt is a text file which webmasters create to instruct robots (especially search engine robots) how to crawl and index pages on our website.

Advaitaahomesale
platinum
platinum

Posts : 59
Earned : 121
Credit : 0
Join date : 2016-03-23
Age : 25

View user profile http://www.advaitaahomes.com/

Back to top Go down

Re: What is the use of robert.txt file ?

Post by Sankara Vignesh on Thu Aug 18, 2016 8:42 pm

The file which is instructing to the search engine bot not to crawl this page within our website.

Sankara Vignesh
platinum
platinum

Posts : 142
Earned : 428
Credit : 0
Join date : 2015-07-28

View user profile

Back to top Go down

Re: What is the use of robert.txt file ?

Post by jackfernandos on Tue Sep 06, 2016 6:46 pm

robots.txt is a plain text file webmaster create to instruct search engine robots how to crawl and indexed of their website.

jackfernandos
platinum
platinum

Posts : 82
Earned : 164
Credit : 0
Join date : 2016-08-11

View user profile

Back to top Go down

Re: What is the use of robert.txt file ?

Post by bangalorewebguru on Mon Oct 10, 2016 7:35 pm

Robots.txt is a text (not html) file you put on your site to tell search robots which pages you would like them not to visit. Robots.txt is by no means mandatory for search engines but generally search engines obey what they are asked not to do. It is important to clarify that robots.txt is not a way from preventing search engines from crawling your site

bangalorewebguru
platinum
platinum

Posts : 1185
Earned : 4828
Credit : 4
Join date : 2013-10-15
Age : 24
Location : Bangalore

View user profile

Back to top Go down

Re: What is the use of robert.txt file ?

Post by zinavo on Mon Oct 24, 2016 2:23 pm

Robert.txt file when search engines frequently visit your site and index your content but often there are cases when indexing parts of your online content is not what you want. For instance, if you have two versions of a page (one for viewing in the browser and one for printing), you'd rather have the printing version excluded from crawling, otherwise you risk being imposed a duplicate content penalty.

zinavo
platinum
platinum

Posts : 105
Earned : 318
Credit : 3
Join date : 2016-10-11

View user profile

Back to top Go down

Re: What is the use of robert.txt file ?

Post by Sponsored content


Sponsored content


Back to top Go down

Back to top

- Similar topics

 
Permissions in this forum:
You cannot reply to topics in this forum