What is the difference between Crawlers and Robots ?

View previous topic View next topic Go down

What is the difference between Crawlers and Robots ?

Post by komaljain0012 on Mon May 04, 2015 3:18 pm

Hi



What is the difference between Crawlers and Robots ?

komaljain0012
platinum
platinum

Posts : 78
Earned : 342
Credit : 0
Join date : 2014-11-28
Location : India

View user profile http://www.aghoritantrikbaba.com/

Back to top Go down

Re: What is the difference between Crawlers and Robots ?

Post by bangalorewebguru on Wed May 06, 2015 5:59 pm

Crawler :
* A program that automatically follows all of the links on each web page.
*Crawler crawl you content and index it in there searches according to Inbound links both techniques helps google to judge importance of website in terms of ranking

Robots:
* An automated computer program that visit websites & perform predefined task.
*robot.txt file is that file which is included into web coding so that google not consider it in crawling or to hide page from google crawling .


bangalorewebguru
platinum
platinum

Posts : 1142
Earned : 4616
Credit : 4
Join date : 2013-10-15
Age : 24
Location : Bangalore

View user profile

Back to top Go down

View previous topic View next topic Back to top


 
Permissions in this forum:
You cannot reply to topics in this forum