Affiliates
Latest topics
» Is wordpress theme good for SEO?
Yesterday at 10:18 pm by bangalorewebguru

» What is the External Links in seo..?
Yesterday at 10:11 pm by bangalorewebguru

» What is the benefits of Video Submission..?
Yesterday at 10:03 pm by bangalorewebguru

» cold blooded animals...?
Fri Aug 18, 2017 7:40 pm by kavitajain9782

» What is a Business directory?
Fri Aug 18, 2017 4:40 pm by Designpluz

» What is a Business directory?
Fri Aug 18, 2017 4:27 pm by Designpluz

» What is Forum Posting?
Fri Aug 18, 2017 4:27 pm by Designpluz

» What are Classified ads?
Fri Aug 18, 2017 4:27 pm by Designpluz

» What is Press Release submission?
Fri Aug 18, 2017 4:27 pm by Designpluz


What is robots.txt?

View previous topic View next topic Go down

Re: What is robots.txt?

Post by bangalorewebguru on Thu Aug 10, 2017 9:09 pm

This text file which sits in the root of your website's folder communicates a certain number of guidelines to search engine crawlers. For instance, if your robots.txt file has this line in it; User-agent: * Disallow: / it's basically telling every crawler on the web to take a hike and not index ANY of your site's content.

_________________
Web Designing Company Bangalore | Website Designing Company Bangalore | Website Design Company Bangalore | Web Design Companies Bangalore

bangalorewebguru
platinum
platinum

Posts : 1046
Earned : 4133
Credit : 4
Join date : 2013-10-15
Age : 29
Location : Bangalore

View user profile http://www.bangalorewebguru.co.in/

Back to top Go down

View previous topic View next topic Back to top


 
Permissions in this forum:
You cannot reply to topics in this forum