Robots.txt SEO | How to Write robots.txt for Google? | How to learn robots.txt | how to use robots.txt  

As we all seos’ know about robots.txt file in main root directory. Robots.txt is seen by search engine robots (crawlers) for information which files or folders to be indexed or not. Robots.txt is very important file if we are working on ecommerce based site or portal. If our site, portal or ecommerce shopping cart has more than 1000 pages, robots.txt plays a role of captain for all pages.