Read This: How To Add Social Media Share Button Below Post
Read This: 5 Reason Why Should Create A Blog
What Is Robots.Txt File ?Robots.txt is a simple text file which contains piece of some coding which is understandable by the Search Engine Crawlers which land on your blog to index your blog's data. Through this coding you can address the crawlers, whether to index any part of your blog or not.
Enable Custom Robots.txt File In BloggerThis task is not such a difficult task. You just have to navigate to a specific area of your blog's dashboard and add a piece of coding which we will provide you. So, just follow the simple below steps correctly.
- Go to Blogger Dashboard.
- Settings >> Search Preferences and click edit on Custom Robots.Txt option as shown below
After that tick mark Yes, and a box will appear where you have to insert the below coding. Just copy it here and paste it in that box.
Just hit Save and you are done.
I am pretty sure you are thinking what these commands mean which you have added. Don't worry Pals ! we have listed all commands below all commands with their explanation so that you can understand each and every piece of code ;).
Understanding Robots.Txt CommandsUser-agen: Mediapartners-Google: This command is for those blogs which are using Google Adsense. It tells the crawlers to index all the pages which are showing adsense ads.
User-agent: *: User-agent is the command used to call the robots and * is the command for all search engines like Google, Yahoo etc.
Disallow: /search?q=*: This command tells the search engine crawlers that they should not index the search pages.
Disallow: /*?updated-max=*: This command tells the crawlers, not to index the label pages.
Allow: /: This command tells the crawlers to index the homepage of your blog.
Sitemap: This command tells the crawler to index each and every new post on your blog.
So, guys that was all. You can also allow or disallow the search engine crawlers to index or don't index any pages on your blog of your desire by just following the above commands gently.