Table of Contents
Robots.txt File in SEO
How to create Robots.txt for a Website
- Replace http://yourwebsite/sitemap.xml with your website’s sitemap
- and link-exchange.php and i with the urls whom you don’t want to get index.
Note : You need to save the txt file with the name robots.txt . Just upload this robots.txt file in root domain means at the same location where Index file is present.
How to add Custom robots.txt File in Blogger
In my previous post i have discussed about how to do custom setting for Blogger Headings and Complete Guide for Onpage SEO for Blogger. This post will cover the topic – How to add Custom robots.txt. This tutorial will tell you the process to add robots.txt file in Blogger. Use the simple method as given below –
|Add Custom Robots.txt in Blogger
- Go to Blogger Dashboard
- Click on Setting
- Go to Search Preferences
- Under custom robots.txt click Yes on Enable custom robots.txt content?
- Now add the following code and then Click on Save.
How to check robots.txt file of a Website/Blog
Google Webmaster tools has recently announced a feature which will allow webmasters to see whether robots.txt file is working or not on your Website. to see this you can simply Login to Webmaster tools >> Select your Site >> Click on Robots.txt Tester From here you can check the condition of the robots.txt file.
If you want to see the robots.txt structure of any website Just type websiteurl/robots.txt like https://sanjaychoubey.com/robots.txt
This post is created by Sanjay Kumar Choubey, Circle him on Google+ to get connected from his Newer posts.