Robots.txt File in SEO Robots.txt file is a text file(Not Html) which tells search engine not to index one or more url from a website. So if you are a webmaster and having some sensitive data on your website and you don,t want to come it in the search result, you can use the robots.txt file.  Some Read more [...]