Don’t know about Robots.txt?
Well let me explain you “Its a file which makes the best use of search engine robots and also imporve SEO.”
But don’t know how to create it?
Here is a simple form which will help you to create a robots.txt which will help your website to get crawl in a better way and with your commands. Robots.txt serves the purpose to adjust the crawling engines robots of various websites like yahoo, msn, Google. A website with a robots.txt also help in improving the SEO of the website and also it helps the website to grow faster and with a high speed. Thus you must upload the “robots.txt” file to your root directory.
Generate robots.txt online for your WordPress Blog –
After creating your robots.txt file kindly save it and upload it on your root folder of your website and also do not forget to ‘s’ after robots.txt . I generally find bloggers, newbies creating this mistake which doesn’t let your website crawl properly as per your needs. So kindly check it and save it and then run it to see whether working or not.
Robots.txt checking tool:-
To check its working functionality, visit http://www.yoursitename.com/robots.txt It will show you a text document on your browser with the implemented codes.