How look like robots.txt file which will allow to index all pages? So i do not want to block crawlers for my website. I want to allow all searchengines to crawl my website.
How look like robots.txt file which will allow to index all pages? So i do not want to block crawlers for my website. I want to allow all searchengines to crawl my website.