Robots.txt is really a file that exists on the foundation directory of each Web page and can be utilized to instruct search engines on which directories/documents of the website they could crawl and include within their index. No matter if you're employed on Web optimization on your own, delegate it https://news.rafeeg.ae