Therefore if you consider it, you're losing all over 9,900 potential customers Because You're not to the 1st placement. This is actually the main reason why we want Web optimization. A robots.txt file is a simple text file that instructs World-wide-web crawlers about which areas of a website are open https://www.seoprd.com