What is a robots txt file and how does it affects SEO

What is a robots txt file and how does it affect SEO- A robots.txt is a text file which is a standard used by websites to communicate with web crawlers and other web robots. What is a web crawler? A web crawler is an internet bot also known as web spider/web robots. Web crawlers are …

What is a robots txt file and how does it affects SEO Read More »