create a robots txt file blogger,add robots.txt to blogger Robots.txt?
create a robots txt file blogger,add robots.txt to blogger Robots.txt?
What is Robots.txt?
Robots.txt could be a computer file that contains few lines of straightforward code. it's saved on the web site or diary’s server that instruct the net crawlers to a way to index and crawl your blog within the search results. meaning you'll be able to prohibit any web content on your diary from net crawlers so it can’t get indexed in search engines like your diary labels page, your demo page or the other pages that don't seem to be as vital to induce indexed. continually keep in mind that search crawlers scan the robots.txt file before locomotion any web content.
Each diary hosted on blogger have its default robots.txt file that are some things seem like this:
User-agent: Mediapartners-Google
Disallow:
User-agent: *
Disallow: /search
Allow: /
Sitemap: http://example.blogspot.com/feeds/posts/default?orderby=UPDATED
Adding Custom Robots.Txt to Blogger
Now the most a part of this tutorial is a way to add custom robots.txt in blogger. therefore below ar steps to feature it.
--->Go to your diaryger blog.
Navigate to Settings ------->Enter
Search Preferences ------> Enter
Crawlers and categorization ------>
Custom robots.txt ------->
Edit ------->
Paste Above Code ------>Save
Now paste your robots.txt file code within the box.
Click on Save Changes button.
You are done!
What is Robots.txt?
Robots.txt could be a computer file that contains few lines of straightforward code. it's saved on the web site or diary’s server that instruct the net crawlers to a way to index and crawl your blog within the search results. meaning you'll be able to prohibit any web content on your diary from net crawlers so it can’t get indexed in search engines like your diary labels page, your demo page or the other pages that don't seem to be as vital to induce indexed. continually keep in mind that search crawlers scan the robots.txt file before locomotion any web content.
Each diary hosted on blogger have its default robots.txt file that are some things seem like this:
User-agent: Mediapartners-Google
Disallow:
User-agent: *
Disallow: /search
Allow: /
Sitemap: http://example.blogspot.com/feeds/posts/default?orderby=UPDATED
Adding Custom Robots.Txt to Blogger
Now the most a part of this tutorial is a way to add custom robots.txt in blogger. therefore below ar steps to feature it.
 |
| create a robots txt file blogger,add robots.txt to blogger Robots.txt? |
--->Go to your diaryger blog.
Navigate to Settings ------->Enter
Search Preferences ------> Enter
Crawlers and categorization ------>
Custom robots.txt ------->
Edit ------->
Paste Above Code ------>Save
Now paste your robots.txt file code within the box.
Click on Save Changes button.
You are done!
Category:
0 comments