How to create robot txt and how to add robot txt to your blogger

How to Create and Add Robots.txt to Your Blogger Website | Dr Saddam Kenya

How to Create and Add Robots.txt to Your Blogger Website

By Dr Saddam Kenya | Last Updated: June 2025

If you own a blog on Blogger (Blogspot), controlling how search engines crawl and index your content is very important. A robots.txt file helps you do that. It’s a small file that tells search engine bots which parts of your site they are allowed or not allowed to access.

📌 What is Robots.txt?

The robots.txt file is a text-based file placed at the root of your site that guides search engine bots like Googlebot on what to crawl and what to ignore.

For example:

User-agent: *
Disallow: /search
Allow: /
Sitemap: https://www.example.com/sitemap.xml

🔧 Step 1: Create a Robots.txt File for Blogger

You can copy and customize the following template for your Blogger blog:

User-agent: Mediapartners-Google
Disallow:

User-agent: *
Disallow: /search
Disallow: /share-widget
Allow: /

Sitemap: https://yourblogname.blogspot.com/sitemap.xml
Sitemap: https://yourblogname.blogspot.com/sitemap-pages.xml

👉 Replace yourblogname with your actual blog name or custom domain (e.g., drsaddamkenya.site).

⚙️ Step 2: Add Robots.txt to Your Blogger Blog

Now that you have created your custom robots.txt, follow these steps to add it to Blogger:

  1. Go to Blogger Dashboard.
  2. Click on Settings from the left menu.
  3. Scroll down to the section labeled Crawlers and indexing.
  4. Enable Enable custom robots.txt.
  5. Click on Custom robots.txt and paste the code you created earlier.
  6. Click Save.

Done! Your blog now has a robots.txt file.

🔍 How to Check if Robots.txt is Working

To verify, go to your browser and type the following URL:

https://yourdomain.com/robots.txt

If it loads correctly, your robots.txt file is now live.

🤔 Why Use Robots.txt on Blogger?

  • Prevent Google from indexing duplicate content like search pages.
  • Improve SEO by focusing crawl budget on important pages.
  • Ensure that only clean and relevant URLs appear in Google results.

✅ Pro Tip

Always test your robots.txt file with the Google Search Console Robots.txt Tester to make sure you’re not blocking important parts of your site.

💡 Conclusion

Adding a proper robots.txt file to your Blogger website is simple but powerful. It helps shape how search engines view and crawl your content. By following the steps above, your blog will be more optimized for search engines and offer better control over your indexing strategy.

If you found this guide useful, share it and bookmark Dr Saddam Kenya Blog for more Blogger tips and SEO tricks.

Popular posts from this blog

Why kipchumba murkomen - shoot to kill orders are illegal and dangerous

Image
Condemning Murkomen’s Shoot-to-Kill Orders: A Violation of Kenya’s Constitution and Human Rights Condemning Kipchumba Murkomen’s Shoot-to-Kill Orders: A Violation of Kenya’s Constitution and Human Rights By Dr Saddam Kenya | June 28, 2025 Interior Cabinet Secretary Kipchumba Murkomen’s recent directive authorizing police to “shoot to kill” anyone approaching police stations during protests has sparked widespread outrage across Kenya. These statements, made in the context of the June 25, 2025, Gen Z-led protests commemorating the 2024 anti-Finance Bill demonstrations, are not only reckless but also unconstitutional and a gross violation of human rights. As Kenya grapples with escalating tensions under President William Ruto’s administration, Murkomen’s remarks threaten to plunge the nation into further chaos, undermining the rule of law and the democratic principles enshrined in the Kenya...
Read more

How to create robot txt and how to add robot txt to your blogger

How to Create and Add Robots.txt to Your Blogger Website | Dr Saddam Kenya How to Create and Add Robots.txt to Your Blogger Website By Dr Saddam Kenya | June 2025 When managing a blog on Blogger, it's important to control what content gets indexed by search engines like Google. This is where a robots.txt file comes in handy. It tells search engine crawlers which pages or folders they should or shouldn’t access. In this guide, I’ll show you how to create your own robots.txt file and add it to your Blogger blog easily. 📘 What is a Robots.txt File? The robots.txt file is a simple text file that provides instructions to web crawlers. It can help prevent search engines from crawling unnecessary parts of your site such as /search or internal labels, while still allowing important pages to be indexed. Here’s a simple example: User-agent: * Disallow: /search Allow: / ✏️ Step 1: Create a Custom Robots.txt File for Blogger ...
Read more

Dalili za Mimba ya mwezi mmoja na ya siku moja

Dalili za Mimba ya Siku Moja na Mwezi Mmoja Dalili za Mimba ya Siku Moja na Mwezi Mmoja Mara nyingi wanawake hupenda kuelewa dalili za mimba mapema iwezekanavyo ili waweze kuchukua hatua stahiki. Kwa hiyo, kuelewa dalili za mimba ya siku moja , dalili za mimba ya wiki moja , na hasa dalili za mimba ya mwezi mmoja ni muhimu kwa mwanamke anayetilia maanani afya yake ya uzazi. Dalili za mimba ya siku moja ni ngumu kugundua, lakini baadhi ya wanawake wanaweza kuhisi mabadiliko madogo sana yanayotokana na utungwaji wa mimba. Dalili za Mimba ya Siku Moja Mabadiliko ya joto la mwili (kuongezeka kidogo) Mkojo wa mara kwa mara kuliko kawaida Kuchoka ghafla bila sababu ya msingi Maumivu madogo ya tumbo (implantation cramps) Kutokwa na matone ya damu ya rangi ya pinki au kahawia (implantation bleeding) Hisia kali ya harufu Dalili za mimba ya siku moja haziwezi kuthibitishwa bil...
Read more