Common robots txt and console errors on blogger

Common Robots.txt Errors on Blogger and How to Fix Them | Dr Saddam Kenya

Common Robots.txt Errors on Blogger and How to Fix Them

By Dr Saddam Kenya | Updated June 2025

Many Blogger (Blogspot) users struggle with search engine indexing issues. One of the main culprits? A poorly configured robots.txt file. If you've seen messages like "Discovered – currently not indexed" or "Submitted URL blocked by robots.txt" in Google Search Console, you're not alone.

In this post, I’ll show you common mistakes people make with robots.txt in Blogger, what errors appear in Search Console, and how to fix them.

🚫 1. Blocking Important Pages

Many Blogger users unknowingly block useful URLs by using:

Disallow: /

This blocks everything from being indexed. It’s usually a mistake. Avoid it unless you're intentionally hiding your entire site (not recommended).

✅ Instead, allow the homepage and pages like this:

User-agent: *
Disallow: /search
Allow: /

🔍 2. “Discovered – Currently Not Indexed” in Search Console

This issue is **not directly caused by robots.txt** — but robots.txt can contribute if it blocks internal navigation pages like /search.

Fix:

  • Ensure your main posts and pages are crawlable
  • Add working sitemap.xml entries
  • Don't block pages that have real content or backlinks

🛑 3. “Submitted URL Blocked by Robots.txt”

This happens when your sitemap includes URLs that your robots.txt disallows.

Example of conflicting rule:

User-agent: *
Disallow: /search

If your sitemap includes search label links like:

https://drsaddamkenya.site/search/label/Health

Google will get confused: your sitemap says “index this,” but robots.txt says “don’t crawl it.”

✅ Fix: Either remove those URLs from your sitemap, or update your robots.txt if you want them indexed.

📉 4. Missing or Wrong Sitemap URL

A missing or wrong sitemap entry in robots.txt can reduce crawling frequency.

Bad example:

Sitemap: https://example.com/sitemap.txt

Correct example for Blogger:

Sitemap: https://www.drsaddamkenya.site/sitemap.xml
Sitemap: https://www.drsaddamkenya.site/sitemap-pages.xml

⚠️ 5. Indexing Blocked Due to “noindex” or Meta Tags

Even with a clean robots.txt, your content won’t appear in search if:

  • You set custom robots header tags to “noindex” or “nofollow” under Blogger settings.

✅ Fix:

  1. Go to Settings → Crawlers and Indexing
  2. Enable Custom robots header tags
  3. Set homepage, archive, and post pages to: all, noodp

🔎 How to Test Robots.txt in Search Console

To confirm your robots.txt is working:

  1. Go to Google Search Console
  2. Choose your property
  3. Navigate to Pages → View data about robots.txt blocking

You’ll see any pages blocked by robots.txt and recommended actions.

✅ Final Recommended Robots.txt for Blogger

User-agent: Mediapartners-Google
Disallow:

User-agent: *
Disallow: /search
Disallow: /share-widget
Allow: /

Sitemap: https://www.drsaddamkenya.site/sitemap.xml
Sitemap: https://www.drsaddamkenya.site/sitemap-pages.xml

📌 Conclusion

Robots.txt is a powerful tool. But misuse can hide your site from Google and damage your traffic. Always double-check your settings inside Blogger and in Google Search Console.

Need help? Reach out to me via the Dr Saddam Kenya blog for custom advice on robots.txt, SEO, or Blogger growth.

Popular posts from this blog

Why kipchumba murkomen - shoot to kill orders are illegal and dangerous

Image
Condemning Murkomen’s Shoot-to-Kill Orders: A Violation of Kenya’s Constitution and Human Rights Condemning Kipchumba Murkomen’s Shoot-to-Kill Orders: A Violation of Kenya’s Constitution and Human Rights By Dr Saddam Kenya | June 28, 2025 Interior Cabinet Secretary Kipchumba Murkomen’s recent directive authorizing police to “shoot to kill” anyone approaching police stations during protests has sparked widespread outrage across Kenya. These statements, made in the context of the June 25, 2025, Gen Z-led protests commemorating the 2024 anti-Finance Bill demonstrations, are not only reckless but also unconstitutional and a gross violation of human rights. As Kenya grapples with escalating tensions under President William Ruto’s administration, Murkomen’s remarks threaten to plunge the nation into further chaos, undermining the rule of law and the democratic principles enshrined in the Kenya...
Read more

How to file KRA Returns on ecitizen . How to file nil returns on Ecitizen

Image
How to File KRA Returns Using eCitizen 🧾 How to File KRA Returns Using eCitizen (Step-by-Step Guide for 2025) Filing your KRA returns in Kenya has never been easier. Thanks to the integration of KRA services on the eCitizen portal , you can now file your tax returns—including Nil Returns —fully online. Whether you’re employed or unemployed, you must file your tax returns before 30th June every year to avoid penalties. ✅ Who Should File Nil Returns? You need to file Nil Returns if: You were unemployed in the previous year You did not earn any income You are a student or stay-at-home person with a KRA PIN 📲 Step-by-Step: How to File KRA Nil Returns via eCitizen Step 1: Visit the eCitizen Portal Go to 👉 https://www.ecitizen.go.ke Step 2: Log in to Your eCitizen Account Use your ID Number and Password , or use your linked email/phone number to log in. Step 3: Select the KRA Section After logging i...
Read more

Dalili za Mimba ya mwezi mmoja na ya siku moja

Dalili za Mimba ya Siku Moja na Mwezi Mmoja Dalili za Mimba ya Siku Moja na Mwezi Mmoja Mara nyingi wanawake hupenda kuelewa dalili za mimba mapema iwezekanavyo ili waweze kuchukua hatua stahiki. Kwa hiyo, kuelewa dalili za mimba ya siku moja , dalili za mimba ya wiki moja , na hasa dalili za mimba ya mwezi mmoja ni muhimu kwa mwanamke anayetilia maanani afya yake ya uzazi. Dalili za mimba ya siku moja ni ngumu kugundua, lakini baadhi ya wanawake wanaweza kuhisi mabadiliko madogo sana yanayotokana na utungwaji wa mimba. Dalili za Mimba ya Siku Moja Mabadiliko ya joto la mwili (kuongezeka kidogo) Mkojo wa mara kwa mara kuliko kawaida Kuchoka ghafla bila sababu ya msingi Maumivu madogo ya tumbo (implantation cramps) Kutokwa na matone ya damu ya rangi ya pinki au kahawia (implantation bleeding) Hisia kali ya harufu Dalili za mimba ya siku moja haziwezi kuthibitishwa bil...
Read more