Don't Let Your Blogger Blog Disappear from Google: The Quick SEO Fix You Need

By Sammi
Google Search Console robots.txt
Google Search Console robots.txt
Photo Gemini


Have you ever checked your Google Search Console and seen the dreaded "Blocked by robots.txt" error? 😨 It's a common problem that can tank your blog's visibility, but the fix is simple, even for Blogger users.

This guide will teach you the difference between two key SEO tools—robots.txt and noindex—and show you how to set up your Blogger blog for success in just a few clicks.

The Bouncer vs. The Librarian: robots.txt vs. noindex

The biggest mistake new bloggers make is confusing these two powerful SEO tools. Here's a simple way to remember them:

  • robots.txt is the Bouncer: It's a file that tells search engine crawlers which parts of your site they are allowed to visit. Think of it as a set of rules for managing traffic. You use it to tell bots to stay away from low-value pages like your internal search results or admin sections. But here’s the crucial part: if a page is blocked by robots.txt, Google might still index the URL if it finds links to it from other sites. This leads to a generic, ugly listing in search results with no title or description.

  • noindex is the Librarian: This is a meta tag you place on a specific page that tells a crawler, "You can come in and read this page, but don't add it to your library (the search index)." This is the correct way to hide a page from Google search. A search engine must be able to crawl the page to see the noindex tag.

This is why you should never use robots.txt to try and hide a page from search results. Instead, use the noindex tag, and make sure robots.txt is not blocking that page.

The Best Blogger Settings for SEO Success

Blogger makes this easy by giving you a simple dashboard to manage both. Here are the optimal settings you should be using for your blog.

1. Custom robots.txt

On Blogger, this is where you manage the "bouncer" rules. The best practice is to block internal search pages to avoid cluttering search results with duplicate content.

How to set it:

  1. From your Blogger dashboard, go to Settings.

  2. Under Crawlers and indexing, enable Custom robots.txt.

  3. Paste this code into the text box:

    User-agent: *
Disallow: /search/
Sitemap: https://www.blowthetruth.com/sitemap.xml
Sitemap: https://www.blowthetruth.com/sitemap-pages.xml

    (Replace the sitemap URLs with your own and see the change in performance in a few weeks, this is much better if you blog post is full of words, Category and tags are important for Blogger formats.)

This file tells all crawlers (User-agent: *) to stay out of your internal search pages (Disallow: /search/), but it allows them to crawl everything else by default. It also provides your sitemaps, which helps Google find all your posts and pages.

2. Custom robot header tags

This is where you set the "librarian" rules. Blogger lets you apply these rules to different sections of your blog.

How to set them:

  1. From your Blogger dashboard, go to Settings.

  2. Under Crawlers and indexing, enable Custom robots header tags.

  3. Click on each of the three options and apply the recommended settings below.

  • Home page: Select all and noodp. This tells search engines to index your home page and follow its links.

  • Archive and search page tags: Select noindex and noodp. This is the key to preventing duplicate content issues. It tells Google not to index your label, category, and archive pages, so your blog posts are the only content showing up in search.

  • Posts and pages tags: Select all and noodp. This ensures that all of your individual blog posts and static pages (your most important content) are fully indexed and discoverable.

Final Thoughts

By taking just a few minutes to properly configure these settings, you can ensure that your blog is not only visible to search engines but is also being crawled and indexed in the most efficient way possible. It's a simple but powerful step toward better SEO for your Blogger blog.

Location: Australia

Comments

Post a Comment

Comment

Most Viewed

Centrelink Payments pittance Increase for pensioners, JobSeekers in a cost of living crisis

By Sammi
Image
Pensioner struggling to buy food in Supermarket Photo by Gemini AI Centrelink Payments Are Increasing in 2025: What You Need to Know In a move to provide financial relief amid rising living costs, the Australian Government is increasing Centrelink payments through its regular indexation process . This will provide a welcome boost to millions of Australians, including pensioners , students , and job seekers . Payment Overview A number of key Centrelink payments are set to increase in 2025. These increases are part of the government's commitment to ensuring social security payments keep pace with the cost of living. The increases are being implemented in two stages: on March 20, 2025, and again on July 1, 2025. The payment increases are not a one-off "cash boost" but rather an ongoing adjustment to fortnightly payment rates. This aims to provide sustained support for those who rely on these payments to cover essential expenses. Who is Eligible? The payment increases will ...
Read more

Brisbane Rally Sparks Outrage as Hamas Flag Appears, David Crisafulli Demands 'Full Force of Law'

By Sammi
Image
A  pro-Palestine rally  Photo Grok A pro-Palestine rally in Brisbane has ignited a firestorm of controversy after a flag associated with the designated terrorist organization Hamas was reportedly flown. The incident has drawn a sharp rebuke from Queensland's Opposition Leader, David Crisafulli , who has called for the person responsible to "bear the full force of law." Queensland Police are currently investigating the matter. The rally, which saw tens of thousands of people march through Brisbane's CBD , was part of a coordinated, nationwide day of action for the Palestinian cause. 1 Organizers hailed the event as one of the largest pro-Palestine protests in the city's history, with participants calling for a ceasefire, an end to the arms trade with Israel, and sanctions on the Israeli government. 2 The event featured speeches from various community leaders and politicians, including Greens Senator Larissa Waters . 3 However, the event's peaceful message wa...
Read more

Big changes are coming to Disability Employment Services

By Sammi
Image
Participants in Disability Employment Services Photo Google Gemini Big changes are happening in the world of disability employment in Australia. On November 1, 2025 , the Disability Employment Services (DES) program will be replaced by a new program called Inclusive Employment Australia . This new program is designed to better help people with a disability, illness, or health condition find and keep a job. The goal is to create a more inclusive and supportive system that meets the unique needs of job seekers and employers. What does this mean for you? If you are currently on the DES program, you don't need to do anything. You will be automatically moved to Inclusive Employment Australia on November 1, 2025. Your current work arrangements and payments will not be affected by this change. This is a significant step toward making employment more accessible for all Australians. Inclusive Employment Australia aims to provide a smoother, more effective pathway to employment, ensuring t...
Read more

Alarming New Laws: Age Verification for All Australian Social Media Users

By Sammi
Image
A frustrated female parent trying to log in Photo Meta Ai In an effort to protect young Australians, the government has introduced new laws that will require social media platforms to implement age verification for all users. Starting December 10, 2025, platforms will need to take "reasonable steps" to prevent under-16s from creating or keeping accounts. However, this means that  all Australian social media users , regardless of age, will likely be impacted. What Does This Mean for You? To enforce the age restriction, platforms may use various methods, including  Facial Age Estimation Technology : analyzing facial features to estimate age Matching Photos with Photo ID : verifying age by matching user-submitted photos with government-issued ID Bank or Mobile Provider Information : confirming age using bank or mobile provider data Alternative Methods : other non-government ID methods, such as behavioral signals or biometrics Concerns and Implications While the intention is to...
Read more