iSmart Communications Blog

How to Stop Google from Indexing Certain Pages on Your Website

Posted by Samantha Hew

Jan 9, 2018 2:20:00 PM

how-to-stop-google-from-indexing-certain-pages-on-your-website.png

You may ask this question: Why should I tell Google not to index my page?

 The common understanding is that when there are high quality keywords with the proper corresponding landing pages, it will improve organic search results.

As tempting as it is for marketers to index as many website pages as possible in an attempt to boost their search engine authority, this may not always prove effective. There are times when keeping certain pages on your website out of a search engine’s index. An example of this would be keeping thank-you pages – where visitors land after filling out a form on your landing page. If thank-you pages are indexed in search, it is possible for people to find or give away your gated content for free. Ultimately, it will affect you as you may lose leads.

There are 2 ways to ask Google not to index your pages in search:

Option #1: Via a Robots.txt File

The first way to remove a page from search engine results is by adding a robots.txt file to your site. The advantage of using this method is that you can get more control over what you are allowing bots to index. This means you can proactively keep unwanted content out of the search results.

Within a robots.txt file, you can specify whether you’d like to block bots from a single page, a whole directory, or even just a single image or file. There’s also an option to prevent your site from being crawled but still enabling AdSense ads to work. That being said, of the two options available to you, this one requires the most technical skill. To learn about how to create a robots.txt file, refer to this article from Google Webmaster Tools.

But if you don’t require all the control of a robots.txt file and just want to get straight to the point, you can consider using the second option.

Option #2: Via a “noindex” Meta Tag

Using a meta tag to prevent a page from appearing in search engine results is both effective and easy. It requires only a tiny bit of technical know-how, and it’s actually just a copy/paste job if you’re using the right content management system.

 Here’s how to do it.

 First, copy this tag:<META NAME=”robots” CONTENT=”noindex”>

Next, paste the full tag into a new line within the <head> section of your page’s HTML (known as the page’s header).

The following screenshots will walk you through it.

This signifies the beginning of your header:

meta-tag-stop-google-from-index-page.png

And here is the meta tag within the header:

meta-tag-stop-google-from-index-page1.png

And this signifies the end of the header: 

meta-tag-stop-google-from-index-page2.png

Voilà! This tag tells a search engine to turn around and go away.

It’s that simple! Remember, indexing more website pages may do you more harm than good. Start by identifying if you have been unknowingly giving gated content away without capturing visitor information.

 

how-to-stop-google-from-indexing-certain-pages-on-your-website.png

 

Topics: Inbound Marketing, Lead Generation

The Complete DIY Guide to Improving Conversion Rates

You may also want to download this FREE guide.

New call-to-action
Download FREE Guide
 
FOLLOW US
 
LIKE US

 

Subscribe to Our Blog via Email

 

Recent Posts