No Index product pages and specific categories

For SEO purposes we are moving all product details to the category pages and have removed all links to the product pages. Just to be safe I want tell search engines not to index our product pages.

Do I simply add the following to the header of the product.tpl? Also, is there a way to tell search engines not to index specific categories?

adding to your header would result in blocking search engines for your entire site, as the header is shown on each page.

best is to use robots.txt in root af site, and set here wich pages should not be followed

do a search on robots.txt and you find how to set up that file

Hi Victorj,

Thanks, I certainly don't want to block the entire site.

The problem is, we have about 150,000 product pages that we don't want indexed. I cant put them all in the robots.txt

They are the only urls that end in .html Could I safely specify not to index .html pages in the robots.txt?

robots.txt is quiete flexible in what you want to block for search engines, and it also supports wildcards, just dig into that, so you can write a specific ane to suit your site

From what I understand, the following should do the trick.

Disallow: /*.html$
Disallow: /*?route=product/product

If anyone has any suggestions, feel free to post them.

I know this is an old post but i have the solution for you.

To just put some code into robots.txt will not "unindex" your product pages.

I have made a VqMod that will put <meta name="robots" content="noindex,follow"> in specified pages.

Here's a code for your problem:


You need to put some code in several files.

catalog/controller/common/header.php

Find Put after: catalog/view/theme/YOUR THEME/template/common/header.tpl

Find: Put before: system/library/document.php

Find line: Put before: Also find the line: Put before:

Now when we have done the most crucial part we need to make so your product pages won't be indexed. This is the easiest part .

catalog/controller/product/product.php

Find: Put after: This will make all your product pages have the meta tag: <meta name="robots" content="noindex,follow">. You can also use this technique on other pages as well, just find the right file and put the code into it. The controller files does controll what is visible on the tpl files.

Hope this will help someone.

/Mijo Media

This plugin is doing things easly with vqmod.You could add product pages also.

http://www.opencart.com/index.php?route ... n_id=17863

@kargaa: That extension is actually from @mijomedia (the guy that answered above)... lol!
-------------------------------------------------------------------------------------------------

Anyone know how to add SPECIFIC product pages to that extension? I need to remove product pages from Index occasionally, looking for a relatively easy way to update which pages should be removed... this looks like my best bet, if I can get it working. Thx.