Turn off search results to Google

Hello, I want to turn off the search results to Google. As seen in the example, 20-30 pages are indexed. How can I prevent this?

https://prnt.sc/uemncz

At best, by clicking this link:
https://www.google.com/search?q=Deny+Go ... 8&oe=utf-8

you can use robots.txt with:
to prevent seacrh engines from even going there

and/or set robots tags and headers per individual pages to prevent indexing and following

in catalog/controller/common/header.php

then in catalog/view/theme/default/template/common/header.twig

letxobnav wrote: ↑

Fri Sep 11, 2020 9:56 am

you can use robots.txt with:

Code: Select all

User-agent: *
Disallow: /*search=*

to prevent seacrh engines from even going there

and/or set robots tags and headers per individual pages to prevent indexing and following

in catalog/controller/common/header.php

Code: Select all

		// index and follow headers
		$data['robots'] = false;
		if (isset($this->request->get['search']) ||
			isset($this->request->get['order']) ||
			isset($this->request->get['sort']) ||
			isset($this->request->get['limit']) ||
			isset($this->request->get['start'])
			) {
			header("X-Robots-Tag: noindex, follow", true);
			$data['robots'] = '<meta name="robots" content="noindex, follow">';
		} elseif (isset($this->request->get['route']) && 
			(
			stristr($this->request->get['route'],'error')
			)
			) {
			header("X-Robots-Tag: noindex, follow", true);
			$data['robots'] = '<meta name="robots" content="noindex, follow">';
		} elseif (isset($this->request->get['route']) && 
			(
			stristr($this->request->get['route'],'checkout/') ||
			stristr($this->request->get['route'],'account/')
			)
			) {
			header("X-Robots-Tag: noindex, nofollow", true);
			$data['robots'] = '<meta name="robots" content="noindex, nofollow">';
		} elseif (isset($this->request->get['route']) && 
			(
			stristr($this->request->get['route'],'FUTURE_PLACEHOLDER')
			)
			) {
			header("X-Robots-Tag: index, nofollow", true);
			$data['robots'] = '<meta name="robots" content="index, nofollow">';
		} else {
			header("X-Robots-Tag: index, follow", true);
			$data['robots'] = '<meta name="robots" content="index, follow">';
		}

then in catalog/view/theme/default/template/common/header.twig

Code: Select all

{% if robots %}
	{{ robots }}
{% endif %}

Hello letxobnav
This works great!!! but i don't understand what is 'FUTURE_PLACEHOLDER' in the code, can you explain it for me?
Thank you!!!

maybe what is meant by "FUTURE_PLACEHOLDER" is text that you can replace with another route that you don't want to be displayed on google

for example for all information pages you can replace it with information/

or for the contact page you can replace it with information/contact

There are basically 4 combinations:
1. index,follow (index this url and follow the urls on it)
2. index,nofollow (index this url but do not follow any urls on it)
3. noindex,follow (no not index this url but follow the urls on it)
4. noindex,nofollow (do not index this url and do not follow any urls on it)

2 is in there as a dummy to have a url/route which you want indexed except for the urls on it.