Post by BigLen » Sat Nov 08, 2014 1:46 pm

Is listing the new name of the admin folder in the robots.txt file, defeating the purpose of changing the name in the first place? Wouldn't listing the re-named directory just make it easier to locate the admin folder?

I have re-named and password protected my admin. and have the whole site on HTTPS, as well as having htaccess files as instructed within the documentation. I will greatly appreciate any words of wisdom on the subject from the security gurus out there!

Thanks!

Big Len
https://BigLensCycles.com

Image
Quality Motorcycle ATV and UTV Parts & Accessories - Discount Prices


New member

Posts

Joined
Sun Sep 07, 2014 7:04 am

Post by uksitebuilder » Sat Nov 08, 2014 7:50 pm

robots.txt can obviously be read by humans (script kiddies etc) by typing it's location in a broswer

Therefore I advise not entering anything private or that you don't wish to be found in robots.txt

Ideally, robots.txt shold only be used to tell search engine spiders what not to follow

Search engine spiders will only follow links they have access to from the frontend - as there is not link to admin available, they will not follow or index it anyway.

it should instead be used to tell spiders not to follow page navigation links or search results or standard pages like contact us etc.

Hope this helps.

User avatar
Guru Member

Posts

Joined
Thu Jun 09, 2011 11:37 pm
Location - United Kindgom

Post by BigLen » Tue Nov 11, 2014 11:32 pm

Thank you for the information. A sample robots.txt that I was working off of, had the admin folder included, which is why I wondered if I should list the renamed file or not. Thank you for clearing that up! :)

Big Len
https://BigLensCycles.com

Image
Quality Motorcycle ATV and UTV Parts & Accessories - Discount Prices


New member

Posts

Joined
Sun Sep 07, 2014 7:04 am

Post by Dhaupin » Fri Nov 14, 2014 5:26 am

Yeah its not a good idea to put sensitive locations in Robots.txt. Instead use X-Robots-Tag header in admin controller then add meta name=robots in admin TPL. Here is a vQmod that does that:

Code: Select all

<modification>

	<id><![CDATA[This utility attempts to turn away bots that hit your store admin areas.]]></id>
	<version><![CDATA[1.0.1]]></version>
	<vqmver><![CDATA[2.4.1]]></vqmver>
	<author><![CDATA[CreadevDotOrg]]></author>

	<file name="admin/controller/common/header.php">

		<operation info="put in the header">
			<search position="after"><![CDATA[
				protected function index() {
			]]></search>
			<add><![CDATA[
	header('X-Robots-Tag: noindex, nofollow');
			]]></add>
		</operation>

	</file>
	<file name="admin/view/template/common/header.tpl">

		<operation info="put in the header">
			<search position="after"><![CDATA[
				<head>
			]]></search>
			<add><![CDATA[
<meta name="robots" content="noindex, nofollow">
			]]></add>
		</operation>

	</file>
	
</modification>
You can get more specific with those too. More info:
https://developers.google.com/webmaster ... s_meta_tag

https://creadev.org | support@creadev.org - Opencart Extensions, Integrations, & Development. Made in the USA.


User avatar
Active Member

Posts

Joined
Tue May 13, 2014 3:45 am
Location - PA
Who is online

Users browsing this forum: No registered users and 5 guests