Page 2 of 2

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Thu Jul 14, 2016 4:00 am
by straightlight
It might be possible that the platform may not be able to parse the {page} tag located in the system/library/pagination.php file since the class requires to eliminate these instances from the current selected element in the URL.

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Thu Jul 14, 2016 4:04 am
by phil-smiler
from the source code

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Thu Jul 14, 2016 4:09 am
by phil-smiler
What if anything can we do about it?

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Thu Jul 14, 2016 4:36 am
by phil-smiler
I've just redone the crawl to show you what i mean

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Thu Jul 14, 2016 3:18 pm
by phil-smiler
this is what the page says number of products are only 5 pages Showing in that catag

-9764 to -9750 of 18 (2 Pages)

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Thu Jul 14, 2016 6:11 pm
by straightlight
The platform you're using might be trying to capture the site information from the front-end rather than using an API with a protocol which is why pages appears as such.

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Thu Jul 14, 2016 7:28 pm
by phil-smiler
ok what can we do to stop it?

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Thu Jul 14, 2016 7:33 pm
by straightlight
Since you're using a custom offline platform to connect to your site, you'd have to request a custom quote from the commercial support section of the forum since this issue is not a direct issue with Opencart. The {page} variable has been added to avoid public feeding on the browser.

Another methodology I would suggest, but a bit costy one, would be to create an adapter from your platform in order to connect with the Opencart API extension: http://www.opencart.com/index.php?route ... rest%20api

Another suggestion: https://opencart-api.com/product/openca ... -pro-v2-0/ for Restful API with JSON method.

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Thu Jul 14, 2016 7:57 pm
by phil-smiler
ouch, i will go back to the software ppl and see what they say first as i think your saying the problem is with them.

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Sat Jul 16, 2016 1:21 am
by phil-smiler
Had to do this to try to sort the problem...

User-agent: *
Disallow: /admin/
Disallow: /shop/
Disallow: /account
Disallow: /login
Disallow: /password
Disallow: /address
Disallow: /order
Disallow: /download
Disallow: /cart
Disallow: /checkout
Disallow: /search
Disallow: /*?page={page}
Disallow: /2016NorvellSunlessRetail/PremiumHandheldSunless?page={page}
Disallow: /2016Norvell?page={page}
Disallow: /PremiumHandheldSunless?page={page}
Disallow: /2016Norvell/2016NorvellSunlessRetail/PremiumHandheldSunless?page={page}
Disallow: /2016NorvellSunlessRetail?page={page}
Disallow: /2016Norvell/2016NorvellSunlessRetail?page={page}
Disallow: /2016NorvellSunlessRetail/PremiumHandheldSunless?page={page}
Disallow: /wishlist
Disallow: /register
Disallow: /compare
Disallow: /forgotten
Disallow: /edit
Disallow: /\'
Disallow: //font
Disallow: /font

Sitemap:http://natural-mist.com/sitemap-gsc.xml

Just in case anyone else has the same problem.

Re: SOLVED sort of.Think i have a bug adding 400 urls to sit

Posted: Sat Jul 16, 2016 2:02 am
by straightlight
This topic is not about a bug with Opencart but rather about tweaking for a specific platform, in this case. This topic should be moved to either the extensions support or the concepts section of the forum.