Page 1 of 2

SOLVED sort of.Think i have a bug adding 400 urls to sitemap

Posted: Wed Jul 13, 2016 5:34 pm
by phil-smiler
Firstly i posted this in general before realising that its prob a bug so I've posted it here instead so sorry if ive done the wrong thing i will add this link into the other conversation (although i had no replays).

In general http://forum.opencart.com/viewtopic.php?f=20&t=165177

Now to the bug, I'm in the process of doing the SEO for the site and was doing sitemap but it just creates pages and pages and when i look at the link it goes to the search area over and over again.


Does this qualify as a bug? not sure if anyone else is effected by this issue????

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Wed Jul 13, 2016 7:28 pm
by straightlight
phil-smiler wrote:Firstly i posted this in general before realising that its prob a bug so I've posted it here instead so sorry if ive done the wrong thing i will add this link into the other conversation (although i had no replays).

In general http://forum.opencart.com/viewtopic.php?f=20&t=165177

Now to the bug, I'm in the process of doing the SEO for the site and was doing sitemap but it just creates pages and pages and when i look at the link it goes to the search area over and over again.


Does this qualify as a bug? not sure if anyone else is effected by this issue????
It would be kind of hard to distinguish at this point since the Opencart version and the custom theme or default theme information has not been provided with your enquiry. Would it be possible to provide both information - including URL?

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Wed Jul 13, 2016 9:39 pm
by phil-smiler
Sorry yes OC 2.2 Default theme
sitemap url
http://natural-mist.com/sitemap-gsc.xml

Hope it helps

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Wed Jul 13, 2016 9:43 pm
by straightlight
There are no core files involving a catalog file with the filename: sitemap-gsc.xml. Since this issue is about an installed contribution, I would suggest to contact the developer of that extension.

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Wed Jul 13, 2016 9:49 pm
by phil-smiler
straightlight wrote:There are no core files involving a catalog file with the filename: sitemap-gsc.xml. Since this issue is about an installed contribution, I would suggest to contact the developer of that extension.

Tried that they have no idea why its doing it. its site side i believe and the program i used to make the map is software on my lappy rather than site side which is why we think its OC side of things, am i wrong if so can you explain why so i can go back to them.

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Wed Jul 13, 2016 9:51 pm
by straightlight
If no answer can be provided by the developer at this point, I would suggest to post under the commercial support topic of the forum as a custom job offering.

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Wed Jul 13, 2016 10:02 pm
by phil-smiler
straightlight wrote:If no answer can be provided by the developer at this point, I would suggest to post under the commercial support topic of the forum as a custom job offering.
Never done that before wouldn't even know how to go about it I've gone back to the software ppl and see if they agree that its the software not OC that's the problem.

Start there i guess

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Wed Jul 13, 2016 10:05 pm
by straightlight
If this XML file is filtered from a specific software that connects via API, then yes, you would need to contact the developer of that specific platform.

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Wed Jul 13, 2016 10:08 pm
by phil-smiler
actually now ive looked at more detailed it seams to be page duplicates not searches that's causing the issue so would that defiantly be the sitemap side wouldn't it??

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Wed Jul 13, 2016 10:23 pm
by straightlight
If there are duplicated content from the schema itself, it means there are possibly relationship data issues which needs to be addressed by the related developer.

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Wed Jul 13, 2016 11:39 pm
by phil-smiler
The software developer said this.

The sitemap is the result of a simple crawl of the website while respecting the robots.txt directives. So all urls found are found while crawling, thus they are created by Opencart.

There adamant that the issue is with OC not the sitemap software and i'm stuck in the middle.

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Thu Jul 14, 2016 12:17 am
by straightlight
Could you upload your XML file as an attachment? I will take a look at the output file.

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Thu Jul 14, 2016 12:27 am
by phil-smiler
here you go

I have noticed that there pages dont go so high in the actual xml
Im sure it has to do with the product search as it shows as a search then the product selected

http://natural-mist.com/POPUP1?tag=&page=3

for example

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Thu Jul 14, 2016 12:35 am
by straightlight
<!--#Generated by SOFTplus GSiteCrawler v1.23 rev. 286 by SOFTplus Entwicklungen GmbH, http://gsitecrawler.com/, http://johannesmueller.com/gs/ -->
Kind of a bit outsourcing information don't you think? ;D

This has been copied from your XML file.

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Thu Jul 14, 2016 12:45 am
by phil-smiler
yeah i no what you mean but i was trying to use a server script version but couldn't get it to work or even to get google web tools to say there was a sitemap there so the guy who was helping me in a google forum for SEO & he recommended that one and helped me get it working. Its just this issue seams to be a pain in the arse, top that off with me learning SEO from scratch doesn't probably help. But with the use of forums especially this one its been invaluable to me as my learning curve gets longer everyday...

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Thu Jul 14, 2016 12:50 am
by straightlight
phil-smiler wrote:yeah i no what you mean but i was trying to use a server script version but couldn't get it to work or even to get google web tools to say there was a sitemap there so the guy who was helping me in a google forum for SEO & he recommended that one and helped me get it working. Its just this issue seams to be a pain in the arse, top that off with me learning SEO from scratch doesn't probably help. But with the use of forums especially this one its been invaluable to me as my learning curve gets longer everyday...
In this case, I would suggest to get in touch with this developer. If unreachable, simply to post a request in the commercial support forum for a custom job.

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Thu Jul 14, 2016 1:00 am
by phil-smiler
straightlight wrote:
phil-smiler wrote:yeah i no what you mean but i was trying to use a server script version but couldn't get it to work or even to get google web tools to say there was a sitemap there so the guy who was helping me in a google forum for SEO & he recommended that one and helped me get it working. Its just this issue seams to be a pain in the arse, top that off with me learning SEO from scratch doesn't probably help. But with the use of forums especially this one its been invaluable to me as my learning curve gets longer everyday...
In this case, I would suggest to get in touch with this developer. If unreachable, simply to post a request in the commercial support forum for a custom job.

Yes he's trying to help me but like i said im sort of stuck in the middle i only started this post in case it was something someone else had experienced it before...No luck there lol. HOPEFULLY he will be able to sort as i have never had to request a private job before.

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Thu Jul 14, 2016 1:13 am
by phil-smiler
Hi he has found an issue with opencart ill add his comments below
Look at line 331 in the source code of http://natural-mist.com/2016Norvell/201 ... ess?page=2

<div class="col-sm-6 text-left"><ul class="pagination"><li><a href="http://natural-mist.com/2016Norvell/201 ... /li><li><a href="http://natural-mist.com/2016Norvell/201 ... /li><li><a href="http://natural-mist.com/2016Norvell/201 ... a></li><li class="active"><span>2</span></li></ul></div>

This sure looks like a bug in Opencart. The query parameter value {page} would not work.

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Thu Jul 14, 2016 1:48 am
by straightlight
From which route of Opencart are you noticing this error message? Do you see any recent errors regarding the page query in the error logs from the admin - > systems - > tools - > error log page?

Re: Think i have a bug which is adding 400 urls to sitemap

Posted: Thu Jul 14, 2016 3:51 am
by phil-smiler
yeah he got the error from somewhere not sure where but its adding a ?page= which is creating loads of repeat pages in the site map so its creating a couple hundred pages that shouldn't come up in the crawl but do, he's holding fast that its a bug in the opencart script that's creating all these page for no reason.


there's nothing i'm errors showing in the log to do with that.