Post by kingkong001 » Mon Apr 08, 2019 12:31 pm

Hi Everyone,

I'm working on the site, which used to be crawled with no issues. All major search engines had it indexed and screaming frog could crawl the site with no issues.

However, all of a sudden, screaming frog is returning a 403 error, and the site is being de-indexed on all major search engines.

I've checked the obvious:
- robots.txt
- search console messages/issues
- htaccess file

Nothing seems to have changed, everything seems to be how it was when the site was crawling properly.

Does anyone have any ideas on what i should try/investigate next?

Thanks in advance!



Mon Apr 08, 2019 12:23 pm

Post by IP_CAM » Tue Apr 09, 2019 5:55 am

Well, you're trying to please a lot of Machines, but not so much Visitors. In addition
to present (default value) categories, adding ~3.6MByte Download Pages. But you
have everything built-in, what only results in negative numbers, but not one of them
will actually help to raise Customer Interest for your Site. You're doing the Job for
others, instead of getting the Job done, as it might have been, but some time ago.

It's like sitting the wrong way on a horse's Saddle. But modern search engines do no
longer honor such doings, one should be aware about such.
Good Luck!



australia.jpg (60.13 KiB) Viewed 349 times

I don't use Forum Mail, to reach me, contact:
Server Q & A Basic Information on Code + Settings
Demoversion OpenCart LIGHT v.
1'400+ FREE OC Extensions - from OC v.1.5.x up,
on the world's largest OC-related Github Site:

User avatar
Legendary Member


Tue Mar 04, 2014 1:37 am
Location - Switzerland
Who is online

Users browsing this forum: No registered users and 3 guests