Chones wrote:Just in case this is useful, this is my robots.txt file:
That stops the same category page being indexed for every possible sort option. It stops all checkout pages, account pages and search pages being indexed. It stops a duplicate entry being indexed for a category page when that category page is accessed from page 2 or 3 etc., and it stops the Terms and Conditions and Privacy Policy as accessed from the Checkout stage being indexed.Code: Select all
User-agent: * Disallow: /*?sort Disallow: /*?route=checkout/ Disallow: /*?route=account/ Disallow: /*?route=product/search Disallow: /*?page=1 Disallow: /*&create=1 Allow: /
I'd suggest everyone do this. Google seems to like me and this may be one of the reasons.
I genuinely think this is a post that should be stickied or mentioned in one of the huge posts on how to get started in OpenCart...I had fixed part of this issue in different ways, but since search engines will see every sorting method as an entirely new page, you can get a lot of duplicate content pretty quickly . I wasn't sure how to entirely get rid of it, but here we are! Didn't expect to find it here.
THANK YOU.
Jared
