(NOT! SOLVED) Backupfile is to big, can´t make a backup!!

Post by Dunald » Thu Apr 18, 2013 10:56 pm

Hi all!
I have a store using latest opencart. I have about 10000 products in my store and today the backupfile became to large after I added 400 more products to my store. I get this error:
Fatal error: Allowed memory size of 83886080 bytes exhausted (tried to allocate 4718564 bytes) in /customers/a/2/b/kontorstema.se/httpd.www/admin/model/tool/backup.php on line 71
My host http://www.one.com says it is because the backup file is larger then the limit of 80MB. And they can not help me with this issue... However if I make a backup using phpmyadmin the file is only 6MB!?


I tried to make a backup WITHOUT the products = works fine
I tried to make a backup with ONLY the products = error

So I can´t make a backup in the admin....
Is there a way to fix this? I mean can I backup 50% of my products at a time or something like that? Probably not but I have to ask. Any ideas how to solve this?

Post by butte » Fri Apr 19, 2013 3:24 am

Post by rph » Fri Apr 19, 2013 3:37 am

-Ryan

Post by butte » Fri Apr 19, 2013 5:24 am

Post by rph » Fri Apr 19, 2013 8:55 am

INSERT INTO `product_filter` (`product_id`, `filter_id`) VALUES ('936', '4');
INSERT INTO `product_filter` (`product_id`, `filter_id`) VALUES ('937', '2');
INSERT INTO `product_filter` (`product_id`, `filter_id`) VALUES ('938', '4');

INSERT INTO `product_filter` (`product_id`, `filter_id`) VALUES
('936', '4'),
('937', '2'),
('938', '4'),

INSERT INTO `product` (`product_id`, `model`, `sku`, `upc`, `ean`, `jan`, `isbn`, `mpn`, `location`, `quantity`, `stock_status_id`, `image`, `manufacturer_id`, `shipping`, `price`, `points`, `tax_class_id`, `date_available`, `weight`, `weight_class_id`, `length`, `width`, `height`, `length_class_id`, `subtract`, `minimum`, `sort_order`, `status`, `date_added`, `date_modified`, `viewed`, `cost`) VALUES ( ...

-Ryan

Post by butte » Fri Apr 19, 2013 10:19 am

Post by rph » Fri Apr 19, 2013 11:41 am

-Ryan

Post by butte » Fri Apr 19, 2013 12:33 pm

Post by grgr » Fri Apr 19, 2013 2:50 pm

-

VIEW ALL EXTENSIONS * EXTENSION SUPPORT * WEBSITE * CUSTOM REQUESTS

Post by butte » Sat Apr 20, 2013 1:00 pm

Post by rph » Sat Apr 20, 2013 1:12 pm

-Ryan

Post by butte » Sun Apr 21, 2013 12:31 pm

Post by Dunald » Tue Apr 23, 2013 7:57 pm

butte wrote:All three of us are on the same proverbial page, each has its uses according to needs. In addition to phpMyAdmin, unless it runs on the local machine, Oracle's Workbench or similar will often be comparably useful.

So, what have we done with Dunald?

Hi all!
Thanks for the answers. I understand that the phpmyadmin is a "better" backup. However as I am importing many products to my store it sometimes goes wrong and it was easy just to restore from my latest backup in the OC.
I do take backup files in the phpmyadmin but only for safety reasons as if my entire site should fail.
It is also much more easy to make a backup in OC, I dont have to go to another site (phpmyadmin) and nothing can go wrong when I use OC but everything can go wrong if I do something really wrong in phpmyadmin.

But do I understand the answers correct?
Is there no solution to my problem with the backup in OC? And no I dont´t think my descriptions are to big and yes I need all my products in my store.

Post by butte » Wed Apr 24, 2013 11:37 pm

Post by rph » Thu Apr 25, 2013 9:11 am

-Ryan

Post by rph » Thu Apr 25, 2013 9:15 am

-Ryan

Post by butte » Thu Apr 25, 2013 10:37 am

Post by Dunald » Fri Apr 26, 2013 3:21 pm

OK, thanks for your advice.
Well I can make a backup without the products, the problem is that when I sometimes import products I put products in the wrong category and the backup file helped me with this. However now I understand that I can use my import tool and rewrite the import again and solve this problem.
The problem with my backup file may not be that big, as I can use myPhpAdmin for this, may only take a minute longer.
Well I also have some other problems with my host http://www.one.com as my site doesn´t perform well/fast with this host. So perhaps I need to change to another host. - Thanks again for your support

Post by butte » Sat Apr 27, 2013 12:10 am

Post by rph » Sun Apr 28, 2013 1:06 am

I've attached a vqmod script for improved backup files. Table structure/creation still needs to be properly dealt with but it will dramatically reduce the size of backup files.

Edit: I've now added a database structure backup so if the backup table doesn't exist it will be created. This should protect against catastrophic DB failures while not effecting the normal truncate function.

On the default store data, backup file size went from 684 KB to 311 KB (55% smaller).

improved_backup.png (19.68 KiB) Viewed 6430 times

-Ryan