Quantcast
Channel: Backup and restore
Viewing all articles
Browse latest Browse all 6815

Automated Asynchronous backup - e-mail notification/summary

$
0
0
von Ken Task.  

While all instance use php-fpm, do they all have same config for php-fpm?
When you do: ps aux |grep php from command line, the first line shows what config file it's using and the number of pools created to handle traffic.

On my largest site, that has more pools than my smaller sites.

Had issues with auto backups many moons ago with 1 course whose backup was about 130G ... 25% of the total space for moodledata on a 1TB data partition.

The auto setup had no option to skip courses.  If a course activity met the criteria to make it a candidate for backup, it was included.  The course was a Digital Multimedia course ...
video, audio, photography.   Shear nature of the course would mean it would be large.

Teacher didn't really have a concept that Moodle was a shared resource.  Teacher was  practicing good course management in that a course backup was made after students submitted their assignments, but teacher never went back and removed older course backups no longer needed.   As a result, it grew and grew and grew.

Auto has no parameter for skipping a course that admin can enter manually. So when auto hit that course, it would literally kill the auto process and course backups after that course would never be attempted.

I had to create 3 separate command line bash shell scripts that looped through course ID's to get auto backups.   1st script, small courses whose backup was at or under 25M.  2nd script courses from 26M up to a couple of GIGs.  Those ran a different cron job schedule - frequency guessed according to activity.   The 3rd script ... just for one course ... the DM course and ran only on weekends ... beginning late Friday night until whenever.

So ... all that to say, you might have to do something similar!

You have your backups going to a dedicated directory ... that's good.

From CLI you can list them by order of size.   File names have course ID numbers in them by default.

Also make a DB query of mdl_files table where file name extension is .mbz and order by size of the .mbz file dumped to a text file.  The purpose in dumping to a text file is so that
you can compare the meta data from the DB to the actual contents of the dedicated directory.
Primary purpose in that ... strategize how you plan to break apart your own auto backup plan.

Nope!  Not ideal ... would be nice with the built in auto would handle it, but it's not ... or reports say they aren't or are confusing, so we do what we must do.

The scripts are run from cron job with no redirect to avoid email notifications to root user.

Invite ANYONE to jump in here and make suggestions ... am outta ideas!

'SoS', Ken


Viewing all articles
Browse latest Browse all 6815

Trending Articles