Operating system: CentOS 7
OS version: 7.9.2004
There seems to be an issue with the schedule backups. I have a daily backup setup and for whatever reason, there are 3 instances running and those backups are completed but not completing on the Virtualmin side. Which is causing the schedule backups to fail because there is a limit of 3 backups allowed to run. Any possible solution to this?
Are you running a command after the backup? Sounds like something is getting stuck. You can check the logs in Virtualmin → Backup and Restore → Backup Logs. I might also be tempted to remove the spaces from the destination file path.
Almost 90% of the time it works without a problem then (it appears to be) on the Friday nightly backup that is when it gets stuck. I do not have any post commands.
Do your logs give you any clues?
So, I am looking at the logs and there is a backup still “running” since Jun 14th.
There doesn’t appear to be something stopping it.
As you can see the Jun 15th one is completed. Its the exact same schedule too.
Here are some more details:
So this is really a little annoying because there appears to be nothing stating why its stuck. I need to have confidence that the backups are happening without monitoring them constantly.
@Joe @Ilia Any ideas as to what is happening with the backups?
So this is really a little annoying because there appears to be nothing stating why its stuck. I need to have confidence that the backups are happening without monitoring them constantly.
Is there anything on the logs printed in regards to FTP connection? @Jamie what happens if outgoing FTP connection cannot reach the destination host, for instance, if the destination host is blocking it?
@wacowonk Can you connect to remove FTP server, with credentials stored in scheduled backup config, using console?
The connection is successful. I see the backups on the FTP server even the ones that keep running.
Is the size of a backup file changing on the target? Is there enough space on the target?
If you don’t run the backup up in the background as part of scheduled backups, and on contrary run it manually, what output do you get on the UI? Does everything look good?
The FTP server that its backing up to has a 2 TB drive with about 1 TB free. If I run the backup manually, its fine. Most days it runs without an issue. Just a few days for whatever reason it gets weird. On those days, the backup is actually done just not ending the scheduled backup task.
The FTP connection should time out if the remote host is blocked
Ok so it happened overnight but this time the outcome is different. It only backup one server something happened (which i can’t find where). I did stop the backup for the 17th, however no log was produced. However, it is still “running”
The 14th backup, that is completed and on the backup server but still running. So I manually ended it so I can see the log. As you can see even Virtualmin said it was completed. Here is that output:
Creating backup for virtual server admin.downtownwacotx.com ..
Copying virtual server configuration ..
.. done
Copying records in DNS domain ..
.. done
Copying Apache virtual host configuration ..
.. done
Copying Apache log files ..
.. done
Copying SSL Apache virtual host configuration and certificate ..
.. done
Creating TAR file of home directory ..
.. done
.. completed in 3 seconds
Creating backup for virtual server apikit.wacowonk.com ..
Copying virtual server configuration ..
.. done
Copying records in DNS domain ..
.. done
Copying Apache virtual host configuration ..
.. done
Copying Apache log files ..
.. done
Copying SSL Apache virtual host configuration and certificate ..
.. done
Creating TAR file of home directory ..
.. done
.. completed in 2 seconds
Creating backup for virtual server cleanandsafe.downtownwacotx.com ..
Copying virtual server configuration ..
.. done
Copying records in DNS domain ..
.. done
Copying Apache virtual host configuration ..
.. done
Copying Apache log files ..
.. done
Copying SSL Apache virtual host configuration and certificate ..
.. done
Creating TAR file of home directory ..
.. done
.. completed in 1 seconds
Creating backup for virtual server downtownwacotx.com ..
Copying virtual server configuration ..
.. done
Backing up Cron jobs ..
.. done
Copying records in DNS domain ..
.. done
Saving mail aliases ..
.. done
Saving mail and FTP users ..
.. done
Backing up mail and FTP user Cron jobs ..
.. none to backup
Copying Apache virtual host configuration ..
.. done
Copying Apache log files ..
.. done
Copying Webalizer configuration files ..
.. done
Copying SSL Apache virtual host configuration and certificate ..
.. done
Copying Logrotate configuration ..
.. done
Dumping MariaDB database ccw_omnia ..
.. done
Backing up Webmin ACL files ..
.. done
Backing up AWstats configuration file ..
.. done
Creating TAR file of home directory ..
.. done
.. completed in 2 minutes, 13 seconds
Creating backup for virtual server files.wacowonk.com ..
Copying virtual server configuration ..
.. done
Copying records in DNS domain ..
.. done
Copying Apache virtual host configuration ..
.. done
Copying Apache log files ..
.. done
Copying SSL Apache virtual host configuration and certificate ..
.. done
Creating TAR file of home directory ..
.. done
.. completed in 1 seconds
Creating backup for virtual server forms.downtownwacotx.com ..
Copying virtual server configuration ..
.. done
Copying records in DNS domain ..
.. done
Copying Apache virtual host configuration ..
.. done
Copying Apache log files ..
.. done
Copying SSL Apache virtual host configuration and certificate ..
.. done
Creating TAR file of home directory ..
.. done
.. completed in 0 seconds
Creating backup for virtual server merchants.downtownwacotx.com ..
Copying virtual server configuration ..
.. done
Copying records in DNS domain ..
.. done
Copying Apache virtual host configuration ..
.. done
Copying Apache log files ..
.. done
Copying SSL Apache virtual host configuration and certificate ..
.. done
Creating TAR file of home directory ..
.. done
.. completed in 1 seconds
Creating backup for virtual server mysql.wacowonk.com ..
Copying virtual server configuration ..
.. done
Copying records in DNS domain ..
.. done
Copying Apache virtual host configuration ..
.. done
Copying Apache log files ..
.. done
Copying SSL Apache virtual host configuration and certificate ..
.. done
Creating TAR file of home directory ..
.. done
.. completed in 1 seconds
Creating backup for virtual server portal.downtownwacotx.com ..
Copying virtual server configuration ..
.. done
Copying records in DNS domain ..
.. done
Copying Apache virtual host configuration ..
.. done
Copying Apache log files ..
.. done
Copying SSL Apache virtual host configuration and certificate ..
.. done
Creating TAR file of home directory ..
.. done
.. completed in 0 seconds
Creating backup for virtual server wacopride.org ..
Copying virtual server configuration ..
.. done
Backing up Cron jobs ..
.. done
Copying records in DNS domain ..
.. done
Saving mail aliases ..
.. done
Saving mail and FTP users ..
.. done
Backing up mail and FTP user Cron jobs ..
.. none to backup
Copying Apache virtual host configuration ..
.. done
Copying Apache log files ..
.. done
Copying Webalizer configuration files ..
.. done
Copying SSL Apache virtual host configuration and certificate ..
.. done
Copying Logrotate configuration ..
.. done
Dumping MariaDB database wpn_wp ..
.. done
Copying ProFTPD virtual server configuration ..
.. done
Backing up Webmin ACL files ..
.. done
Backing up AWstats configuration file ..
.. done
Creating TAR file of home directory ..
.. done
.. completed in 26 seconds
Creating backup for virtual server wacowonk.com ..
Copying virtual server configuration ..
.. done
Backing up Cron jobs ..
.. done
Copying records in DNS domain ..
.. done
Saving mail aliases ..
.. done
Saving mail and FTP users ..
.. done
Backing up mail and FTP user Cron jobs ..
.. none to backup
Copying Apache virtual host configuration ..
.. done
Copying Apache log files ..
.. done
Copying Webalizer configuration files ..
.. done
Copying SSL Apache virtual host configuration and certificate ..
.. done
Copying Logrotate configuration ..
.. done
Dumping MariaDB database wacowonk_hesk ..
.. done
Dumping MariaDB database wacowonk_service ..
.. done
Dumping MariaDB database wacowonk_wp952 ..
.. done
Dumping MariaDB database wacowonk_roundcube ..
.. done
Copying Procmail and SpamAssassin configuration files ..
.. done
Backing up Webmin ACL files ..
.. done
Backing up AWstats configuration file ..
.. done
Creating TAR file of home directory ..
.. done
.. completed in 11 seconds
Creating backup for virtual server wm.wacowonk.com ..
Copying virtual server configuration ..
.. done
Copying records in DNS domain ..
.. done
Copying Apache virtual host configuration ..
.. done
Copying Apache log files ..
.. done
Copying SSL Apache virtual host configuration and certificate ..
.. done
Creating TAR file of home directory ..
.. done
.. completed in 0 seconds
Saving Virtualmin configuration ..
.. done
Saving templates and plans ..
.. done
Saving email templates ..
.. done
Saving custom fields, links, categories and shells ..
.. done
Saving custom script installers ..
.. done
Saving scheduled backups ..
.. done
Saving FTP directory restrictions ..
.. done
Saving DKIM settings ..
.. done
Saving greylisting settings ..
.. done
Save mail rate limiting configuration ..
.. done
Saving mail server configuration ..
.. done
.. done
Uploading archive to FTP server hs.wacowonk.com ..
.. done
12 servers backed up successfully, 0 had errors.
8 Virtualmin configuration settings backed up successfully.
Deleting backups from /full/Monthly/%a -- %Y-%m-%d on FTP server hs.wacowonk.com older than 31 days ..
.. found 1 backups, but none were old enough
So here is something interesting… I ran the backup manually and it starts as normal but when it gets to the first virtual server it keeps uploading on our Backup FTP server WHILE the logs shows that its past the first virtual server. Not sure if this is an issue with how the FTP backups work with Virtualmin OR if this is an issue with the FTP Server.
So I ended up changing backup methods to AWS S3 and so far no issues. However, I did notice how the backup process works differs. when FTP, it uploads each individual compressed file at a time where as S3 does it all at once. Would it be potentially more efficient to have the backup files upload at one time like S3 does?
There’s an option on the backup page to upload one by one, or all at once.
This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.