Increase remote backup speeds

Community Support Backups
1

Hello. I have a HestiaCP server I’m needing to increase remote backup speeds on. For some reason the remote backups are super slow.

If I sftp to primary server from secondary location server, where backups need to be stored, I can manually transfer these backup archives at 940 Mbps. However, the automatic remote backups are only transferring at about 40-50Mbps.

CPU is idling during remote backups on both servers, I have 32x cores, Xeon 3.2GHz, 128GB DDR4 ram. 6x 2TB SSD drives in raid 10 config on primary (2TB file system), and raid 5 on secondary server (10TB file system). Backups include 25 accounts, all 25x backup files combined equal about 650GB I’m needing to transfer off site. Servers are humming without any load to speak of.

Internet connection at primary site is 10Gb, secondary location is 1Gb.

I’m wanting to transfer these backups at 1Gbps speeds, I can’t find the bottle neck. Please help. Thanks in advance

2

Maybe the bottleneck is the speed at which the tar.gz files are being created?

Maybe you could try creating the backup files locally, then mirroring them over to the other server?

Or look at using restic incremental backups, which, if you have the skills and patience to set it up, is vastly superior, and lightning fast.

1 Like