hey, i just set up rclone for my hestiacp but when I try to create a backup larger than 5 GB, the upload fails. Is there any solution for this?
my config
Options:
- type: s3
- provider: Other
- access_key_id: xxxx
- secret_access_key: xxxx
- endpoint: xxxx
- acl: authenticated-read
- upload_cutoff: 4Gi
below 5gb backup files upload without any issue
backup log
– SUMMARY –
2023-12-02 08:53:44 Upload With Rclone to remote1: myweb58.2023-12-02_08-53-44.tar
2023/12/02 08:53:58 INFO : S3 bucket remote1: Bucket “remote1” created with ACL “authenticated-read”
2023/12/02 08:54:11 ERROR : myweb58.2023-12-02_08-53-44.tar: Failed to copy: multi-thread copy: failed to write chunk: failed to upload chunk 4 with 5242880 bytes: NoSuchUpload:
status code: 404, request id: tx0000011dc54c8e913b112-00656aa35b-16a22338-default, host id:
2023/12/02 08:54:11 ERROR : Attempt 1/3 failed with 1 errors and: multi-thread copy: failed to write chunk: failed to upload chunk 4 with 5242880 bytes: NoSuchUpload:
status code: 404, request id: tx0000011dc54c8e913b112-00656aa35b-16a22338-default, host id:
2023/12/02 08:54:26 ERROR : myweb58.2023-12-02_08-53-44.tar: Failed to copy: multi-thread copy: failed to write chunk: failed to upload chunk 3 with 5242880 bytes: NoSuchUpload:
status code: 404, request id: tx00000fdbc3ea32c7b9c2a-00656aa36a-166fa084-default, host id:
2023/12/02 08:54:26 ERROR : Attempt 2/3 failed with 1 errors and: multi-thread copy: failed to write chunk: failed to upload chunk 3 with 5242880 bytes: NoSuchUpload:
status code: 404, request id: tx00000fdbc3ea32c7b9c2a-00656aa36a-166fa084-default, host id:
2023/12/02 08:54:40 ERROR : myweb58.2023-12-02_08-53-44.tar: Failed to copy: multi-thread copy: failed to write chunk: failed to upload chunk 1 with 5242880 bytes: NoSuchUpload:
status code: 404, request id: tx000003b719a9dd0f64bf1-00656aa378-166a3c5d-default, host id:
2023/12/02 08:54:40 ERROR : Attempt 3/3 failed with 1 errors and: multi-thread copy: failed to write chunk: failed to upload chunk 1 with 5242880 bytes: NoSuchUpload:
status code: 404, request id: tx000003b719a9dd0f64bf1-00656aa378-166a3c5d-default, host id:
2023/12/02 08:54:40 INFO :
Transferred: 16.344 MiB / 16.344 MiB, 100%, 234.146 KiB/s, ETA 0s
Errors: 1 (retrying may help)
Elapsed time: 42.7s
2023/12/02 08:54:40 Failed to copy: multi-thread copy: failed to write chunk: failed to upload chunk 1 with 5242880 bytes: NoSuchUpload:
status code: 404, request id: tx000003b719a9dd0f64bf1-00656aa378-166a3c5d-default, host id:
Error: Unable to upload backup
– SYSTEM –
2023-12-02 08:55:02 myweb58.conf
2023-12-02 08:55:02 stats.log
2023-12-02 08:55:02 history.log
2023-12-02 08:55:02 pam
please anyone know how to fix this ?
– SUMMARY –
2024-01-13 12:04:41 Upload With Rclone to linode: admin.2024-01-13_12-04-41.tar
2024/01/13 12:04:59 INFO : S3 bucket test: Bucket “test” created with ACL “authenticated-read”
2024/01/13 12:05:17 ERROR : admin.2024-01-13_12-04-41.tar: Failed to copy: multi-thread copy: failed to write chunk: failed to upload chunk 2 with 104857600 bytes: NoSuchUpload:
status code: 404, request id: tx0000023a1b7b30dc05a96-0065a27c7d-1e514201-default, host id:
2024/01/13 12:05:17 ERROR : Attempt 1/3 failed with 1 errors and: multi-thread copy: failed to write chunk: failed to upload chunk 2 with 104857600 bytes: NoSuchUpload:
status code: 404, request id: tx0000023a1b7b30dc05a96-0065a27c7d-1e514201-default, host id:
2024/01/13 12:05:36 ERROR : admin.2024-01-13_12-04-41.tar: Failed to copy: multi-thread copy: failed to write chunk: failed to upload chunk 2 with 104857600 bytes: NoSuchUpload:
status code: 404, request id: tx00000434bbfc5b708cb36-0065a27c90-1e5271d3-default, host id:
2024/01/13 12:05:36 ERROR : Attempt 2/3 failed with 1 errors and: multi-thread copy: failed to write chunk: failed to upload chunk 2 with 104857600 bytes: NoSuchUpload:
status code: 404, request id: tx00000434bbfc5b708cb36-0065a27c90-1e5271d3-default, host id:
2024/01/13 12:05:55 ERROR : admin.2024-01-13_12-04-41.tar: Failed to copy: multi-thread copy: failed to write chunk: failed to upload chunk 1 with 104857600 bytes: NoSuchUpload:
status code: 404, request id: tx00000b54b63e87beda1db-0065a27ca3-1e538165-default, host id:
2024/01/13 12:05:55 ERROR : Attempt 3/3 failed with 1 errors and: multi-thread copy: failed to write chunk: failed to upload chunk 1 with 104857600 bytes: NoSuchUpload:
status code: 404, request id: tx00000b54b63e87beda1db-0065a27ca3-1e538165-default, host id:
2024/01/13 12:05:55 INFO :
Transferred: 129.031 MiB / 129.031 MiB, 100%, 839.993 KiB/s, ETA 0s
Errors: 1 (retrying may help)
Elapsed time: 56.6s
2024/01/13 12:05:55 Failed to copy: multi-thread copy: failed to write chunk: failed to upload chunk 1 with 104857600 bytes: NoSuchUpload:
status code: 404, request id: tx00000b54b63e87beda1db-0065a27ca3-1e538165-default, host id:
Error: Unable to upload backup
my config :
[linode]
type = s3
provider = Other
access_key_id = xxxxx
secret_access_key = xxxxxxxxx
endpoint = xxxxxxxx
acl = authenticated-read
chunk_size = 2Gi
can’t upload backup files above 5gb
You probally want to ask your question here:
I have really no idea what is going wrong…