9dfe6242b9
mounts: rename name to description
...
this makes it clear that the field is not important
2025-08-01 15:48:11 +02:00
ea419509f1
backups: add setup/teardown
...
1. add setup, teardown hooks
2. move the managed mount setup and teardown to filesystem backend
3. remove this vague storage.js
we should convert storageApi into a real object, so we don't have to
keep passing apiConfig around
2025-08-01 15:36:25 +02:00
2386124089
Upcloud S3 does not return a Contents property if no keys are found
2025-07-22 18:55:44 +02:00
5548ed1b57
s3: fix malformed endpoint URL from older versions
...
this is specifically for linode, but may apply for other storages too
2025-07-16 09:12:57 +02:00
4eed77e123
Do not crash in gcs if remote path has zero objects
2025-07-15 20:39:38 +02:00
bb257f2bf2
s3: make delete objects work again again
2025-07-15 01:11:23 +02:00
76f365f7e8
s3: make delete objects work again
2025-07-15 00:13:40 +02:00
499336e752
s3: fix debug
2025-07-14 22:24:23 +02:00
e53ec3e43c
s3: add debugging code
2025-07-14 21:59:56 +02:00
15ac81c1cd
s3: format errors with .Code
2025-07-14 15:54:31 +02:00
241053e1a8
s3: error handling has changed in v3 api
2025-06-20 16:07:21 +02:00
48bf21a537
s3: use listObjectsV2 API
...
in some minio instances, listObjectV1 is not returning all the objects
2025-05-26 14:17:13 +02:00
65f066d391
sshfs: implement rm via ssh
...
this is similar to change we did for cp -r . sshfs is often flaky with lots
of concurrent operations
2025-04-09 15:48:53 +02:00
20a30b303b
s3: fix encoding of downloaded stream
2025-02-13 19:29:07 +01:00
59721a3f1a
s3: in v3, Body is a stream
...
https://docs.aws.amazon.com/sdk-for-javascript/v3/developer-guide/migrate-s3.html
2025-02-13 15:17:48 +01:00
cb6d531300
storage: automatically abort old multipart uploads in s3
2025-02-13 11:09:15 +01:00
a138425298
storage: start migration of s3 api
2025-02-12 23:04:37 +01:00
9888aa8c08
storage: rework listDir api to be a generator (like) function
2025-02-12 19:34:57 +01:00
23d91c7b37
upgrade readdirp
2025-02-05 15:50:10 +01:00
837d5803c8
backups: add preserve attributes checkbox
2025-01-24 13:59:01 +01:00
b4d58f0609
aws: add a 20min timeout
...
in some services like b2, the multi-part copy just hangs. this allows
us to retry
2024-11-20 07:13:43 +05:30
6407d795ed
du: better error handling of du
...
du can fail when files and directories go missing. luckily, when du fails,
it still provides the best effort output
2024-11-06 14:54:52 +01:00
6c3ca9c364
shell: rework code to use shell.spawn
...
spawn gives out streams and we have more control over the stdout/stderr
buffers. otherwise, we have to provide a max buffer capture size to exec
2024-10-15 12:13:46 +02:00
a9e1d7641d
shell: make require take a tag
2024-10-14 21:08:32 +02:00
ea72cef7f9
storage: remove getProviderStatus
2024-09-09 17:36:51 +02:00
1cd577cc65
filesystem: remove debug warning
2024-09-08 15:25:49 +02:00
4a29371907
s3: sometimes message is null and only code is valid
2024-08-13 07:08:33 +02:00
041f7da59b
backups: make noop upload work again
2024-08-12 10:05:14 +02:00
247309e11b
use constant
2024-07-30 11:00:50 +02:00
b26ff08a3c
shell: copy over code and signal values from cp object
2024-07-22 21:24:27 +02:00
44678cf5f1
sshfs: if remote copy fails, fallback to sshfs based copy
...
remote copy can file if there is no cp in the remote . for example,
if it was a windows server.
2024-07-22 20:53:19 +02:00
e9b6002f63
s3: fix exists check
2024-07-14 22:04:12 +02:00
ad4e0ba9aa
tests: fix storage test
2024-07-08 22:29:45 +02:00
1dc6b40a68
tgz: extract using tar-stream directly
...
we used have a fork of tar-fs. using tar-stream directly gives us
more control
2024-07-08 13:06:56 +02:00
d122ece8e9
Attempt server side copy on sshfs via ssh exec
...
only so far tested agains hetzner storage boxes which apparently run BSD
unix tools
2024-07-02 19:51:34 +02:00
e481606d0e
lint
2024-07-02 16:09:36 +02:00
2b1b304c6e
backup/import/restore: fix crash with root path calcuation
...
rootPath was calculated before the arguments were validated
2024-04-09 13:53:48 +02:00
a6f078330f
shell: no need to promise scoping
2024-02-21 19:40:27 +01:00
cfd5c0f82b
shell: rewrite exec to use execFile
...
this also renames execFile to execArgs
2024-02-21 18:54:43 +01:00
2237d2bbb7
shell: remove usage of .spawn
2024-02-21 13:27:04 +01:00
54c7757e38
Fix crash
2024-02-20 21:53:52 +01:00
3da3ccedcb
volumes: only wait for 5 seconds for mount status
...
mountpoint -q can never exit if the nfs mount disappears, for example
2024-02-20 21:38:57 +01:00
243a254f3e
filesystem: remove hook should not rm recursively
...
this causes a bug in the backupcleaner when it tries to prune
empty directories when using the filesystem backend.
the bug is hit when a box backup is getting cleaned up but
one or more app backups are preserved.
2024-01-25 11:50:48 +01:00
934c701be2
vultr: fix copy of large objects
...
https://forum.cloudron.io/topic/10266/backups-are-failing
2023-10-26 09:51:07 +02:00
aa8c23c8b3
rework backup root
...
notes:
* backup root cannot come from backend. for dynamic mounts backend cannot know where it is mounted
* backupConfig is 3 parts - format / mount / password . there is also this rootPath (which should not be in db)
* password should be stored separately in settings at some point
* format has to be passed along everywhere because we allow restore from same backupConfig but different format. we do this by saving the format in the backups table
fixes #819
2023-08-15 22:51:45 +05:30
e6b85c2df7
remount does not need a backend hook
2023-08-15 08:55:38 +05:30
10646e9e04
Add generic disk (partition) backup provider to replace ext4 and xfs
2023-08-08 15:11:22 +02:00
3d5c21d9ca
backups: encrypted backups must have .enc extension
2023-07-24 22:25:06 +05:30
050a82039a
getBackupProviderStatus -> getProviderStatus
2023-07-15 11:00:45 +05:30
c86059e070
backups: move limits into a sub object
...
fixes #817
2023-07-13 12:17:57 +05:30
Girish Ramakrishnan