Girish Ramakrishnan
5d836b3f7c
sshfs: only chown when auth as root user
2021-07-10 08:36:30 -07:00
Girish Ramakrishnan
17a70fdefd
sshfs: hide private key
2021-07-09 16:07:45 -07:00
Johannes Zellner
41273640da
SSHFS also does not need to chown here
2021-06-30 17:10:34 +02:00
Girish Ramakrishnan
0b0d552f58
Fix usage of execSync
...
important thing is to not use encoding: 'utf8' because in that case
it will return a string instead of a Buffer object. '' is false but
Buffer() is not.
2021-06-24 12:59:47 -07:00
Girish Ramakrishnan
5129465e59
aws: const correctness
2021-06-23 14:30:00 -07:00
Girish Ramakrishnan
02263e8921
add back mountpoint check
2021-06-22 15:52:50 -07:00
Girish Ramakrishnan
5040b4f3f9
backups: chown and preserve attribs on ext4 and sshfs
2021-06-22 09:27:11 -07:00
Girish Ramakrishnan
ceddabd691
Fix tryAddMount usage
2021-06-21 23:13:37 -07:00
Girish Ramakrishnan
f2e0ee12a2
vultr: object storage
2021-06-16 22:36:01 -07:00
Girish Ramakrishnan
a34bdb9ddf
backups: fix mounting logic of backup settings and cloudron restore
2021-05-27 13:52:05 -07:00
Girish Ramakrishnan
14bb928d41
backups: fix various mount issues
2021-05-17 22:58:40 -07:00
Girish Ramakrishnan
124954d490
migrate old providers as generic mountpoint provider
2021-05-17 13:23:32 -07:00
Girish Ramakrishnan
f3d9b81942
check for autofs mounts
...
autofs mounts are "mounts on demand". this way, instead of mounting
lots of things on startup, you can mount it on first access.
2021-03-19 09:59:09 -07:00
Girish Ramakrishnan
93510654a5
nfs: also check for nfs4 mount type
...
it seems in some version of ubuntu you mount with "-t nfs4".
this still doesn't handle autofs yet.
https://help.ubuntu.com/community/NFSv4Howto
2021-03-19 09:54:09 -07:00
Girish Ramakrishnan
1e96606110
error.code is a number which causes crash at times in BoxError
2021-03-12 10:10:49 -08:00
Girish Ramakrishnan
91a229305d
missing backups: check if the s3 end point is valid
...
s3 api never return NotFound or ENOENT - https://docs.aws.amazon.com/AmazonS3/latest/API/ErrorResponses.html
Sadly, DO/OVH etc just return NotFound instead of NoSuchKey. And we cannot
distinguish easily if we are talking to some s3 server or some random server.
This is applicable for things like say minio where maybe there is something
apache now just giving out 404 / NotFound.
2021-03-05 01:24:16 -08:00
Girish Ramakrishnan
4275114d28
s3: remove retry options for exists check
2021-03-04 23:40:23 -08:00
Girish Ramakrishnan
c4dffa393b
backups: remove entries from database that don't exist in storage
...
fixes #772
2021-02-19 11:34:22 -08:00
Girish Ramakrishnan
382ae7424d
async 3: the whilst and doWhilst test funcs are async
2021-02-04 16:39:47 -08:00
Girish Ramakrishnan
282040ed1b
gcs: use delete concurrency
2021-02-01 14:23:15 -08:00
Girish Ramakrishnan
eff9d378e5
nfs: chown the backups for hardlinks to work
2020-12-18 17:14:42 -08:00
Girish Ramakrishnan
0f9a5c6b9a
nfs: is prefix is empty, it errors
2020-12-18 14:41:59 -08:00
Girish Ramakrishnan
f55300eba5
reduce DO spaces copy part size
2020-12-15 14:37:18 -08:00
Girish Ramakrishnan
a68ddcbbc4
Fix progress message
2020-12-14 19:58:44 -08:00
Girish Ramakrishnan
0723b7d672
reduce copy concurrency to keep most providers happy
2020-12-14 17:26:44 -08:00
Girish Ramakrishnan
ca17afc734
volumes: better hostPath validation
2020-12-03 23:05:06 -08:00
Girish Ramakrishnan
41053d6857
validate backup folder and prefix
2020-12-01 12:46:02 -08:00
Girish Ramakrishnan
3d5599cdd9
b2: reduce copy part size
...
'Error copying snapshot/app_8b22dc8f-3e15-4314-8108-bcf1908a24df.tar.gz.enc (482405284 bytes): InternalError InternalError: too busy to complete copy - please try again' }
2020-11-29 11:16:05 -08:00
Girish Ramakrishnan
bedcd6fccf
Disable the timeout altogether for chunk to upload
2020-11-06 14:47:14 -08:00
Girish Ramakrishnan
df8a71cd8b
Each chunk can take up to 30 mins to upload
2020-11-06 00:05:53 -08:00
Girish Ramakrishnan
e68db4ce57
Aim for 60% used space
2020-11-02 23:42:53 -08:00
Girish Ramakrishnan
1da2450b10
gcs: use copy concurrency
2020-09-28 22:03:08 -07:00
Girish Ramakrishnan
166c06c628
log the partSize
2020-09-10 00:09:54 -07:00
Girish Ramakrishnan
fc08f9823e
s3: copy parts in parallel
2020-09-03 14:31:56 -07:00
Girish Ramakrishnan
e25ccc5e9a
Double the timeout for upload now that chunks can have custom sizes
2020-08-20 16:50:58 -07:00
Girish Ramakrishnan
0e00492f54
backups: make part size configurable
2020-08-19 14:39:20 -07:00
Girish Ramakrishnan
df6e3eb1e6
Add deleteConcurrency setting
2020-08-11 09:14:09 -07:00
Girish Ramakrishnan
91288c96b1
s3: set queue size to 3
...
fixes #691
2020-08-07 00:28:00 -07:00
Johannes Zellner
493f1505f0
Check also for mountpoint on filesystem with external disk
2020-07-02 19:08:27 +02:00
Johannes Zellner
a96da20536
TODO is done for filesystem backend moutnpoint check
2020-06-26 17:57:26 +02:00
Johannes Zellner
60f1b2356a
Also make nfs storage provider same as cifs and sshfs
2020-06-22 15:51:05 +02:00
Girish Ramakrishnan
c855d75f35
remove mkdirp use
...
node 10.12 has { recursive: true }
2020-06-11 08:27:48 -07:00
Johannes Zellner
89494ced41
Check for sshfs and cifs backup backends, if they are mounted
2020-06-08 17:46:52 +02:00
Johannes Zellner
ef764c2393
Merge sshfs.js into filesystem.js
2020-06-08 17:08:26 +02:00
Johannes Zellner
8624e2260d
add storage api to make preflight checks
...
Currently there is only disk space checking but sshfs and cifs need
mount point checking as well
2020-06-08 16:25:05 +02:00
Johannes Zellner
3557fcd129
Add sshfs quirks to shared code in filesytstem.js
2020-06-05 13:45:25 +02:00
Johannes Zellner
330b4a613c
Retrieve the backupPath from the storage provider itself
2020-06-05 13:27:18 +02:00
Johannes Zellner
7ba3412aae
Add some sshfs config tests
2020-06-05 12:43:09 +02:00
Johannes Zellner
6f60495d4d
Initial version of sshfs storage backend
2020-06-05 11:39:51 +02:00
Girish Ramakrishnan
4a0a934a76
start using vhost style for accessing s3 style storage
...
if bucket name has a '.', accept self-signed
fixes #680
2020-05-27 17:50:37 -07:00
