6494050d66
Make removeDir less noisy
2017-10-03 01:22:37 -07:00
21afc71d89
add tests for storage backends
2017-10-02 23:08:16 -07:00
0f543e6703
s3: add progress detail
...
this is a bit of a hack and we should add another way to set the progress
(maybe via backups.setProgress or via a progress callback). this is because
some methods like removeDir can be called from backuptask and from box code.
2017-10-01 18:25:51 -07:00
5cccb50a31
fix backup cleanup logic
2017-09-30 18:38:45 -07:00
a93d453963
rename flat-file to rsync
...
not a name I like but cannot come up with anything better
https://en.wikipedia.org/wiki/Flat_file_database
the term 'rsync format' seems to be used in a few places
2017-09-30 14:19:19 -07:00
954224dafb
make syncer track directories
2017-09-29 15:29:18 -07:00
4a5cbab194
Do not remove parent directory in fs.remove()
...
Do the pruning in the cleanup logic instead
2017-09-28 20:55:45 -07:00
19999abc50
s3: fix restore
2017-09-28 14:35:49 -07:00
5123b669d7
remove options.concurrency
2017-09-28 12:20:15 -07:00
404a019c56
s3: Check IsTruncated before accessing Contents
2017-09-28 10:36:56 -07:00
bafc6dce98
s3: refactor out directory listing
2017-09-27 21:59:51 -07:00
eeef221b4e
Fix race where pipe finishes before file is created
...
When there are 0 length files, this is easily reproducible.
2017-09-27 19:40:26 -07:00
a34180c27b
Add format to backupsdb
...
Call remove/removeDir based on the format
2017-09-27 18:02:30 -07:00
b3c6b8aa15
do not spawn process just for chown
2017-09-27 15:07:19 -07:00
003dc0dbaf
Add todo
2017-09-27 11:50:49 -07:00
e39329218d
Make tests work
2017-09-27 11:38:43 -07:00
2780de631e
writable streams emit finish
2017-09-26 16:43:51 -07:00
399c756735
use exec so that filenames do not have to be escaped
2017-09-26 15:53:42 -07:00
a9e89b57d9
merge caas storage into s3 backend
2017-09-26 12:28:33 -07:00
0a60365143
Initial version of flat-file uploader
2017-09-26 00:17:11 -07:00
b0f85678d4
Implement downloadDir for flat-file format
2017-09-23 18:07:26 -07:00
e43413e063
implement remove dir in storage backends
2017-09-23 12:34:51 -07:00
97da8717ca
Refactor backup strategy logic into backups.js
2017-09-20 14:09:55 -07:00
26f33a8e9b
Send resolved path to the storage APIs
2017-09-19 21:58:35 -07:00
a3293c4c35
Fix tests
2017-09-19 12:43:13 -07:00
4892473eff
backupIds do not have extension anymore
...
this code existed for legacy reasons
2017-09-19 12:34:09 -07:00
221d5f95e1
ensure backupFolder is always set
2017-09-19 12:34:09 -07:00
84649b9471
Bring back backuptask
...
This is required for various small reasons:
* dir iteration with a way to pass messagein back to the upload() easily
* can be killed independently of box code
* allows us to run sync (blocking) commands in the upload logic
2017-09-19 12:32:38 -07:00
8ced0aa78e
copy: use hardlinks to preserve space
2017-09-18 14:29:48 -07:00
f5d32a9178
copyBackup -> copy
2017-09-18 14:29:15 -07:00
71233ecd95
Fix undefined variable
2017-09-18 11:14:04 -07:00
781f543e87
Rename API calls in the storage backend
2017-09-17 18:50:29 -07:00
6525a467a2
Rework backuptask into tar.js
...
This makes it easy to integrate another backup strategy
as the next step
2017-09-17 18:50:26 -07:00
b0ee116004
targz: make sourceDir a string
2017-09-17 18:50:15 -07:00
e78d976c8f
Fix backup mapping (mail dir has moved)
2017-09-13 09:51:20 -07:00
11c2cecc9e
Ensure we only add a leading / when we have a prefix
...
Part of #343
2017-07-19 14:35:35 +02:00
6fc69c05ca
Add noop storage backend
...
This is sometimes useful when an update gets stuck because of some
bug in backup logic.
Note that you cannot restore from this backend because nothing is
saved.
2017-05-22 10:45:01 -07:00
6ef2f974ae
fs: Use key to determine backup extension
2017-05-08 16:03:29 -07:00
dacc66bb35
Ignore fifo files during backup
...
Fixes #318
2017-05-01 10:11:41 -07:00
7a3d3a3c74
Fix usage of tar.gz API
2017-04-30 17:42:55 -07:00
e5c42f2b90
Do a multipart download for slow internet connections
...
Fixes #317
2017-04-28 17:28:40 -07:00
9635f9aa24
Use key to determine if we should encrypt or not
...
When encrypting we use the .enc extension. When not encrypting, we
use the plain .tar.gz extension.
Fixes #315
2017-04-28 14:50:20 -07:00
893f9d87bc
make s3 upload use queueSize of 1
2017-04-28 14:50:08 -07:00
bfda0d4891
drop support for old format backups
2017-04-28 14:45:44 -07:00
a723203b28
Fix typo of missing data argument
2017-04-25 13:48:12 +02:00
ca5723bbc7
more work on tests
...
disable the migrate tests for now
2017-04-24 15:45:23 -07:00
81b705b25b
give inner callback variable a different name
2017-04-23 22:51:07 -07:00
f79e1993cb
use debug() more
2017-04-23 22:10:44 -07:00
aeba8e8fd2
Use retentionSecs to cleanup backups
...
Part of #310
2017-04-23 19:34:00 -07:00
d91e8bb87b
add minio as a separate backend
...
Fixes #308
2017-04-22 13:34:43 -07:00
Girish Ramakrishnan