 Girish Ramakrishnan
|
e39329218d
|
Make tests work
|
2017-09-27 11:38:43 -07:00 |
|
|
Girish Ramakrishnan
|
a9e89b57d9
|
merge caas storage into s3 backend
|
2017-09-26 12:28:33 -07:00 |
|
|
Girish Ramakrishnan
|
0a60365143
|
Initial version of flat-file uploader
|
2017-09-26 00:17:11 -07:00 |
|
|
Girish Ramakrishnan
|
b0f85678d4
|
Implement downloadDir for flat-file format
|
2017-09-23 18:07:26 -07:00 |
|
|
Girish Ramakrishnan
|
e43413e063
|
implement remove dir in storage backends
|
2017-09-23 12:34:51 -07:00 |
|
|
Girish Ramakrishnan
|
97da8717ca
|
Refactor backup strategy logic into backups.js
|
2017-09-20 14:09:55 -07:00 |
|
|
Girish Ramakrishnan
|
26f33a8e9b
|
Send resolved path to the storage APIs
|
2017-09-19 21:58:35 -07:00 |
|
|
Girish Ramakrishnan
|
4892473eff
|
backupIds do not have extension anymore
this code existed for legacy reasons
|
2017-09-19 12:34:09 -07:00 |
|
|
Girish Ramakrishnan
|
f5d32a9178
|
copyBackup -> copy
|
2017-09-18 14:29:15 -07:00 |
|
|
Girish Ramakrishnan
|
781f543e87
|
Rename API calls in the storage backend
|
2017-09-17 18:50:29 -07:00 |
|
|
Girish Ramakrishnan
|
b0ee116004
|
targz: make sourceDir a string
|
2017-09-17 18:50:15 -07:00 |
|
|
Girish Ramakrishnan
|
e78d976c8f
|
Fix backup mapping (mail dir has moved)
|
2017-09-13 09:51:20 -07:00 |
|
|
Johannes Zellner
|
11c2cecc9e
|
Ensure we only add a leading / when we have a prefix
Part of #343
|
2017-07-19 14:35:35 +02:00 |
|
|
Girish Ramakrishnan
|
e5c42f2b90
|
Do a multipart download for slow internet connections
Fixes #317
|
2017-04-28 17:28:40 -07:00 |
|
|
Girish Ramakrishnan
|
9635f9aa24
|
Use key to determine if we should encrypt or not
When encrypting we use the .enc extension. When not encrypting, we
use the plain .tar.gz extension.
Fixes #315
|
2017-04-28 14:50:20 -07:00 |
|
|
Girish Ramakrishnan
|
893f9d87bc
|
make s3 upload use queueSize of 1
|
2017-04-28 14:50:08 -07:00 |
|
|
Girish Ramakrishnan
|
bfda0d4891
|
drop support for old format backups
|
2017-04-28 14:45:44 -07:00 |
|
|
Girish Ramakrishnan
|
ca5723bbc7
|
more work on tests
disable the migrate tests for now
|
2017-04-24 15:45:23 -07:00 |
|
|
Girish Ramakrishnan
|
f79e1993cb
|
use debug() more
|
2017-04-23 22:10:44 -07:00 |
|
|
Girish Ramakrishnan
|
aeba8e8fd2
|
Use retentionSecs to cleanup backups
Part of #310
|
2017-04-23 19:34:00 -07:00 |
|
|
Girish Ramakrishnan
|
d91e8bb87b
|
add minio as a separate backend
Fixes #308
|
2017-04-22 13:34:43 -07:00 |
|
|
Johannes Zellner
|
a7d7935451
|
Remove backup download code
|
2017-04-22 22:17:29 +02:00 |
|
|
Girish Ramakrishnan
|
1cca0aee6e
|
refactor targz logic into separate file
|
2017-04-21 15:45:45 -07:00 |
|
|
Girish Ramakrishnan
|
be73ec4b66
|
Add oldFormat support to caas and s3 backends
|
2017-04-21 15:06:54 -07:00 |
|
|
Girish Ramakrishnan
|
0aea7cc347
|
Add progress-stream for upload/download progress
|
2017-04-21 12:07:01 -07:00 |
|
|
Johannes Zellner
|
8fb1bc29d1
|
Fix storage tests for filesystem and s3
|
2017-04-21 17:21:10 +02:00 |
|
|
Johannes Zellner
|
33492333c7
|
Fix backupDone() for caas
|
2017-04-21 10:31:43 +02:00 |
|
|
Johannes Zellner
|
0471a14894
|
We always encrypt even with empty key so make that clear with the file extension
|
2017-04-21 09:59:27 +02:00 |
|
|
Girish Ramakrishnan
|
1cd36319ff
|
s3: support setting the signatureVersion
|
2017-04-20 19:56:06 -07:00 |
|
|
Girish Ramakrishnan
|
a65611a37b
|
Fix error handling in s3 backend
|
2017-04-20 19:27:12 -07:00 |
|
|
Girish Ramakrishnan
|
0584ace954
|
Remove StorageError from backends
|
2017-04-20 18:12:29 -07:00 |
|
|
Girish Ramakrishnan
|
83f36981f7
|
Make box backups work again
|
2017-04-20 16:26:42 -07:00 |
|
|
Johannes Zellner
|
788873e858
|
Add error callbacks for backup in filesystem and s3
|
2017-04-20 16:18:27 +02:00 |
|
|
Johannes Zellner
|
9f117fcfdc
|
Also simplify the s3 backend
|
2017-04-20 15:35:52 +02:00 |
|
|
Johannes Zellner
|
65af062c33
|
Cleanup linter issues
|
2017-04-19 13:20:24 +02:00 |
|
|
Johannes Zellner
|
d5db9657ca
|
Add s3 mock for the s3 storage tests
|
2017-04-18 19:15:56 +02:00 |
|
|
Johannes Zellner
|
ad9cb00f13
|
Add s3 storage removeBackup() and getDownloadStream() implementations
|
2017-04-18 17:33:59 +02:00 |
|
|
Johannes Zellner
|
cec52e14f6
|
Remove s3 backup test shell script
|
2017-04-18 16:58:27 +02:00 |
|
|
Johannes Zellner
|
261d15f0f7
|
Handle S3 not found errors
|
2017-04-18 16:47:49 +02:00 |
|
|
Johannes Zellner
|
14fe1dde58
|
s3 storage backend with backup and restore implemented
|
2017-04-18 16:28:39 +02:00 |
|
|
Girish Ramakrishnan
|
31a9437b2c
|
Add backupDone hook
|
2017-01-04 16:23:12 -08:00 |
|
|
Johannes Zellner
|
b2dbb5a100
|
Fixup bugs with updated backup scripts
|
2016-12-12 09:51:52 +01:00 |
|
|
Johannes Zellner
|
816911d071
|
Make s3 backup scripts aware of endpoints
Part of #123
|
2016-12-12 09:51:52 +01:00 |
|
|
Johannes
|
5ba86d5c35
|
Use aws s3 cli to test credentials
This allows us to test the exact same usage of the api
through the cli tool, not the javascript api
|
2016-10-28 16:36:05 +02:00 |
|
|
Johannes Zellner
|
6e6d4f7413
|
Actually verify s3 credentials by using the api
|
2016-10-11 11:46:28 +02:00 |
|
|
Johannes Zellner
|
cac85b17bc
|
Add backup config test for each backend
|
2016-10-11 11:36:25 +02:00 |
|
|
Johannes Zellner
|
c7e5c09bb9
|
Adjust removeBackup() api
|
2016-10-10 15:45:48 +02:00 |
|
|
Johannes Zellner
|
1b3ae1f178
|
Add new storage.removeBackup() api
This currently is only used in the filesystem backend,
but may be expanded to also cleanup S3 in the future
|
2016-10-10 15:45:48 +02:00 |
|
|
Johannes Zellner
|
4a9a6dc232
|
Move backup config fetching into storage backend
|
2016-09-20 09:25:48 +02:00 |
|
|
Johannes Zellner
|
6352064e6c
|
Add backup download route if backend supports it
|
2016-09-20 09:25:48 +02:00 |
|