Johannes Zellner
816911d071
Make s3 backup scripts aware of endpoints
...
Part of #123
2016-12-12 09:51:52 +01:00
Johannes
5ba86d5c35
Use aws s3 cli to test credentials
...
This allows us to test the exact same usage of the api
through the cli tool, not the javascript api
2016-10-28 16:36:05 +02:00
Johannes Zellner
6e6d4f7413
Actually verify s3 credentials by using the api
2016-10-11 11:46:28 +02:00
Johannes Zellner
cac85b17bc
Add backup config test for each backend
2016-10-11 11:36:25 +02:00
Johannes Zellner
f576f38e4c
Calculate the backup checksum for client side verification
...
Fixes #54
2016-10-10 18:11:25 +02:00
Johannes Zellner
9d3f8f23ef
Also remove the app backup json files
2016-10-10 16:25:43 +02:00
Johannes Zellner
1e65142f47
Use rmbackup.sh instead of fs.unlink() due to root ownership
2016-10-10 16:25:43 +02:00
Johannes Zellner
c7e5c09bb9
Adjust removeBackup() api
2016-10-10 15:45:48 +02:00
Johannes Zellner
1b3ae1f178
Add new storage.removeBackup() api
...
This currently is only used in the filesystem backend,
but may be expanded to also cleanup S3 in the future
2016-10-10 15:45:48 +02:00
Johannes Zellner
629e061743
Use specific error if app backup for restore can't be found
2016-10-10 13:21:45 +02:00
Johannes Zellner
4a9a6dc232
Move backup config fetching into storage backend
2016-09-20 09:25:48 +02:00
Johannes Zellner
6352064e6c
Add backup download route if backend supports it
2016-09-20 09:25:48 +02:00
Johannes Zellner
c9c1964e09
The storage backends dont need a backup listing function
2016-09-20 09:25:48 +02:00
Johannes Zellner
e8be76f2e8
Fixup typos
2016-09-20 09:25:48 +02:00
Johannes Zellner
0ef9102b50
Set default backup folder to /var/backups
2016-09-20 09:25:48 +02:00
Johannes Zellner
d8de9555f2
Add storage interface definition
2016-09-20 09:25:48 +02:00
Johannes Zellner
f348fedd50
Caas backend has to use the AWS credentials provided by appstore
2016-09-20 09:25:48 +02:00
Johannes Zellner
2a92d4772c
Fix typo
2016-09-20 09:25:48 +02:00
Johannes Zellner
fa828cc661
Basic backup listing for filesystem backend
2016-09-20 09:25:48 +02:00
Johannes Zellner
04b7822be5
Implement filesystem storage backend getRestoreUrl()
2016-09-20 09:25:48 +02:00
Johannes Zellner
1fd96a847f
Implement filesystem storage backend copy
2016-09-20 09:25:48 +02:00
Johannes Zellner
bf177473fe
Rename getBackupDetails() -> getBoxBackupDetails()
2016-09-20 09:25:48 +02:00
Johannes Zellner
2ce768e29a
Refactor getAppBackupCredentials()
2016-09-20 09:25:48 +02:00
Johannes Zellner
96c8f96c52
Group exports
2016-09-20 09:25:48 +02:00
Johannes Zellner
83ed87a8eb
Refactor getBackupCredentials()
2016-09-20 09:25:48 +02:00
Johannes Zellner
1736d50260
Add filesystem storage backend only as noop currently
2016-09-20 09:25:48 +02:00
Johannes Zellner
10e7f27b16
Actually we need to specify the signatureVersion...
2016-09-13 12:07:09 +02:00
Girish Ramakrishnan
c1bb264065
Set a timeout for superagent
...
The default is 'no timeout' and it will wait for the response forever.
https://github.com/visionmedia/superagent/issues/17#issuecomment-207742985
2016-09-12 13:06:18 -07:00
Johannes Zellner
8de0746ac8
Revert "Use S3 signature versoin 4 to support all regions"
...
If we set the correct region name, the signature version is selected
automatically
This reverts commit 1e22cc3236
2016-09-12 14:27:47 +02:00
Johannes Zellner
1e22cc3236
Use S3 signature versoin 4 to support all regions
...
http://docs.aws.amazon.com/AmazonS3/latest/API/sig-v4-authenticating-requests.html
2016-09-09 20:07:57 +02:00
Girish Ramakrishnan
22d86ff5b9
create signed urls that are valid for a day
...
sometimes the downloads take overly long and it's annoying that they
expire so soon.
2016-08-24 17:53:31 -07:00
Girish Ramakrishnan
4ed368cdd8
remove getBackupUrl
2016-04-10 22:12:06 -07:00
Girish Ramakrishnan
4565291c1c
use aws-cli to upload box backups
2016-04-10 18:22:05 -07:00
Girish Ramakrishnan
08b5d7003d
expose getBackupCredentials from storage api
2016-04-10 10:55:59 -07:00
Girish Ramakrishnan
497eaea65e
bump expiry to 60 mins
2016-04-04 16:02:13 -07:00
Girish Ramakrishnan
8aacc503a6
Revert "getRestoreUrl now uses caas restore api"
...
This reverts commit f9fc9325a8995dc0a9cb1dfcf22fb27eca697a89.
For now, we can simply assume that caas is s3 based.
2016-04-04 15:57:32 -07:00
Girish Ramakrishnan
ec160fe45f
make getBackupUrl return id as well
2016-04-04 12:45:09 -07:00
Girish Ramakrishnan
c9ef0056e0
rename getSignedUploadUrl to getBackupUrl
2016-04-04 12:01:47 -07:00
Girish Ramakrishnan
efb228cf5e
getRestoreUrl now uses caas restore api
2016-04-04 11:57:29 -07:00
Girish Ramakrishnan
af700827c5
info is not passed anymore
2016-04-04 11:44:24 -07:00
Girish Ramakrishnan
3135783fe3
rename getSignedDownloadUrl to getRestoreUrl
2016-04-04 11:43:56 -07:00
Girish Ramakrishnan
496f530b9f
sessionToken is required in credentials (when signing)
2016-04-04 11:23:38 -07:00
Girish Ramakrishnan
d839f0b762
remove redundant session token
2016-04-03 23:23:23 -07:00
Girish Ramakrishnan
16a65fb185
drop configJson
...
The initial idea was to store exactly where the backups are stored.
But this only causes problems for migrations where the bucket might
change and clones where the prefix (box.id) changes.
Thus, it's best to leave the url creation to the caas side. (That
has to be done in another change)
2016-04-03 22:55:08 -07:00
Girish Ramakrishnan
357f6f0552
use same region as what we uploaded to
2016-04-02 13:32:14 -07:00
Girish Ramakrishnan
b16aa4c007
check for region as well
2016-04-02 13:31:12 -07:00
Girish Ramakrishnan
3ea2070cdb
pass filename (it is not part of the config!)
2016-03-31 09:53:56 -07:00
Girish Ramakrishnan
fc11484b51
pick region from apiConfig if present
2016-03-31 09:48:38 -07:00
Girish Ramakrishnan
b4ddfa94cc
rename to apiConfig
2016-03-31 09:48:13 -07:00
Girish Ramakrishnan
39cc5d07d1
use the backupdb config to determine bucket and prefix
2016-03-31 00:50:56 -07:00
