Girish Ramakrishnan
40033e09cd
Check disk space before create app/box backups
...
Fixes #642
2019-08-13 10:55:02 -07:00
Girish Ramakrishnan
2cd00de6e3
initCache after every restore
2019-07-27 19:09:09 -07:00
Girish Ramakrishnan
9b74bb73aa
config.js is dead, long live config.js
...
we use settings now
2019-07-26 14:51:51 -07:00
Girish Ramakrishnan
d7dd069ae0
Use constants.version instead of config.version
2019-07-25 15:02:14 -07:00
Girish Ramakrishnan
3553fbc7b6
Add wasabi storage backend
2019-07-22 16:44:56 -07:00
Girish Ramakrishnan
117f06e971
Fix issue where tar backups with files > 8GB was corrupt
...
Fixes #640
2019-07-10 14:58:54 -07:00
Girish Ramakrishnan
9e74b666fb
More caas removal
2019-05-08 20:01:14 -07:00
Girish Ramakrishnan
6fa13f1bcc
caas: remove backupDone
2019-05-08 15:28:37 -07:00
Girish Ramakrishnan
35dfd540b5
caas: move backupDone
2019-04-26 10:06:03 -07:00
Girish Ramakrishnan
996c838320
timestamp -> tag
...
later, we can actually move this tag to a separate field in backupdb.
and then, dependsOn can also be removed and we can use this tag as
a collation label.
2019-04-14 11:33:11 -07:00
Girish Ramakrishnan
083b8a6d7b
Add preserveSecs to backup entries
...
We want to keep updates automatic and don't want to keep reminding
users that apps are getting updated etc (i.e beyong the weekly
digest). The reason to remind them is so they can check if the
app updated correctly. in some very corner cases, the app is not
really checked upon for a while and people forget about them until
they check them later. in such cases, it's too late to recover because
the backpus gets cleaned up. this preserve seconds fields, let's us
mark 'update' backups for preservation for 3 weeks.
2019-04-13 18:17:49 -07:00
Girish Ramakrishnan
74211dd2c9
Change signature of backupdb.add
2019-04-13 17:28:19 -07:00
Girish Ramakrishnan
e44ad19bda
Add Scaleway ObjectStorage backup backend
2019-04-12 10:10:43 -07:00
Girish Ramakrishnan
f6ad66bd30
rename to ignoreStatError and explicitly ignore ENOENT
2019-04-01 11:56:20 -07:00
Girish Ramakrishnan
38d9378e48
Fix issue where tar-fs would complain about missing files
...
This is being tracked in upstream issue - https://github.com/mafintosh/tar-fs/issues/81
We use a custom fork of tar-fs for now
Fixes #628
2019-03-31 17:43:08 -07:00
Girish Ramakrishnan
155decfca1
typog
2019-03-17 16:09:21 -07:00
Girish Ramakrishnan
1bcc2d544a
link to logs instead of spatch'ed error
2019-03-04 18:03:51 -08:00
Girish Ramakrishnan
f6213595d1
move mailer notification of failed backups
...
this also removes the splatchError which is causing a crash because
of infinite recursion when backups fail (not sure why)
2019-03-04 15:01:30 -08:00
Girish Ramakrishnan
a8735a6465
Generate detailed mail configuration error notification
2019-03-01 11:15:05 -08:00
Girish Ramakrishnan
a88893b10a
remove/inject backups secret fields
...
follow same pattern as dns code
fixes #615
2019-02-09 20:44:05 -08:00
Girish Ramakrishnan
ddffc8a36e
better message
2019-01-25 14:11:38 -08:00
Girish Ramakrishnan
6d365fde14
move datalayout to separate file for tests
2019-01-22 17:35:36 -08:00
Girish Ramakrishnan
8c8cc035ab
Generate fsmetadata correctly
2019-01-19 21:45:54 -08:00
Girish Ramakrishnan
d8ff2488a3
Make syncer work with a layout
2019-01-19 20:39:49 -08:00
Girish Ramakrishnan
a0b69df20d
Add DataLayout class to help with path xforms
2019-01-18 17:13:25 -08:00
Girish Ramakrishnan
57aa3de9bb
typo
2019-01-18 15:18:46 -08:00
Girish Ramakrishnan
fcc77635c2
retry must wrap the download function as well
2019-01-18 14:31:30 -08:00
Girish Ramakrishnan
ab35821b59
saveFsMetadata: make it work with a layout
2019-01-17 14:55:37 -08:00
Girish Ramakrishnan
a915348b22
Return correct error code when already locked
2019-01-17 10:58:38 -08:00
Girish Ramakrishnan
13c628b58b
backups (tgz): work with a layout
...
this will allow us to place the localstorage directory in an arbitrary
location
2019-01-16 12:52:04 -08:00
Girish Ramakrishnan
3500236d32
sync concurrency cannot be very high
2019-01-15 20:44:09 -08:00
Girish Ramakrishnan
2f881c0c91
log download errors
2019-01-15 12:01:12 -08:00
Girish Ramakrishnan
ee65089eb7
s3: make copying and uploading significantly faster
2019-01-14 13:47:07 -08:00
Girish Ramakrishnan
40c7d18382
Fix upload progress message
2019-01-14 12:23:03 -08:00
Girish Ramakrishnan
3236a9a5b7
backup: retry rsync file downloads
...
fixes #608
2019-01-14 11:57:10 -08:00
Girish Ramakrishnan
d0522d7d4f
backups: retry tgz downloads
...
Part of #608
2019-01-14 11:36:11 -08:00
Girish Ramakrishnan
e63b67b99e
resolve any boxdata symlink
2019-01-13 15:17:02 -08:00
Girish Ramakrishnan
172d4b7c5e
backup: store cleanup result properly
2019-01-12 15:17:04 -08:00
Girish Ramakrishnan
2acb065d38
Track what the the backup cleaner removed
2019-01-11 14:09:43 -08:00
Girish Ramakrishnan
c021d3d9ce
backup: add retry only if > 1
2019-01-11 11:07:19 -08:00
Girish Ramakrishnan
79f9180f6b
run backup cleanup as a task
2019-01-10 16:07:06 -08:00
Girish Ramakrishnan
766ef5f420
remove spurious argument
2019-01-10 16:02:15 -08:00
Girish Ramakrishnan
7b64b2a708
do-spaces: Limit download concurrency
...
https://www.digitalocean.com/community/questions/rate-limiting-on-spaces?answer=40441
2019-01-09 15:09:29 -08:00
Girish Ramakrishnan
d9309cb215
Use a separate event for tarExtract
2018-12-22 21:23:20 -08:00
Girish Ramakrishnan
433c34e4ce
better debugs
2018-12-22 21:23:17 -08:00
Girish Ramakrishnan
0a74bd1718
add note on saveFsMetadata
2018-12-20 15:11:15 -08:00
Girish Ramakrishnan
8a5b24afff
Make tarPack and tarExtract have consistent style
2018-12-20 11:49:37 -08:00
Girish Ramakrishnan
0a7f1faad1
Better progress message
2018-12-14 23:20:32 -08:00
Girish Ramakrishnan
d43106b0af
Add taskworker that runs funcs out of process
2018-12-09 10:06:22 -08:00
Girish Ramakrishnan
c72ea91743
make task args an object and put it in eventlog
2018-11-30 14:57:24 -08:00
