996c838320
timestamp -> tag
...
later, we can actually move this tag to a separate field in backupdb.
and then, dependsOn can also be removed and we can use this tag as
a collation label.
2019-04-14 11:33:11 -07:00
083b8a6d7b
Add preserveSecs to backup entries
...
We want to keep updates automatic and don't want to keep reminding
users that apps are getting updated etc (i.e beyong the weekly
digest). The reason to remind them is so they can check if the
app updated correctly. in some very corner cases, the app is not
really checked upon for a while and people forget about them until
they check them later. in such cases, it's too late to recover because
the backpus gets cleaned up. this preserve seconds fields, let's us
mark 'update' backups for preservation for 3 weeks.
2019-04-13 18:17:49 -07:00
74211dd2c9
Change signature of backupdb.add
2019-04-13 17:28:19 -07:00
e44ad19bda
Add Scaleway ObjectStorage backup backend
2019-04-12 10:10:43 -07:00
f6ad66bd30
rename to ignoreStatError and explicitly ignore ENOENT
2019-04-01 11:56:20 -07:00
38d9378e48
Fix issue where tar-fs would complain about missing files
...
This is being tracked in upstream issue - https://github.com/mafintosh/tar-fs/issues/81
We use a custom fork of tar-fs for now
Fixes #628
2019-03-31 17:43:08 -07:00
155decfca1
typog
2019-03-17 16:09:21 -07:00
1bcc2d544a
link to logs instead of spatch'ed error
2019-03-04 18:03:51 -08:00
f6213595d1
move mailer notification of failed backups
...
this also removes the splatchError which is causing a crash because
of infinite recursion when backups fail (not sure why)
2019-03-04 15:01:30 -08:00
a8735a6465
Generate detailed mail configuration error notification
2019-03-01 11:15:05 -08:00
a88893b10a
remove/inject backups secret fields
...
follow same pattern as dns code
fixes #615
2019-02-09 20:44:05 -08:00
ddffc8a36e
better message
2019-01-25 14:11:38 -08:00
6d365fde14
move datalayout to separate file for tests
2019-01-22 17:35:36 -08:00
8c8cc035ab
Generate fsmetadata correctly
2019-01-19 21:45:54 -08:00
d8ff2488a3
Make syncer work with a layout
2019-01-19 20:39:49 -08:00
a0b69df20d
Add DataLayout class to help with path xforms
2019-01-18 17:13:25 -08:00
57aa3de9bb
typo
2019-01-18 15:18:46 -08:00
fcc77635c2
retry must wrap the download function as well
2019-01-18 14:31:30 -08:00
ab35821b59
saveFsMetadata: make it work with a layout
2019-01-17 14:55:37 -08:00
a915348b22
Return correct error code when already locked
2019-01-17 10:58:38 -08:00
13c628b58b
backups (tgz): work with a layout
...
this will allow us to place the localstorage directory in an arbitrary
location
2019-01-16 12:52:04 -08:00
3500236d32
sync concurrency cannot be very high
2019-01-15 20:44:09 -08:00
2f881c0c91
log download errors
2019-01-15 12:01:12 -08:00
ee65089eb7
s3: make copying and uploading significantly faster
2019-01-14 13:47:07 -08:00
40c7d18382
Fix upload progress message
2019-01-14 12:23:03 -08:00
3236a9a5b7
backup: retry rsync file downloads
...
fixes #608
2019-01-14 11:57:10 -08:00
d0522d7d4f
backups: retry tgz downloads
...
Part of #608
2019-01-14 11:36:11 -08:00
e63b67b99e
resolve any boxdata symlink
2019-01-13 15:17:02 -08:00
172d4b7c5e
backup: store cleanup result properly
2019-01-12 15:17:04 -08:00
2acb065d38
Track what the the backup cleaner removed
2019-01-11 14:09:43 -08:00
c021d3d9ce
backup: add retry only if > 1
2019-01-11 11:07:19 -08:00
79f9180f6b
run backup cleanup as a task
2019-01-10 16:07:06 -08:00
766ef5f420
remove spurious argument
2019-01-10 16:02:15 -08:00
7b64b2a708
do-spaces: Limit download concurrency
...
https://www.digitalocean.com/community/questions/rate-limiting-on-spaces?answer=40441
2019-01-09 15:09:29 -08:00
d9309cb215
Use a separate event for tarExtract
2018-12-22 21:23:20 -08:00
433c34e4ce
better debugs
2018-12-22 21:23:17 -08:00
0a74bd1718
add note on saveFsMetadata
2018-12-20 15:11:15 -08:00
8a5b24afff
Make tarPack and tarExtract have consistent style
2018-12-20 11:49:37 -08:00
0a7f1faad1
Better progress message
2018-12-14 23:20:32 -08:00
d43106b0af
Add taskworker that runs funcs out of process
2018-12-09 10:06:22 -08:00
c72ea91743
make task args an object and put it in eventlog
2018-11-30 14:57:24 -08:00
b0ecdcc8b6
Fix another crash
2018-11-30 10:03:16 -08:00
df927eae74
move backupupload.js to scripts
...
it is just a sudo helper
2018-11-29 23:30:56 -08:00
30aea047e3
startTask now takes args
2018-11-29 23:28:26 -08:00
fca0e897b2
Add tasks.startTask
2018-11-29 16:21:04 -08:00
2f729b56fa
Use result in db instead of ipc
2018-11-29 15:34:05 -08:00
d9f3f64c76
Store result and error message separately
2018-11-29 14:45:28 -08:00
632ba69663
Make restore/download logic have progress callbacks
2018-11-27 12:13:16 -08:00
b2465dd2ee
Set the backup task progress in the task only
2018-11-27 12:12:27 -08:00
e56b87766b
backupApp should not set backup task progress
2018-11-27 11:06:03 -08:00
Girish Ramakrishnan