Girish Ramakrishnan
|
e44ad19bda
|
Add Scaleway ObjectStorage backup backend
|
2019-04-12 10:10:43 -07:00 |
|
Girish Ramakrishnan
|
f6ad66bd30
|
rename to ignoreStatError and explicitly ignore ENOENT
|
2019-04-01 11:56:20 -07:00 |
|
Girish Ramakrishnan
|
38d9378e48
|
Fix issue where tar-fs would complain about missing files
This is being tracked in upstream issue - https://github.com/mafintosh/tar-fs/issues/81
We use a custom fork of tar-fs for now
Fixes #628
|
2019-03-31 17:43:08 -07:00 |
|
Girish Ramakrishnan
|
155decfca1
|
typog
|
2019-03-17 16:09:21 -07:00 |
|
Girish Ramakrishnan
|
1bcc2d544a
|
link to logs instead of spatch'ed error
|
2019-03-04 18:03:51 -08:00 |
|
Girish Ramakrishnan
|
f6213595d1
|
move mailer notification of failed backups
this also removes the splatchError which is causing a crash because
of infinite recursion when backups fail (not sure why)
|
2019-03-04 15:01:30 -08:00 |
|
Girish Ramakrishnan
|
a8735a6465
|
Generate detailed mail configuration error notification
|
2019-03-01 11:15:05 -08:00 |
|
Girish Ramakrishnan
|
a88893b10a
|
remove/inject backups secret fields
follow same pattern as dns code
fixes #615
|
2019-02-09 20:44:05 -08:00 |
|
Girish Ramakrishnan
|
ddffc8a36e
|
better message
|
2019-01-25 14:11:38 -08:00 |
|
Girish Ramakrishnan
|
6d365fde14
|
move datalayout to separate file for tests
|
2019-01-22 17:35:36 -08:00 |
|
Girish Ramakrishnan
|
8c8cc035ab
|
Generate fsmetadata correctly
|
2019-01-19 21:45:54 -08:00 |
|
Girish Ramakrishnan
|
d8ff2488a3
|
Make syncer work with a layout
|
2019-01-19 20:39:49 -08:00 |
|
Girish Ramakrishnan
|
a0b69df20d
|
Add DataLayout class to help with path xforms
|
2019-01-18 17:13:25 -08:00 |
|
Girish Ramakrishnan
|
57aa3de9bb
|
typo
|
2019-01-18 15:18:46 -08:00 |
|
Girish Ramakrishnan
|
fcc77635c2
|
retry must wrap the download function as well
|
2019-01-18 14:31:30 -08:00 |
|
Girish Ramakrishnan
|
ab35821b59
|
saveFsMetadata: make it work with a layout
|
2019-01-17 14:55:37 -08:00 |
|
Girish Ramakrishnan
|
a915348b22
|
Return correct error code when already locked
|
2019-01-17 10:58:38 -08:00 |
|
Girish Ramakrishnan
|
13c628b58b
|
backups (tgz): work with a layout
this will allow us to place the localstorage directory in an arbitrary
location
|
2019-01-16 12:52:04 -08:00 |
|
Girish Ramakrishnan
|
3500236d32
|
sync concurrency cannot be very high
|
2019-01-15 20:44:09 -08:00 |
|
Girish Ramakrishnan
|
2f881c0c91
|
log download errors
|
2019-01-15 12:01:12 -08:00 |
|
Girish Ramakrishnan
|
ee65089eb7
|
s3: make copying and uploading significantly faster
|
2019-01-14 13:47:07 -08:00 |
|
Girish Ramakrishnan
|
40c7d18382
|
Fix upload progress message
|
2019-01-14 12:23:03 -08:00 |
|
Girish Ramakrishnan
|
3236a9a5b7
|
backup: retry rsync file downloads
fixes #608
|
2019-01-14 11:57:10 -08:00 |
|
Girish Ramakrishnan
|
d0522d7d4f
|
backups: retry tgz downloads
Part of #608
|
2019-01-14 11:36:11 -08:00 |
|
Girish Ramakrishnan
|
e63b67b99e
|
resolve any boxdata symlink
|
2019-01-13 15:17:02 -08:00 |
|
Girish Ramakrishnan
|
172d4b7c5e
|
backup: store cleanup result properly
|
2019-01-12 15:17:04 -08:00 |
|
Girish Ramakrishnan
|
2acb065d38
|
Track what the the backup cleaner removed
|
2019-01-11 14:09:43 -08:00 |
|
Girish Ramakrishnan
|
c021d3d9ce
|
backup: add retry only if > 1
|
2019-01-11 11:07:19 -08:00 |
|
Girish Ramakrishnan
|
79f9180f6b
|
run backup cleanup as a task
|
2019-01-10 16:07:06 -08:00 |
|
Girish Ramakrishnan
|
766ef5f420
|
remove spurious argument
|
2019-01-10 16:02:15 -08:00 |
|
Girish Ramakrishnan
|
7b64b2a708
|
do-spaces: Limit download concurrency
https://www.digitalocean.com/community/questions/rate-limiting-on-spaces?answer=40441
|
2019-01-09 15:09:29 -08:00 |
|
Girish Ramakrishnan
|
d9309cb215
|
Use a separate event for tarExtract
|
2018-12-22 21:23:20 -08:00 |
|
Girish Ramakrishnan
|
433c34e4ce
|
better debugs
|
2018-12-22 21:23:17 -08:00 |
|
Girish Ramakrishnan
|
0a74bd1718
|
add note on saveFsMetadata
|
2018-12-20 15:11:15 -08:00 |
|
Girish Ramakrishnan
|
8a5b24afff
|
Make tarPack and tarExtract have consistent style
|
2018-12-20 11:49:37 -08:00 |
|
Girish Ramakrishnan
|
0a7f1faad1
|
Better progress message
|
2018-12-14 23:20:32 -08:00 |
|
Girish Ramakrishnan
|
d43106b0af
|
Add taskworker that runs funcs out of process
|
2018-12-09 10:06:22 -08:00 |
|
Girish Ramakrishnan
|
c72ea91743
|
make task args an object and put it in eventlog
|
2018-11-30 14:57:24 -08:00 |
|
Girish Ramakrishnan
|
b0ecdcc8b6
|
Fix another crash
|
2018-11-30 10:03:16 -08:00 |
|
Girish Ramakrishnan
|
df927eae74
|
move backupupload.js to scripts
it is just a sudo helper
|
2018-11-29 23:30:56 -08:00 |
|
Girish Ramakrishnan
|
30aea047e3
|
startTask now takes args
|
2018-11-29 23:28:26 -08:00 |
|
Girish Ramakrishnan
|
fca0e897b2
|
Add tasks.startTask
|
2018-11-29 16:21:04 -08:00 |
|
Girish Ramakrishnan
|
2f729b56fa
|
Use result in db instead of ipc
|
2018-11-29 15:34:05 -08:00 |
|
Girish Ramakrishnan
|
d9f3f64c76
|
Store result and error message separately
|
2018-11-29 14:45:28 -08:00 |
|
Girish Ramakrishnan
|
632ba69663
|
Make restore/download logic have progress callbacks
|
2018-11-27 12:13:16 -08:00 |
|
Girish Ramakrishnan
|
b2465dd2ee
|
Set the backup task progress in the task only
|
2018-11-27 12:12:27 -08:00 |
|
Girish Ramakrishnan
|
e56b87766b
|
backupApp should not set backup task progress
|
2018-11-27 11:06:03 -08:00 |
|
Girish Ramakrishnan
|
f7ca2e416a
|
Add progress callback for snapshotting
|
2018-11-27 11:03:58 -08:00 |
|
Girish Ramakrishnan
|
002f68b0a1
|
Add progress info during backup rotation
|
2018-11-27 10:51:35 -08:00 |
|
Girish Ramakrishnan
|
aa31be5c5a
|
backup: make upload progress available with callback+ipc
|
2018-11-27 10:42:34 -08:00 |
|