Girish Ramakrishnan
|
13c628b58b
|
backups (tgz): work with a layout
this will allow us to place the localstorage directory in an arbitrary
location
|
2019-01-16 12:52:04 -08:00 |
|
Girish Ramakrishnan
|
3500236d32
|
sync concurrency cannot be very high
|
2019-01-15 20:44:09 -08:00 |
|
Girish Ramakrishnan
|
2f881c0c91
|
log download errors
|
2019-01-15 12:01:12 -08:00 |
|
Girish Ramakrishnan
|
ee65089eb7
|
s3: make copying and uploading significantly faster
|
2019-01-14 13:47:07 -08:00 |
|
Girish Ramakrishnan
|
40c7d18382
|
Fix upload progress message
|
2019-01-14 12:23:03 -08:00 |
|
Girish Ramakrishnan
|
3236a9a5b7
|
backup: retry rsync file downloads
fixes #608
|
2019-01-14 11:57:10 -08:00 |
|
Girish Ramakrishnan
|
d0522d7d4f
|
backups: retry tgz downloads
Part of #608
|
2019-01-14 11:36:11 -08:00 |
|
Girish Ramakrishnan
|
e63b67b99e
|
resolve any boxdata symlink
|
2019-01-13 15:17:02 -08:00 |
|
Girish Ramakrishnan
|
172d4b7c5e
|
backup: store cleanup result properly
|
2019-01-12 15:17:04 -08:00 |
|
Girish Ramakrishnan
|
2acb065d38
|
Track what the the backup cleaner removed
|
2019-01-11 14:09:43 -08:00 |
|
Girish Ramakrishnan
|
c021d3d9ce
|
backup: add retry only if > 1
|
2019-01-11 11:07:19 -08:00 |
|
Girish Ramakrishnan
|
79f9180f6b
|
run backup cleanup as a task
|
2019-01-10 16:07:06 -08:00 |
|
Girish Ramakrishnan
|
766ef5f420
|
remove spurious argument
|
2019-01-10 16:02:15 -08:00 |
|
Girish Ramakrishnan
|
7b64b2a708
|
do-spaces: Limit download concurrency
https://www.digitalocean.com/community/questions/rate-limiting-on-spaces?answer=40441
|
2019-01-09 15:09:29 -08:00 |
|
Girish Ramakrishnan
|
d9309cb215
|
Use a separate event for tarExtract
|
2018-12-22 21:23:20 -08:00 |
|
Girish Ramakrishnan
|
433c34e4ce
|
better debugs
|
2018-12-22 21:23:17 -08:00 |
|
Girish Ramakrishnan
|
0a74bd1718
|
add note on saveFsMetadata
|
2018-12-20 15:11:15 -08:00 |
|
Girish Ramakrishnan
|
8a5b24afff
|
Make tarPack and tarExtract have consistent style
|
2018-12-20 11:49:37 -08:00 |
|
Girish Ramakrishnan
|
0a7f1faad1
|
Better progress message
|
2018-12-14 23:20:32 -08:00 |
|
Girish Ramakrishnan
|
d43106b0af
|
Add taskworker that runs funcs out of process
|
2018-12-09 10:06:22 -08:00 |
|
Girish Ramakrishnan
|
c72ea91743
|
make task args an object and put it in eventlog
|
2018-11-30 14:57:24 -08:00 |
|
Girish Ramakrishnan
|
b0ecdcc8b6
|
Fix another crash
|
2018-11-30 10:03:16 -08:00 |
|
Girish Ramakrishnan
|
df927eae74
|
move backupupload.js to scripts
it is just a sudo helper
|
2018-11-29 23:30:56 -08:00 |
|
Girish Ramakrishnan
|
30aea047e3
|
startTask now takes args
|
2018-11-29 23:28:26 -08:00 |
|
Girish Ramakrishnan
|
fca0e897b2
|
Add tasks.startTask
|
2018-11-29 16:21:04 -08:00 |
|
Girish Ramakrishnan
|
2f729b56fa
|
Use result in db instead of ipc
|
2018-11-29 15:34:05 -08:00 |
|
Girish Ramakrishnan
|
d9f3f64c76
|
Store result and error message separately
|
2018-11-29 14:45:28 -08:00 |
|
Girish Ramakrishnan
|
632ba69663
|
Make restore/download logic have progress callbacks
|
2018-11-27 12:13:16 -08:00 |
|
Girish Ramakrishnan
|
b2465dd2ee
|
Set the backup task progress in the task only
|
2018-11-27 12:12:27 -08:00 |
|
Girish Ramakrishnan
|
e56b87766b
|
backupApp should not set backup task progress
|
2018-11-27 11:06:03 -08:00 |
|
Girish Ramakrishnan
|
f7ca2e416a
|
Add progress callback for snapshotting
|
2018-11-27 11:03:58 -08:00 |
|
Girish Ramakrishnan
|
002f68b0a1
|
Add progress info during backup rotation
|
2018-11-27 10:51:35 -08:00 |
|
Girish Ramakrishnan
|
aa31be5c5a
|
backup: make upload progress available with callback+ipc
|
2018-11-27 10:42:34 -08:00 |
|
Girish Ramakrishnan
|
581774e001
|
Use ipc to pass back the result
|
2018-11-26 20:39:52 -08:00 |
|
Girish Ramakrishnan
|
3847a6616e
|
No need to track backup time since it is killable now
|
2018-11-26 20:39:20 -08:00 |
|
Girish Ramakrishnan
|
a2da9bea58
|
backup: use ipc for communicating with upload process
|
2018-11-26 15:21:48 -08:00 |
|
Girish Ramakrishnan
|
802011bb7e
|
Fix args to shell.sudo
|
2018-11-25 14:57:51 -08:00 |
|
Girish Ramakrishnan
|
cce03e250d
|
these can just be debugs
|
2018-11-22 18:05:41 -08:00 |
|
Girish Ramakrishnan
|
9b32cad946
|
typoe
|
2018-11-22 17:26:06 -08:00 |
|
Girish Ramakrishnan
|
ec08ccb996
|
move tasks to separate directory
these are just wrappers that we use to launch as processes
|
2018-11-19 21:17:04 -08:00 |
|
Girish Ramakrishnan
|
b47a146c2b
|
unlock on log failure
|
2018-11-19 21:12:58 -08:00 |
|
Girish Ramakrishnan
|
218739a6b5
|
Add tasks table and API
progress will be tracked with this table instead of being in-process
like progress.js
|
2018-11-19 17:37:42 -08:00 |
|
Girish Ramakrishnan
|
8267279779
|
backup can now be stopped
track the backup process and killable
|
2018-11-17 20:31:07 -08:00 |
|
Girish Ramakrishnan
|
6d971b9235
|
backupupload also logs to stdout now
|
2018-11-17 19:38:02 -08:00 |
|
Girish Ramakrishnan
|
98dc160886
|
remove the progress and watchdog timers
not needed since we will track these processes now and can be killed
by the user.
|
2018-11-17 19:38:02 -08:00 |
|
Girish Ramakrishnan
|
a869c88b43
|
Remove setBackupProgress
the upload task can just output to stdout. for progress status, we
can just use a tailstream on the ui side
|
2018-11-17 19:38:02 -08:00 |
|
Girish Ramakrishnan
|
0b86070fe9
|
run backuptask as separate process
|
2018-11-17 19:38:02 -08:00 |
|
Girish Ramakrishnan
|
d7a11ef394
|
runBackupTask -> runBackupUpload
|
2018-11-16 09:21:07 -08:00 |
|
Girish Ramakrishnan
|
6abd48d480
|
rename backuptask to backupupload
|
2018-11-15 12:00:51 -08:00 |
|
Girish Ramakrishnan
|
a504759b95
|
more debugs and comments
|
2018-09-26 12:39:33 -07:00 |
|