Girish Ramakrishnan
|
d8ff2488a3
|
Make syncer work with a layout
|
2019-01-19 20:39:49 -08:00 |
|
Girish Ramakrishnan
|
a0b69df20d
|
Add DataLayout class to help with path xforms
|
2019-01-18 17:13:25 -08:00 |
|
Girish Ramakrishnan
|
57aa3de9bb
|
typo
|
2019-01-18 15:18:46 -08:00 |
|
Girish Ramakrishnan
|
fcc77635c2
|
retry must wrap the download function as well
|
2019-01-18 14:31:30 -08:00 |
|
Girish Ramakrishnan
|
ab35821b59
|
saveFsMetadata: make it work with a layout
|
2019-01-17 14:55:37 -08:00 |
|
Girish Ramakrishnan
|
a915348b22
|
Return correct error code when already locked
|
2019-01-17 10:58:38 -08:00 |
|
Girish Ramakrishnan
|
13c628b58b
|
backups (tgz): work with a layout
this will allow us to place the localstorage directory in an arbitrary
location
|
2019-01-16 12:52:04 -08:00 |
|
Girish Ramakrishnan
|
3500236d32
|
sync concurrency cannot be very high
|
2019-01-15 20:44:09 -08:00 |
|
Girish Ramakrishnan
|
2f881c0c91
|
log download errors
|
2019-01-15 12:01:12 -08:00 |
|
Girish Ramakrishnan
|
ee65089eb7
|
s3: make copying and uploading significantly faster
|
2019-01-14 13:47:07 -08:00 |
|
Girish Ramakrishnan
|
40c7d18382
|
Fix upload progress message
|
2019-01-14 12:23:03 -08:00 |
|
Girish Ramakrishnan
|
3236a9a5b7
|
backup: retry rsync file downloads
fixes #608
|
2019-01-14 11:57:10 -08:00 |
|
Girish Ramakrishnan
|
d0522d7d4f
|
backups: retry tgz downloads
Part of #608
|
2019-01-14 11:36:11 -08:00 |
|
Girish Ramakrishnan
|
e63b67b99e
|
resolve any boxdata symlink
|
2019-01-13 15:17:02 -08:00 |
|
Girish Ramakrishnan
|
172d4b7c5e
|
backup: store cleanup result properly
|
2019-01-12 15:17:04 -08:00 |
|
Girish Ramakrishnan
|
2acb065d38
|
Track what the the backup cleaner removed
|
2019-01-11 14:09:43 -08:00 |
|
Girish Ramakrishnan
|
c021d3d9ce
|
backup: add retry only if > 1
|
2019-01-11 11:07:19 -08:00 |
|
Girish Ramakrishnan
|
79f9180f6b
|
run backup cleanup as a task
|
2019-01-10 16:07:06 -08:00 |
|
Girish Ramakrishnan
|
766ef5f420
|
remove spurious argument
|
2019-01-10 16:02:15 -08:00 |
|
Girish Ramakrishnan
|
7b64b2a708
|
do-spaces: Limit download concurrency
https://www.digitalocean.com/community/questions/rate-limiting-on-spaces?answer=40441
|
2019-01-09 15:09:29 -08:00 |
|
Girish Ramakrishnan
|
d9309cb215
|
Use a separate event for tarExtract
|
2018-12-22 21:23:20 -08:00 |
|
Girish Ramakrishnan
|
433c34e4ce
|
better debugs
|
2018-12-22 21:23:17 -08:00 |
|
Girish Ramakrishnan
|
0a74bd1718
|
add note on saveFsMetadata
|
2018-12-20 15:11:15 -08:00 |
|
Girish Ramakrishnan
|
8a5b24afff
|
Make tarPack and tarExtract have consistent style
|
2018-12-20 11:49:37 -08:00 |
|
Girish Ramakrishnan
|
0a7f1faad1
|
Better progress message
|
2018-12-14 23:20:32 -08:00 |
|
Girish Ramakrishnan
|
d43106b0af
|
Add taskworker that runs funcs out of process
|
2018-12-09 10:06:22 -08:00 |
|
Girish Ramakrishnan
|
c72ea91743
|
make task args an object and put it in eventlog
|
2018-11-30 14:57:24 -08:00 |
|
Girish Ramakrishnan
|
b0ecdcc8b6
|
Fix another crash
|
2018-11-30 10:03:16 -08:00 |
|
Girish Ramakrishnan
|
df927eae74
|
move backupupload.js to scripts
it is just a sudo helper
|
2018-11-29 23:30:56 -08:00 |
|
Girish Ramakrishnan
|
30aea047e3
|
startTask now takes args
|
2018-11-29 23:28:26 -08:00 |
|
Girish Ramakrishnan
|
fca0e897b2
|
Add tasks.startTask
|
2018-11-29 16:21:04 -08:00 |
|
Girish Ramakrishnan
|
2f729b56fa
|
Use result in db instead of ipc
|
2018-11-29 15:34:05 -08:00 |
|
Girish Ramakrishnan
|
d9f3f64c76
|
Store result and error message separately
|
2018-11-29 14:45:28 -08:00 |
|
Girish Ramakrishnan
|
632ba69663
|
Make restore/download logic have progress callbacks
|
2018-11-27 12:13:16 -08:00 |
|
Girish Ramakrishnan
|
b2465dd2ee
|
Set the backup task progress in the task only
|
2018-11-27 12:12:27 -08:00 |
|
Girish Ramakrishnan
|
e56b87766b
|
backupApp should not set backup task progress
|
2018-11-27 11:06:03 -08:00 |
|
Girish Ramakrishnan
|
f7ca2e416a
|
Add progress callback for snapshotting
|
2018-11-27 11:03:58 -08:00 |
|
Girish Ramakrishnan
|
002f68b0a1
|
Add progress info during backup rotation
|
2018-11-27 10:51:35 -08:00 |
|
Girish Ramakrishnan
|
aa31be5c5a
|
backup: make upload progress available with callback+ipc
|
2018-11-27 10:42:34 -08:00 |
|
Girish Ramakrishnan
|
581774e001
|
Use ipc to pass back the result
|
2018-11-26 20:39:52 -08:00 |
|
Girish Ramakrishnan
|
3847a6616e
|
No need to track backup time since it is killable now
|
2018-11-26 20:39:20 -08:00 |
|
Girish Ramakrishnan
|
a2da9bea58
|
backup: use ipc for communicating with upload process
|
2018-11-26 15:21:48 -08:00 |
|
Girish Ramakrishnan
|
802011bb7e
|
Fix args to shell.sudo
|
2018-11-25 14:57:51 -08:00 |
|
Girish Ramakrishnan
|
cce03e250d
|
these can just be debugs
|
2018-11-22 18:05:41 -08:00 |
|
Girish Ramakrishnan
|
9b32cad946
|
typoe
|
2018-11-22 17:26:06 -08:00 |
|
Girish Ramakrishnan
|
ec08ccb996
|
move tasks to separate directory
these are just wrappers that we use to launch as processes
|
2018-11-19 21:17:04 -08:00 |
|
Girish Ramakrishnan
|
b47a146c2b
|
unlock on log failure
|
2018-11-19 21:12:58 -08:00 |
|
Girish Ramakrishnan
|
218739a6b5
|
Add tasks table and API
progress will be tracked with this table instead of being in-process
like progress.js
|
2018-11-19 17:37:42 -08:00 |
|
Girish Ramakrishnan
|
8267279779
|
backup can now be stopped
track the backup process and killable
|
2018-11-17 20:31:07 -08:00 |
|
Girish Ramakrishnan
|
6d971b9235
|
backupupload also logs to stdout now
|
2018-11-17 19:38:02 -08:00 |
|