Girish Ramakrishnan
8a5b24afff
Make tarPack and tarExtract have consistent style
2018-12-20 11:49:37 -08:00
Girish Ramakrishnan
0a7f1faad1
Better progress message
2018-12-14 23:20:32 -08:00
Girish Ramakrishnan
d43106b0af
Add taskworker that runs funcs out of process
2018-12-09 10:06:22 -08:00
Girish Ramakrishnan
c72ea91743
make task args an object and put it in eventlog
2018-11-30 14:57:24 -08:00
Girish Ramakrishnan
b0ecdcc8b6
Fix another crash
2018-11-30 10:03:16 -08:00
Girish Ramakrishnan
df927eae74
move backupupload.js to scripts
...
it is just a sudo helper
2018-11-29 23:30:56 -08:00
Girish Ramakrishnan
30aea047e3
startTask now takes args
2018-11-29 23:28:26 -08:00
Girish Ramakrishnan
fca0e897b2
Add tasks.startTask
2018-11-29 16:21:04 -08:00
Girish Ramakrishnan
2f729b56fa
Use result in db instead of ipc
2018-11-29 15:34:05 -08:00
Girish Ramakrishnan
d9f3f64c76
Store result and error message separately
2018-11-29 14:45:28 -08:00
Girish Ramakrishnan
632ba69663
Make restore/download logic have progress callbacks
2018-11-27 12:13:16 -08:00
Girish Ramakrishnan
b2465dd2ee
Set the backup task progress in the task only
2018-11-27 12:12:27 -08:00
Girish Ramakrishnan
e56b87766b
backupApp should not set backup task progress
2018-11-27 11:06:03 -08:00
Girish Ramakrishnan
f7ca2e416a
Add progress callback for snapshotting
2018-11-27 11:03:58 -08:00
Girish Ramakrishnan
002f68b0a1
Add progress info during backup rotation
2018-11-27 10:51:35 -08:00
Girish Ramakrishnan
aa31be5c5a
backup: make upload progress available with callback+ipc
2018-11-27 10:42:34 -08:00
Girish Ramakrishnan
581774e001
Use ipc to pass back the result
2018-11-26 20:39:52 -08:00
Girish Ramakrishnan
3847a6616e
No need to track backup time since it is killable now
2018-11-26 20:39:20 -08:00
Girish Ramakrishnan
a2da9bea58
backup: use ipc for communicating with upload process
2018-11-26 15:21:48 -08:00
Girish Ramakrishnan
802011bb7e
Fix args to shell.sudo
2018-11-25 14:57:51 -08:00
Girish Ramakrishnan
cce03e250d
these can just be debugs
2018-11-22 18:05:41 -08:00
Girish Ramakrishnan
9b32cad946
typoe
2018-11-22 17:26:06 -08:00
Girish Ramakrishnan
ec08ccb996
move tasks to separate directory
...
these are just wrappers that we use to launch as processes
2018-11-19 21:17:04 -08:00
Girish Ramakrishnan
b47a146c2b
unlock on log failure
2018-11-19 21:12:58 -08:00
Girish Ramakrishnan
218739a6b5
Add tasks table and API
...
progress will be tracked with this table instead of being in-process
like progress.js
2018-11-19 17:37:42 -08:00
Girish Ramakrishnan
8267279779
backup can now be stopped
...
track the backup process and killable
2018-11-17 20:31:07 -08:00
Girish Ramakrishnan
6d971b9235
backupupload also logs to stdout now
2018-11-17 19:38:02 -08:00
Girish Ramakrishnan
98dc160886
remove the progress and watchdog timers
...
not needed since we will track these processes now and can be killed
by the user.
2018-11-17 19:38:02 -08:00
Girish Ramakrishnan
a869c88b43
Remove setBackupProgress
...
the upload task can just output to stdout. for progress status, we
can just use a tailstream on the ui side
2018-11-17 19:38:02 -08:00
Girish Ramakrishnan
0b86070fe9
run backuptask as separate process
2018-11-17 19:38:02 -08:00
Girish Ramakrishnan
d7a11ef394
runBackupTask -> runBackupUpload
2018-11-16 09:21:07 -08:00
Girish Ramakrishnan
6abd48d480
rename backuptask to backupupload
2018-11-15 12:00:51 -08:00
Girish Ramakrishnan
a504759b95
more debugs and comments
2018-09-26 12:39:33 -07:00
Girish Ramakrishnan
ec9c96da6f
Fix comments
2018-09-04 10:48:54 -07:00
Girish Ramakrishnan
8bd6c9933f
Add interval secs
...
Part of #568
2018-08-13 22:35:38 -07:00
Girish Ramakrishnan
1ed4710c68
Better error message
2018-08-05 23:38:49 -07:00
Girish Ramakrishnan
ef5dc7311f
Do not encrypt empty path
2018-07-31 19:41:03 -07:00
Girish Ramakrishnan
498642b670
Fix debugs
2018-07-31 19:32:56 -07:00
Girish Ramakrishnan
a1070b7da3
storage: fix file not found message
2018-07-30 07:47:52 -07:00
Girish Ramakrishnan
3067d87ca9
handle decryption errors
2018-07-29 21:01:20 -07:00
Girish Ramakrishnan
f546d53ca2
gcs: add listDir
...
part of #440
2018-07-28 03:51:32 -07:00
Girish Ramakrishnan
a5daad2e1a
rsync: encrypted download (fs backend)
...
Part of #440
2018-07-27 16:06:13 -07:00
Girish Ramakrishnan
b3c8767d79
rsync: encrypted upload (fs backend)
...
Part of #440
2018-07-27 15:34:48 -07:00
Girish Ramakrishnan
f97f528f05
backup: Implement downloadDir using listDir
2018-07-27 15:24:35 -07:00
Girish Ramakrishnan
df98847535
Remove backupDone from storage interface
...
This is only used by caas
2018-07-27 12:08:19 -07:00
Girish Ramakrishnan
6adf88a6e5
Make uploads work with very slow upload speeds
...
chunk uploads get a timeout of 2mins (derived from http.timeout).
On servers like kimsufi, uploads takes forever (100 MB/sec limit).
Currently, our upload code does not dynamically adapt itself to
changing the concurrency when network is slow.
2018-03-20 19:37:45 -07:00
Girish Ramakrishnan
7699f6721d
Add hack to figure out the position in the queue
...
this helps us track the progress a bit in the logs
2018-03-20 19:37:35 -07:00
Girish Ramakrishnan
565eed015f
Add better backup logs
2018-03-20 16:41:45 -07:00
Girish Ramakrishnan
98e19e6df5
fix upload errors causing double callback
2018-02-27 19:16:03 -08:00
Girish Ramakrishnan
f5d426fd69
debug out the progress message
2018-02-22 11:11:36 -08:00
