Girish Ramakrishnan
aae52ec795
backups: remove periodic dumping of heap info
...
this has not been as useful as I expected
2022-11-05 08:32:38 +01:00
Girish Ramakrishnan
8bc3b832e7
detect oom in tasks correctly
2022-11-02 22:39:25 +01:00
Girish Ramakrishnan
80a3ca0f46
remove 16.04 related task logic
2022-11-02 21:22:42 +01:00
Girish Ramakrishnan
0f0a98f7ac
Add TimeoutStopSec=10s for systemctl kill to work faster
2022-11-02 18:46:20 +01:00
Girish Ramakrishnan
4fe0402735
box data is separate from mail data already
2022-10-12 11:59:28 +02:00
Girish Ramakrishnan
656f3fcc13
add system.du
2022-10-11 23:06:54 +02:00
Girish Ramakrishnan
3caffdb4e1
Rework app stats
...
Previously, the du plugin was collecting data every 20 seconds but
carbon was configured to only keep data every 12 hours causing much
confusion.
In the process of reworking this, it was determined:
* No need to collect disk usage info over time. Not sure how that is useful
* Instead, collect CPU/Network/Block info over time. We get this now from docker stats
* We also collect info about the services (addon containers)
* No need to reconfigure collectd for each app change anymore since there is no per
app collectd configuration anymore.
2022-10-10 21:13:26 +02:00
Girish Ramakrishnan
9f788c2c57
backup: reduce memory logs
2022-10-01 20:16:08 +02:00
Girish Ramakrishnan
a32166bc9d
data dir: allow sameness of old and new dir
...
this makes it easy to migrate to a new volume setup
2022-06-09 17:49:33 -07:00
Girish Ramakrishnan
037f4195da
guard against two level subdir moves
...
this has never worked since the -wholename check only works for
one level deep
2022-06-08 12:24:11 -07:00
Girish Ramakrishnan
6311c78bcd
Fix quoting
2022-06-08 11:25:20 -07:00
Girish Ramakrishnan
7598cf2baf
consolidate storage validation logic
2022-06-06 12:50:21 -07:00
Girish Ramakrishnan
90a6ad8cf5
support: new keys (ed25519)
...
rsa keys are slowly going away
2022-04-29 12:37:27 -07:00
Girish Ramakrishnan
8ef730ad9c
backuptask: make upload/download async
2022-04-28 21:37:08 -07:00
Girish Ramakrishnan
452a4d9a75
backups: add remotePath
...
the main motivation is that id can be used in REST API routes. previously,
the id was a path and this had a "/" in it. This made /api/v1/backups/:backupId
not work.
2022-04-04 20:40:40 -07:00
Girish Ramakrishnan
773dfd9a7b
ipv6 support in firewall allow and block lists
2022-02-16 13:39:35 -08:00
Girish Ramakrishnan
ee3d1b3697
remove unused var
2022-01-27 09:16:46 -08:00
Johannes Zellner
d69758e559
Only set ldap allowlist if file exists and is not empty
2021-12-15 19:23:22 +01:00
Johannes Zellner
1c7eeb6ac6
Handle exposed ldap allowlist
2021-12-10 17:04:30 +01:00
Girish Ramakrishnan
f505fdd5cb
remove the space
2021-11-02 18:07:45 -07:00
Girish Ramakrishnan
6cb041bcb2
Print readable sizes in the log
2021-11-02 17:51:27 -07:00
Johannes Zellner
9eed3af8b6
add volume remount
2021-10-11 16:22:56 +02:00
Girish Ramakrishnan
004e812d60
merge backupdb into backups.js
2021-07-14 15:10:45 -07:00
Girish Ramakrishnan
1ce4875db1
volumes: set hostPath based on volume id
...
this is required for the file browser to work which does operations
based on the id
fixes #789
2021-06-24 17:32:41 -07:00
Girish Ramakrishnan
15ff43369f
mount: if unmount failed, do not proceed
2021-06-22 13:03:44 -07:00
Girish Ramakrishnan
6ace8d1ac5
volumes: fix various mount related issues
...
Various notes on mounting:
* The permissions come from the mounted file system and not the mount point.
This means that if we change the perms before mounting, it is overridden by
whatever is in the actual file system.
* uid/gid only works for permission-less file systems
SFTP container notes:
* Assumes that nothing changed if the host path hasn't changed. This means that
if a user changes the disk uuid, reload doesn't work.
* Not sure how/why, but even after unmounting the container can still access the old
mount files (!). With ext4 on disk change or nfs after root path change, the file manager
continues to be able to access the old mounts (despite umount succeeding).
All this led to following changes:
* Remove editing of volumes. Just allow editing username/password.
* edit UI then just also provides a way to re-mount.
* Change mode of mountpoint to be 777 post mounting for ease of use. Otherwise, we have to
make the user do this by ssh. this can always become options later.
2021-06-21 16:11:48 -07:00
Girish Ramakrishnan
c16a7c1f45
do not block for service to restart
2021-06-21 10:05:22 -07:00
Girish Ramakrishnan
87c22a4670
mount: mount as 777 for max compat
...
for cifs, file_mode can be 666
2021-06-20 22:48:37 -07:00
Girish Ramakrishnan
90657af7f2
mount: fix nfs re-mounting
2021-06-18 23:48:39 -07:00
Girish Ramakrishnan
a34bdb9ddf
backups: fix mounting logic of backup settings and cloudron restore
2021-05-27 13:52:05 -07:00
Girish Ramakrishnan
0a5a24ba2e
add tryAddMount
...
we try to add a mount. if it fails, it will revert to the previous mount config.
there was a plan to make this work based on systemd-mount but we hit this bug - https://bugzilla.redhat.com/show_bug.cgi?id=1708996
2021-05-21 22:32:51 -07:00
Girish Ramakrishnan
8cb7c8cd1c
volumes fixes
2021-05-14 10:26:57 -07:00
Girish Ramakrishnan
88a5526e9b
starttask: set NODE_OPTIONS instead of env -S
2021-05-14 09:36:00 -07:00
Johannes Zellner
5e48b69d3b
Revert "taskworker: Use --unhandled-rejections=strict"
...
Breaks the task argument count
This reverts commit b7643ae3b3 .
2021-05-14 11:13:52 +02:00
Johannes Zellner
a43e804ee2
Revert "taskworker: put the arg in shebang line"
...
Not supported on ubuntu 18
This reverts commit e6edc4e999 .
2021-05-14 10:51:37 +02:00
Girish Ramakrishnan
e6edc4e999
taskworker: put the arg in shebang line
...
otherwise, it gets passed as an arg to the script and is visible in process.argv!
2021-05-13 22:49:15 -07:00
Girish Ramakrishnan
b7643ae3b3
taskworker: Use --unhandled-rejections=strict
...
this way, those tasks crash and do not hang on bad code
2021-05-13 22:32:12 -07:00
Girish Ramakrishnan
50407eba0b
volumes: generate systemd mount files based on mount type
2021-05-12 23:57:12 -07:00
Girish Ramakrishnan
7de454911e
migrate firewall configuration into database
...
the ports.json is for the moment server specific
2021-05-04 15:55:54 -07:00
Girish Ramakrishnan
5833d6ed5d
Fix failing dns and network test
2021-04-14 21:43:51 -07:00
Girish Ramakrishnan
0447dce0d6
graphite: restart collectd as well
2021-03-23 16:34:36 -07:00
Girish Ramakrishnan
32f385741a
graphite: implement upgrade
...
for the moment, we wipe out the old data and start afresh. this is because
the graphite web app keeps changing quite drastically.
2021-03-23 16:34:32 -07:00
Girish Ramakrishnan
7a6a170451
remove retire.sh
2021-02-25 10:32:53 -08:00
Girish Ramakrishnan
a63c2cfdf2
reverse this since it makes better reading
2020-11-05 16:08:57 -08:00
Girish Ramakrishnan
8f78a9dcde
No need to pass --expose-gc
...
http://sambal.org/2014/02/passing-options-node-shebang-line/ was a cool trick but not needed at all.
https://bitbucket.org/chromiumembedded/cef/issues/483/dont-always-add-the-expose-gc-v8-flag
says it will change behavior in ways we don't want.
2020-11-05 16:07:28 -08:00
Girish Ramakrishnan
f79263a92a
backups: periodically dump heap space info
2020-11-05 16:06:09 -08:00
Girish Ramakrishnan
f9f44b18ad
suppress reset-failed warning message
2020-10-12 10:08:07 -07:00
Johannes Zellner
dd75cdb37e
Don't explicitly sync the filesystems on reboot
...
This will happen during unmount anyways but will first terminate all
processes
2020-09-25 19:11:15 +02:00
Girish Ramakrishnan
4dfa7b132d
ignore duplicates
2020-09-14 13:53:58 -07:00
Girish Ramakrishnan
fb5bfaa2bd
read does not read last line without a newline
2020-09-14 13:52:10 -07:00