77 Commits
Author SHA1 Message Date
simon 0eab632ec4 chore: publish 2.1.0+v1.18.1 release 2.1.0+v1.18.1 2026-09-17 16:05:27 +02:00
simon e5f57c97f1 Split image tags, relabel journald logs (#30)
Reviewed-on: coop-cloud/monitoring-ng#30
Reviewed-by: ammaratef45 <ammaratef45@proton.me>
Co-authored-by: Simon <s.thiessen@local-it.org>
2026-09-17 13:38:45 +00:00
simon a7014f72ae chore: publish 2.0.0+v1.18.1 release 2.0.0+v1.18.1 2026-09-08 17:31:55 +02:00
simon f48aa64193 make disk usage per container metric optional (#29)
Following the discussion from the matrix channel, I made the disk usage metrics optional, as it currently causes ~35% of cpu usage on our system.

[Old cadvisor-config](02b01e5c23/compose.yml) from this repo had a `- "--housekeeping_interval=120s"` option enabled which seems currently not configurable for alloy - maybe this allows us reenabling disk metrics at a later point again.

dropped from 35% to 5% when removing `disk` from
`  enabled_metrics = ["cpu", "cpuLoad", "diskIO", "memory", "network"]` for cadvisor.

go profiling:

```
File: alloy
Build ID: de7ba8978f6753c25c13f6886ab3b896d3b05d3f
Type: cpu
Time: Sep 7, 2026 at 12:53pm (CEST)
Duration: 120s, Total samples = 37.23s (31.02%)
Showing nodes accounting for 32.20s, 86.49% of 37.23s total
Dropped 790 nodes (cum <= 0.19s)
      flat  flat%   sum%        cum   cum%
    28.72s 77.14% 77.14%     28.72s 77.14%  internal/runtime/syscall/linux.Syscall6
     0.47s  1.26% 78.40%      0.48s  1.29%  internal/filepathlite.(*lazybuf).append (inline)
     0.30s  0.81% 79.21%      0.94s  2.52%  internal/filepathlite.Clean
     0.26s   0.7% 79.91%      0.26s   0.7%  runtime.nextFreeFast (inline)
     0.23s  0.62% 80.53%      0.23s  0.62%  runtime.futex
     0.21s  0.56% 81.09%      0.21s  0.56%  runtime.memclrNoHeapPointers
     0.21s  0.56% 81.65%      0.21s  0.56%  runtime.memmove
     0.19s  0.51% 82.16%      6.19s 16.63%  os.(*File).readdir
     0.17s  0.46% 82.62%     31.24s 83.91%  path/filepath.walk
     0.12s  0.32% 82.94%      0.20s  0.54%  runtime.exitsyscall
     0.08s  0.21% 83.16%      0.24s  0.64%  runtime.scanObject
     0.08s  0.21% 83.37%      0.24s  0.64%  runtime.sweepone
     0.08s  0.21% 83.59%      0.29s  0.78%  slices.pdqsortOrdered[go.shape.string]
     0.07s  0.19% 83.78%      0.27s  0.73%  runtime.makeslicecopy
     0.06s  0.16% 83.94%     28.48s 76.50%  syscall.RawSyscall6
     0.05s  0.13% 84.07%      0.27s  0.73%  github.com/google/cadvisor/fs.GetDirUsage.func1
     0.05s  0.13% 84.21%     19.99s 53.69%  os.lstatNolog
     0.05s  0.13% 84.34%      1.26s  3.38%  runtime.mallocgc
     0.05s  0.13% 84.47%      0.43s  1.15%  runtime.mallocgcSmallNoscan
     0.04s  0.11% 84.58%      0.46s  1.24%  runtime.newobject
     0.04s  0.11% 84.69%      0.19s  0.51%  runtime.selectgo
     0.04s  0.11% 84.80%      1.18s  3.17%  runtime.systemstack
```

Reviewed-on: coop-cloud/monitoring-ng#29
Reviewed-by: Danny Groenewegen <247+dannygroenewegen@noreply.git.coopcloud.tech>
Co-authored-by: Simon <s.thiessen@local-it.org>
2026-09-08 14:25:47 +00:00
faunoanddannygroenewegen ff56438d7c BREAKING CHANGES: replace promtail and cadvisor for alloy (#21)
closes #20

---------

Co-authored-by: Danny Groenewegen <danny@ecommons.space>
Reviewed-on: coop-cloud/monitoring-ng#21
Reviewed-by: ammaratef45 <ammaratef45@proton.me>
Reviewed-by: Danny Groenewegen <247+dannygroenewegen@noreply.git.coopcloud.tech>
Co-authored-by: f <f@sutty.nl>
2026-09-02 22:57:39 +00:00
p4u1 02b01e5c23 feat: make alerts configurable (#19)
Alert threshholds can now be configured via env variables

I also seperated the basic auth, so that it is possible to deploy only prometheus without promtail

Reviewed-on: coop-cloud/monitoring-ng#19
Reviewed-by: ammaratef45 <ammaratef45@proton.me>
Reviewed-by: Danny Groenewegen <dannygroenewegen@noreply.git.coopcloud.tech>
Co-authored-by: p4u1 <p4u1_f4u1@riseup.net>
Co-committed-by: p4u1 <p4u1_f4u1@riseup.net>
2026-06-12 06:49:17 +00:00
p4u1 fce8ea5889 docs: Update deploy docs and adds prometheus basic auth back (#7)
Reviewed-on: coop-cloud/monitoring-ng#7
Reviewed-by: Danny Groenewegen <dannygroenewegen@noreply.git.coopcloud.tech>
Co-authored-by: p4u1 <p4u1_f4u1@riseup.net>
Co-committed-by: p4u1 <p4u1_f4u1@riseup.net>
2026-06-12 06:48:39 +00:00
moritz dd320e9f1c fix: Shorten all secret and config names to max 14 characters (#13)
Reviewed-on: coop-cloud/monitoring-ng#13
Reviewed-by: p4u1 <p4u1@noreply.git.coopcloud.tech>
Reviewed-by: moritz <moritz@noreply.git.coopcloud.tech>
2026-05-11 15:38:15 +00:00
ammaratef45 9cb997b25a delete_request_store based on env variable 2026-04-09 04:36:03 +00:00
ammaratef45 48d137d194 update loki config file 2026-04-09 04:36:03 +00:00
ammaratef45 1acb5ebd6a chore: update image tags 2026-04-09 04:36:03 +00:00
dannygroenewegen 682f30cef1 Add migrate_secret_names() to abra.sh to reinsert all secrets with shortened names in docker 2026-03-25 16:11:37 +01:00
dannygroenewegen 694c8a9875 Add instructions for shorter secret names to release notes 2026-03-25 16:11:28 +01:00
dannygroenewegen 9dfa9cad2a Shortened all the secret and config names to max 14 characters to prevent running into Docker's 64 character limit when STACK_NAME is appended to it. 2026-03-25 15:58:28 +01:00
dannygroenewegen 99f8790ec4 fix: Update scape-config example to use HTTPS for Traefik metrics (#17)
This fixes the insecure Traefik metrics endpoint. See coop-cloud/traefik#94 for details.

Reviewed-on: coop-cloud/monitoring-ng#17
Co-authored-by: Danny Groenewegen <mail@dannygroenewegen.nl>
Co-committed-by: Danny Groenewegen <mail@dannygroenewegen.nl>
2026-03-24 09:37:05 +00:00
p4u1 310c28e735 refactor: provision alerts instead of putting them in the /var/lib folder (#16)
Note that I did not copy the backupbot alert since this one gets a rework soon

Reviewed-on: coop-cloud/monitoring-ng#16
Co-authored-by: p4u1 <p4u1_f4u1@riseup.net>
Co-committed-by: p4u1 <p4u1_f4u1@riseup.net>
2026-03-20 14:10:10 +00:00
ammaratef45andp4u1 16bd65f417 fix recipe part in the domain (#8)
I created a new app using this recipe and the domain wasn't automatically replaced, I'm guessing cause the part before the root domain didn't match the recipe name?

Just opening a PR real quick so I can get back to it and test the fix later when I have cycles

Co-authored-by: p4u1 <p4u1@noreply.git.coopcloud.tech>
Reviewed-on: coop-cloud/monitoring-ng#8
Reviewed-by: p4u1 <p4u1@noreply.git.coopcloud.tech>
Co-authored-by: ammaratef45 <ammaratef45@proton.me>
Co-committed-by: ammaratef45 <ammaratef45@proton.me>
2026-03-20 09:23:36 +00:00
Apfelwurm 97ebcf306a add all mountpoints to free disk space in Docker Swarm dashboard (#4)
Until now, only / and /media were monitored in the Docker Swarm dashboard. We removed the filters and changed the dashboard to a time series, so multiple mounts can be shown at once.
We also updated the alert, so it also triggers on all mount ext4 points.

Reviewed-on: coop-cloud/monitoring-ng#4
Co-authored-by: Apfelwurm <Alexander@volzit.de>
Co-committed-by: Apfelwurm <Alexander@volzit.de>
2026-03-20 09:15:52 +00:00
p4u1 f93370b9ca Moves oidc to a seperate compose config (#6)
Otherwise the secret has to be provided when oidc is not used

Reviewed-on: coop-cloud/monitoring-ng#6
Co-authored-by: p4u1 <p4u1_f4u1@riseup.net>
Co-committed-by: p4u1 <p4u1_f4u1@riseup.net>
2026-03-20 09:10:48 +00:00
iexos 83461e2e76 remove default TIMEOUT (abra #596) 2025-12-30 13:53:47 +01:00
p4u1 7dbe5bf22e fix: Removes duplicate basic auth from prometheus and a few other improvements 2025-02-21 18:31:54 +01:00
p4u1 89b5fef6ac chore: publish 1.6.0+v1.8.1 release 1.6.0+v1.8.1 2025-02-21 17:23:06 +01:00
p4u1 cd42c64544 feat: Adds option to expose ports for node and cadvisor service 2025-02-21 17:21:46 +01:00
p4u1 70719dbee8 chore: publish 1.5.0+v1.8.1 release 1.5.0+v1.8.1 2025-02-18 16:04:21 +01:00
p4u1 8900ace6a2 feat: Adds matrix contact point for grafana alerts 2025-02-18 16:03:47 +01:00
p4u1 8b464156bd chore: publish 1.4.0+v1.8.1 release 1.4.0+v1.8.1 2025-02-17 12:18:39 +01:00
p4u1 73c4ec3e74 feat: Adds optional GRAFANA_DOMAIN 2025-02-17 12:16:29 +01:00
moritz 225899785b Merge pull request 'feat: Adds dashboard and alerts for backupbot' (#2) from backup-dashboard into main
Reviewed-on: coop-cloud/monitoring-ng#2
2025-01-14 13:35:29 +00:00
p4u1 0352a393de feat: Adds dashboard and alerts for backupbot 2024-12-30 14:43:30 +01:00
p4u1 92e7bbc730 chore: publish 1.3.0+v1.8.1 release 1.3.0+v1.8.1 2024-12-28 13:55:05 +01:00
p4u1 5bf3d31c0f docs: Improves documentation for pushgateway 2024-12-28 13:53:31 +01:00
p4u1 a14cb575a2 fix: shorten names for dashboard files 2024-12-21 14:37:10 +01:00
p4u1 1a59dfac7f add pushgateway 2024-12-21 14:23:50 +01:00
moritz a9b76dff65 update backupbot label 2024-10-24 17:32:29 +02:00
moritz 0401de1d16 chore: publish 1.2.0+v1.8.1 release 1.2.0+v1.8.1 2024-07-17 13:36:04 +02:00
moritz aa133fcfea add backup label 2024-04-17 16:02:38 +02:00
moritz 3750e75439 chore: publish 1.1.0+v1.7.0 release 1.1.0+v1.7.0 2024-04-16 16:45:42 +02:00
moritz 5d0b6d88fc fix default DOMAIN naming scheme 2024-01-19 12:30:58 +01:00
moritz c06dda7205 chore: publish 1.0.0+v1.7.0 release 1.0.0+v1.7.0 2023-12-21 02:24:47 +01:00
moritz b497b4ce4e shorten config names 2023-12-21 01:43:44 +01:00
moritz 29b3fcd7d1 update grafana dashboards 2023-12-21 01:43:44 +01:00
moritz d4c6bd4c12 shorten basic_auth secret 2023-12-20 22:46:27 +01:00
moritz 42c3695bf3 add diskIO and process metrics 2023-12-20 17:34:41 +01:00
philippr 74498b70fe update grafana dashboards 2023-07-31 16:28:44 +02:00
philippr 961a17f1ad chore: publish 0.3.0+v1.6.0 release 0.3.0+v1.6.0 2023-07-11 14:59:37 +02:00
philippr d549c33fe5 chore: publish 0.2.0+v1.5.0 release 0.2.0+v1.5.0 2023-06-26 11:44:10 +02:00
philippr 9a791ef794 feat: add hostname label to promtail logs 2023-06-26 11:43:26 +02:00
philippr 7a0292f902 fix: grafana smtp stuff 2023-06-20 16:04:40 +02:00
philippr 705934abc1 fix: increase loki limits 2023-06-20 16:03:57 +02:00
philippr b091bf1951 add process to cadvisor metrics 2023-06-14 14:02:35 +02:00