Commit Graph
121 Commits
Author SHA1 Message Date
fauno 085992dab0 fix: remove unneeded flag 2026-11-05 15:30:11 -03:00
fauno 40d31a535f fix: read only access 2026-11-05 15:30:02 -03:00
fauno 6db3afa97c fix: smartctl needs access to /dev closes #52 2026-11-03 18:42:58 -03:00
fauno f130a61bd2 chore: publish 2.3.0+v1.21.3 release 2.3.0+v1.21.3 2026-10-30 11:08:21 -03:00
fauno 7d7060c308 fix: unless-stopped is not a restart policy supported by swarm 2026-10-30 11:07:49 -03:00
fauno d3cc5977db chore(deps): update grafana/grafana docker tag to v13.3.0 (#50)
Reviewed-on: #50
Reviewed-by: fauno <fauno@sutty.coop.ar>
2026-10-30 14:07:10 +00:00
fauno 05b5b3d742 chore(deps): update grafana/alloy docker tag to v1.21.3 (#51)
Reviewed-on: #51
Reviewed-by: fauno <fauno@sutty.coop.ar>
2026-10-30 14:05:57 +00:00
fauno 09dd411989 feat: opt-in Loki index store migration from deprecated boltdb-shipper to TSDB (#56)
Reviewed-on: #56
Reviewed-by: fauno <fauno@sutty.coop.ar>
2026-10-30 13:54:54 +00:00
fauno 28a5091aed Merge branch 'main' into loki-tsdb 2026-10-30 10:54:08 -03:00
fauno 56caa14fcf chore(deps): update grafana/loki docker tag to v3.7.9 (#38)
Reviewed-on: #38
Reviewed-by: fauno <fauno@sutty.coop.ar>
2026-10-30 13:53:18 +00:00
fauno 5c65a257fc feat: improve loki debugging (#37)
Reviewed-on: #37
Reviewed-by: simon <135+simon@noreply.git.coopcloud.tech>
Reviewed-by: fauno <fauno@sutty.coop.ar>
2026-10-30 13:52:43 +00:00
fauno d0d600ca4e Merge branch 'main' into loki-debugging 2026-10-30 10:52:10 -03:00
fauno cbd98fae7b chore(deps): update prom/prometheus docker tag to v3.15.1 (#53)
Reviewed-on: #53
Reviewed-by: fauno <fauno@sutty.coop.ar>
2026-10-30 13:49:05 +00:00
p4u1 25f811bd4f feat(alert): adds traefik apdex alert (#49)
Reviewed-on: #49
Reviewed-by: ammaratef45 <ammaratef45@proton.me>
Reviewed-by: fauno <fauno@sutty.coop.ar>
Co-authored-by: p4u1 <p4u1_f4u1@riseup.net>
2026-10-30 13:48:38 +00:00
renovate-bot 6ec83806e1 chore(deps): update grafana/alloy docker tag to v1.21.3 2026-10-30 07:20:43 +00:00
dannygroenewegen e708e418ba feat: opt-in Loki index store migration from deprecated boltdb-shipper to TSDB
boltdb-shipper is deprecated and will be removed in Loki 4.0.
Setting LOKI_TSDB_FROM_DATE adds a second schema_config period (store:
tsdb) from that date onward, alongside the existing boltdb-shipper
period, so logs before the cutover stay queryable under the old store
while new logs are indexed with TSDB.
2026-10-29 12:44:30 +01:00
renovate-bot d6f5e7ebf6 chore(deps): update grafana/grafana docker tag to v13.3.0 2026-10-27 09:16:38 +00:00
ammaratef45 8c7afe5d8f increase grafana healthcheck start_period and reduce error logs 2026-10-26 17:40:03 +00:00
ammaratef45 ebcb12163f alloy and prometheus restart-policy update 2026-10-23 23:17:11 -07:00
renovate-bot ace2d6d76d chore(deps): update prom/prometheus docker tag to v3.15.1 2026-10-21 14:19:00 +00:00
renovate-bot b508b13366 chore(deps): update grafana/loki docker tag to v3.7.9 2026-10-20 23:16:59 +00:00
fauno aa61e17bae fix(alert): invert memory usage alert (#48)
Reviewed-on: #48
Reviewed-by: fauno <fauno@sutty.coop.ar>
2026-10-13 13:55:45 +00:00
p4u1 c76f327cdb change folder to monitoring 2026-10-12 20:30:07 +02:00
fauno 48e8318e41 chore: publish 2.3.0+v1.20.1 release 2026-10-12 13:11:16 -03:00
fauno 298efcfb50 Merge branch 'main' of https://git.coopcloud.tech/coop-cloud/monitoring-ng 2026-10-12 13:10:24 -03:00
fauno 4ab976a0f0 chore(deps): update prometheuscommunity/smartctl-exporter docker tag to v0.15.0 (#46)
Reviewed-on: #46
Reviewed-by: fauno <fauno@sutty.coop.ar>
2026-10-12 16:09:28 +00:00
fauno 8665af7d91 chore(deps): update grafana/grafana docker tag to v13.2.3 (#43)
Reviewed-on: #43
Reviewed-by: fauno <fauno@sutty.coop.ar>
2026-10-12 16:08:11 +00:00
renovate-bot 24927d6331 chore(deps): update grafana/grafana docker tag to v13.2.3 2026-10-12 16:07:57 +00:00
fauno 06521e98cf chore(deps): update grafana/alloy docker tag to v1.20.1 (#42)
Reviewed-on: #42
Reviewed-by: fauno <fauno@sutty.coop.ar>
2026-10-12 16:04:23 +00:00
fauno b322d8fb84 chore(deps): update prom/prometheus docker tag to v3.15.0 (#45)
Reviewed-on: #45
Reviewed-by: fauno <fauno@sutty.coop.ar>
2026-10-12 16:02:08 +00:00
p4u1 01111b992d fix(alert): invert memory usage alert 2026-10-12 13:02:52 +02:00
renovate-bot 0a749fe4fe chore(deps): update prometheuscommunity/smartctl-exporter docker tag to v0.15.0 2026-10-12 03:16:50 +00:00
renovate-bot f980185f8f chore(deps): update prom/prometheus docker tag to v3.15.0 2026-10-12 03:16:46 +00:00
renovate-bot 5028630b04 chore(deps): update grafana/alloy docker tag to v1.20.1 2026-10-12 01:16:59 +00:00
fauno b58e52873a chore: Configure Renovate (#11)
Reviewed-on: #11
2026-10-11 23:39:19 +00:00
fauno 1babe0c7e8 feat: smart monitoring (#25)
it requires a helper script on the host because swarm doesn't support privileged mode

Reviewed-on: #25
Reviewed-by: Danny Groenewegen <247+dannygroenewegen@noreply.git.coopcloud.tech>
Co-authored-by: f <f@sutty.nl>
2026-10-11 23:38:27 +00:00
p4u1 f8973c11fc feat: improve loki debugging 2026-10-10 14:44:30 +02:00
fauno e0172eaed8 fix: monitoring-ng (#35)
Reviewed-on: #35
Reviewed-by: Danny Groenewegen <247+dannygroenewegen@noreply.git.coopcloud.tech>
Reviewed-by: moritz <98+moritz@noreply.git.coopcloud.tech>
Co-authored-by: f <f@sutty.nl>
2026-10-08 18:42:28 +00:00
fauno e5028c8648 fix: monitoring-ng 2026-10-05 12:46:49 -03:00
fauno 343aa55f75 feat: maintainers closes #33 2026-09-28 15:30:29 -03:00
Linus Gasser 6b72f2e1f6 Increase timeout for healthcheck 2026-09-25 09:20:48 +00:00
simon 625e479c3d chore: publish 2.2.0+v1.18.1 release 2.2.0+v1.18.1 2026-09-22 12:43:11 +02:00
simon 779dee5a0d allow scraping of docker events (#32)
another one! closes #15

again, the compose-snippet was generated using Claude, but verified and tested manually.
Thought of using a socket-proxy just as traefik does, but since alloy has socket access anyways and the official docker image should be as safe as it gets, I think this should be alright.

## Loki log preview
![grafik.png](/attachments/013605e9-9abc-47ef-8cb9-c118fbaec3b5)

Reviewed-on: #32
Reviewed-by: moritz <98+moritz@noreply.git.coopcloud.tech>
Co-authored-by: Simon <s.thiessen@local-it.org>
2026-09-22 10:33:47 +00:00
simon 0eab632ec4 chore: publish 2.1.0+v1.18.1 release 2.1.0+v1.18.1 2026-09-17 16:05:27 +02:00
simon e5f57c97f1 Split image tags, relabel journald logs (#30)
Reviewed-on: #30
Reviewed-by: ammaratef45 <ammaratef45@proton.me>
Co-authored-by: Simon <s.thiessen@local-it.org>
2026-09-17 13:38:45 +00:00
simon a7014f72ae chore: publish 2.0.0+v1.18.1 release 2.0.0+v1.18.1 2026-09-08 17:31:55 +02:00
simon f48aa64193 make disk usage per container metric optional (#29)
Following the discussion from the matrix channel, I made the disk usage metrics optional, as it currently causes ~35% of cpu usage on our system.

[Old cadvisor-config](02b01e5c23/compose.yml) from this repo had a `- "--housekeeping_interval=120s"` option enabled which seems currently not configurable for alloy - maybe this allows us reenabling disk metrics at a later point again.

dropped from 35% to 5% when removing `disk` from
`  enabled_metrics = ["cpu", "cpuLoad", "diskIO", "memory", "network"]` for cadvisor.

go profiling:

```
File: alloy
Build ID: de7ba8978f6753c25c13f6886ab3b896d3b05d3f
Type: cpu
Time: Sep 7, 2026 at 12:53pm (CEST)
Duration: 120s, Total samples = 37.23s (31.02%)
Showing nodes accounting for 32.20s, 86.49% of 37.23s total
Dropped 790 nodes (cum <= 0.19s)
      flat  flat%   sum%        cum   cum%
    28.72s 77.14% 77.14%     28.72s 77.14%  internal/runtime/syscall/linux.Syscall6
     0.47s  1.26% 78.40%      0.48s  1.29%  internal/filepathlite.(*lazybuf).append (inline)
     0.30s  0.81% 79.21%      0.94s  2.52%  internal/filepathlite.Clean
     0.26s   0.7% 79.91%      0.26s   0.7%  runtime.nextFreeFast (inline)
     0.23s  0.62% 80.53%      0.23s  0.62%  runtime.futex
     0.21s  0.56% 81.09%      0.21s  0.56%  runtime.memclrNoHeapPointers
     0.21s  0.56% 81.65%      0.21s  0.56%  runtime.memmove
     0.19s  0.51% 82.16%      6.19s 16.63%  os.(*File).readdir
     0.17s  0.46% 82.62%     31.24s 83.91%  path/filepath.walk
     0.12s  0.32% 82.94%      0.20s  0.54%  runtime.exitsyscall
     0.08s  0.21% 83.16%      0.24s  0.64%  runtime.scanObject
     0.08s  0.21% 83.37%      0.24s  0.64%  runtime.sweepone
     0.08s  0.21% 83.59%      0.29s  0.78%  slices.pdqsortOrdered[go.shape.string]
     0.07s  0.19% 83.78%      0.27s  0.73%  runtime.makeslicecopy
     0.06s  0.16% 83.94%     28.48s 76.50%  syscall.RawSyscall6
     0.05s  0.13% 84.07%      0.27s  0.73%  github.com/google/cadvisor/fs.GetDirUsage.func1
     0.05s  0.13% 84.21%     19.99s 53.69%  os.lstatNolog
     0.05s  0.13% 84.34%      1.26s  3.38%  runtime.mallocgc
     0.05s  0.13% 84.47%      0.43s  1.15%  runtime.mallocgcSmallNoscan
     0.04s  0.11% 84.58%      0.46s  1.24%  runtime.newobject
     0.04s  0.11% 84.69%      0.19s  0.51%  runtime.selectgo
     0.04s  0.11% 84.80%      1.18s  3.17%  runtime.systemstack
```

Reviewed-on: #29
Reviewed-by: Danny Groenewegen <247+dannygroenewegen@noreply.git.coopcloud.tech>
Co-authored-by: Simon <s.thiessen@local-it.org>
2026-09-08 14:25:47 +00:00
faunoanddannygroenewegen ff56438d7c BREAKING CHANGES: replace promtail and cadvisor for alloy (#21)
closes #20

---------

Co-authored-by: Danny Groenewegen <danny@ecommons.space>
Reviewed-on: #21
Reviewed-by: ammaratef45 <ammaratef45@proton.me>
Reviewed-by: Danny Groenewegen <247+dannygroenewegen@noreply.git.coopcloud.tech>
Co-authored-by: f <f@sutty.nl>
2026-09-02 22:57:39 +00:00
p4u1 02b01e5c23 feat: make alerts configurable (#19)
Alert threshholds can now be configured via env variables

I also seperated the basic auth, so that it is possible to deploy only prometheus without promtail

Reviewed-on: #19
Reviewed-by: ammaratef45 <ammaratef45@proton.me>
Reviewed-by: Danny Groenewegen <dannygroenewegen@noreply.git.coopcloud.tech>
Co-authored-by: p4u1 <p4u1_f4u1@riseup.net>
Co-committed-by: p4u1 <p4u1_f4u1@riseup.net>
2026-06-12 06:49:17 +00:00
p4u1 fce8ea5889 docs: Update deploy docs and adds prometheus basic auth back (#7)
Reviewed-on: #7
Reviewed-by: Danny Groenewegen <dannygroenewegen@noreply.git.coopcloud.tech>
Co-authored-by: p4u1 <p4u1_f4u1@riseup.net>
Co-committed-by: p4u1 <p4u1_f4u1@riseup.net>
2026-06-12 06:48:39 +00:00