feat: opt-in Loki index store migration from deprecated boltdb-shipper to TSDB #56

2026-10-29T12:00:47Z

dannygroenewegen commented

2026-10-29 12:00:47 +00:00

The boltdb-shipper store in scheme-config is deprecated and will be removed in Loki 4.0. This commit adds an opt-in to move to TSDB.

Setting LOKI_TSDB_FROM_DATE in <app>.env adds a second schema_config period with the TSDB store from that date onward, alongside the existing boltdb-shipper, so logs before the cutover stay queryable under the old store while new logs are indexed with TSDB.

It's important to pick a future day for LOKI_TSDB_FROM_DATE, e.g. the day after you first deploy this env: Both stores share the same
per-day table, so a past or same-day date makes them collide over that day's data and breaks querying it.

The boltdb-shipper store in scheme-config is deprecated and will be removed in Loki 4.0. This commit adds an opt-in to move to TSDB. Setting `LOKI_TSDB_FROM_DATE` in `<app>.env` adds a second schema_config period with the TSDB store from that date onward, alongside the existing boltdb-shipper, so logs before the cutover stay queryable under the old store while new logs are indexed with TSDB. It's important to pick a future day for `LOKI_TSDB_FROM_DATE`, e.g. the day after you first deploy this env: Both stores share the same per-day table, so a past or same-day date makes them collide over that day's data and breaks querying it.

dannygroenewegen added 1 commit 2026-10-29 12:00:48 +00:00

feat: opt-in Loki index store migration from deprecated boltdb-shipper to TSDB e708e418ba

boltdb-shipper is deprecated and will be removed in Loki 4.0.
Setting LOKI_TSDB_FROM_DATE adds a second schema_config period (store:
tsdb) from that date onward, alongside the existing boltdb-shipper
period, so logs before the cutover stay queryable under the old store
while new logs are indexed with TSDB.

CODEOWNERS rules requested review from monitoring-ng-maintainers 2026-10-29 12:00:48 +00:00

fauno reviewed

2026-10-29 14:06:37 +00:00

fauno left a comment

looks good! i haven't had time to properly test loki yet. are you running it? i had to do some changes for getting it to start but i couldn't commit them yet.

fauno approved these changes

2026-10-29 14:07:06 +00:00

fauno left a comment

sorry, i meant to approve it

fauno added 1 commit 2026-10-30 13:54:14 +00:00

Merge branch 'main' into loki-tsdb 28a5091aed

CODEOWNERS rules requested review from monitoring-ng-maintainers 2026-10-30 13:54:15 +00:00

fauno merged commit 09dd411989 into main

2026-10-30 13:54:55 +00:00

fauno deleted branch loki-tsdb

2026-10-30 13:54:56 +00:00

Sign in to join this conversation.

2 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: coop-cloud/monitoring-ng#56