toolshed/abra
4
3
Fork 21
Code Issues 38 Pull Requests 4 Packages Releases 42 Activity

abra catalogue generate doesn't see all tags #740

New Issue
Closed
opened 2025-12-28 01:43:30 +00:00 by 3wordchant · 2 comments
3wordchant commented 2025-12-28 01:43:30 +00:00
Owner
Copy Link
➜ abra catalogue generate peertube -d
DEBU <cli/run.go:137> abra version: dev, commit: c41df874, lang: en
DEBU <git/branch.go:99> successfully checked out refs/heads/main in /home/user/.abra/catalogue
DEBU <catalogue/catalogue.go:84> fetched latest git changes for /home/user/.abra/catalogue
DEBU <recipe/recipe.go:406> read recipe catalogue from file system cache in /home/user/.abra/catalogue/recipes.json
DEBU <git/read.go:149> read global ignore paths: .DS_Store *.swp *.swo *.pyc /doc/tags /.envrc .~*# /.rgignore .netcoredbg_hist /.crush /.crush.json /CRUSH.md
DEBU <git/read.go:52> git status: /home/user/.abra/recipes/peertube: clean
WARN <internal/validate.go:79> yaml: unmarshal errors:
  line 40: mapping key "restart_policy" already defined at line 33
DEBU <internal/validate.go:88> validated peertube as recipe argument
DEBU <git/read.go:149> read global ignore paths: .DS_Store *.swp *.swo *.pyc /doc/tags /.envrc .~*# /.rgignore .netcoredbg_hist /.crush /.crush.json /CRUSH.md
DEBU <git/read.go:52> git status: /home/user/.abra/catalogue: clean
DEBU <recipe/recipe.go:555> fetching repo metadata from https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=1
DEBU <web/client.go:17> [DEBUG] GET https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=1
DEBU <recipe/recipe.go:555> fetching repo metadata from https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=2
DEBU <web/client.go:17> [DEBUG] GET https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=2
DEBU <recipe/recipe.go:555> fetching repo metadata from https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=3
DEBU <web/client.go:17> [DEBUG] GET https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=3
DEBU <recipe/recipe.go:555> fetching repo metadata from https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=4
DEBU <web/client.go:17> [DEBUG] GET https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=4
DEBU <recipe/recipe.go:555> fetching repo metadata from https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=5
DEBU <web/client.go:17> [DEBUG] GET https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=5
DEBU <recipe/recipe.go:555> fetching repo metadata from https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=6
DEBU <web/client.go:17> [DEBUG] GET https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=6
DEBU <recipe/recipe.go:555> fetching repo metadata from https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=7
DEBU <web/client.go:17> [DEBUG] GET https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=7
DEBU <recipe/recipe.go:555> fetching repo metadata from https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=8
DEBU <web/client.go:17> [DEBUG] GET https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=8
DEBU <git/read.go:149> read global ignore paths: .DS_Store *.swp *.swo *.pyc /doc/tags /.envrc .~*# /.rgignore .netcoredbg_hist /.crush /.crush.json /CRUSH.md
DEBU <git/read.go:52> git status: /home/user/.abra/recipes/peertube: clean
DEBU <git/clone.go:89> git clone: /home/user/.abra/recipes/peertube already exists
DEBU <git/read.go:149> read global ignore paths: .DS_Store *.swp *.swo *.pyc /doc/tags /.envrc .~*# /.rgignore .netcoredbg_hist /.crush /.crush.json /CRUSH.md
DEBU <git/read.go:52> git status: /home/user/.abra/recipes/peertube: clean
DEBU <recipe/git.go:378> git: opening repository in /home/user/.abra/recipes/peertube
DEBU <recipe/git.go:398> processing 1.0.0+v3.4.1-buster for peertube
DEBU <recipe/git.go:410> git checkout: refs/tags/1.0.0+v3.4.1-buster in /home/user/.abra/recipes/peertube
DEBU <formatter/formatter.go:238> stripped library/redis to redis for parsing
DEBU <formatter/formatter.go:238> stripped library/postgres to postgres for parsing
DEBU <formatter/formatter.go:238> stripped library/nginx to nginx for parsing
DEBU <recipe/git.go:398> processing 2.0.0+v4.0.0-bullseye for peertube
DEBU <recipe/git.go:410> git checkout: refs/tags/2.0.0+v4.0.0-bullseye in /home/user/.abra/recipes/peertube
DEBU <formatter/formatter.go:238> stripped library/redis to redis for parsing
DEBU <formatter/formatter.go:238> stripped library/postgres to postgres for parsing
DEBU <formatter/formatter.go:238> stripped library/nginx to nginx for parsing
DEBU <recipe/git.go:398> processing 2.1.0+v4.1.0-bullseye for peertube
DEBU <recipe/git.go:410> git checkout: refs/tags/2.1.0+v4.1.0-bullseye in /home/user/.abra/recipes/peertube
DEBU <formatter/formatter.go:238> stripped library/redis to redis for parsing
DEBU <formatter/formatter.go:238> stripped library/postgres to postgres for parsing
DEBU <formatter/formatter.go:238> stripped library/nginx to nginx for parsing
DEBU <recipe/git.go:398> processing 2.1.1+v4.1.1-bullseye for peertube
DEBU <recipe/git.go:410> git checkout: refs/tags/2.1.1+v4.1.1-bullseye in /home/user/.abra/recipes/peertube
DEBU <formatter/formatter.go:238> stripped library/redis to redis for parsing
DEBU <formatter/formatter.go:238> stripped library/postgres to postgres for parsing
DEBU <formatter/formatter.go:238> stripped library/nginx to nginx for parsing
DEBU <recipe/git.go:398> processing 2.2.0+v4.2.2-bullseye for peertube
DEBU <recipe/git.go:410> git checkout: refs/tags/2.2.0+v4.2.2-bullseye in /home/user/.abra/recipes/peertube
DEBU <formatter/formatter.go:238> stripped library/redis to redis for parsing
DEBU <formatter/formatter.go:238> stripped library/postgres to postgres for parsing
DEBU <formatter/formatter.go:238> stripped library/nginx to nginx for parsing
DEBU <recipe/git.go:398> processing 3.0.0+v4.3.0-bullseye for peertube
DEBU <recipe/git.go:410> git checkout: refs/tags/3.0.0+v4.3.0-bullseye in /home/user/.abra/recipes/peertube
DEBU <recipe/recipe.go:237> /home/user/.abra/recipes/peertube/README.md: attempt recipe metadata parse
DEBU <git/branch.go:99> successfully checked out refs/heads/main in /home/user/.abra/catalogue
DEBU <catalogue/catalogue.go:84> fetched latest git changes for /home/user/.abra/catalogue
DEBU <recipe/recipe.go:406> read recipe catalogue from file system cache in /home/user/.abra/catalogue/recipes.json
INFO <catalogue/catalogue.go:219> generated recipe catalogue: /home/user/.abra/catalogue/recipes.json

So it's missing many of these exciting tags:

➜ git tag -n1 -l
1.0.0+v3.4.1-buster chore: publish first release
2.0.0+v4.0.0-bullseye chore: publish 2.0.0+v4.0.0-bullseye release
2.1.0+v4.1.0-bullseye chore: publish 2.1.0+v4.1.0-bullseye release
2.1.1+v4.1.1-bullseye chore: publish 2.1.1+v4.1.1-bullseye release
2.2.0+v4.2.2-bullseye chore: publish 2.2.0+v4.2.2-bullseye release
3.0.0+v4.3.0-bullseye chore: publish 3.0.0+v4.3.0-bullseye release
4.0.0+v5.0.1-bullseye Major upgrade
4.1.0+v5.2.1-bullseye chore: publish 4.1.0+v5.2.1-bullseye release
5.0.0+v5.2.1-bullseye chore: publish 5.0.0+v5.2.1-bullseye release
5.0.1+v5.2.1-bullseye chore: publish 5.0.1+v5.2.1-bullseye release
6.0.0+v6.0.0-bookworm chore: publish 6.0.0+v6.0.0-bookworm release
6.0.1+v6.0.0-bookworm chore: publish 6.0.1+v6.0.0-bookworm release
6.0.2+v6.0.4-bookworm add tag
6.1.0+v6.3.3-bookworm chore: publish 6.1.0+v6.3.3-bookworm release
6.1.0+v7.3.0-bookworm chore: publish 6.1.0+v7.3.0-bookworm release
6.1.1+v6.3.3-bookworm chore: publish 6.1.1+v6.3.3-bookworm release
7.0.0+v7.0.1-bookworm chore: publish 7.0.0+v7.0.1-bookworm release
7.1.0+v7.1.1-bookworm chore: publish 7.1.0+v7.1.1-bookworm release
7.2.0+v7.3.0-bookworm chore: publish 7.2.0+v7.3.0-bookworm release

This is on abra version dev-c41df87

``` ➜ abra catalogue generate peertube -d DEBU <cli/run.go:137> abra version: dev, commit: c41df874, lang: en DEBU <git/branch.go:99> successfully checked out refs/heads/main in /home/user/.abra/catalogue DEBU <catalogue/catalogue.go:84> fetched latest git changes for /home/user/.abra/catalogue DEBU <recipe/recipe.go:406> read recipe catalogue from file system cache in /home/user/.abra/catalogue/recipes.json DEBU <git/read.go:149> read global ignore paths: .DS_Store *.swp *.swo *.pyc /doc/tags /.envrc .~*# /.rgignore .netcoredbg_hist /.crush /.crush.json /CRUSH.md DEBU <git/read.go:52> git status: /home/user/.abra/recipes/peertube: clean WARN <internal/validate.go:79> yaml: unmarshal errors: line 40: mapping key "restart_policy" already defined at line 33 DEBU <internal/validate.go:88> validated peertube as recipe argument DEBU <git/read.go:149> read global ignore paths: .DS_Store *.swp *.swo *.pyc /doc/tags /.envrc .~*# /.rgignore .netcoredbg_hist /.crush /.crush.json /CRUSH.md DEBU <git/read.go:52> git status: /home/user/.abra/catalogue: clean DEBU <recipe/recipe.go:555> fetching repo metadata from https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=1 DEBU <web/client.go:17> [DEBUG] GET https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=1 DEBU <recipe/recipe.go:555> fetching repo metadata from https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=2 DEBU <web/client.go:17> [DEBUG] GET https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=2 DEBU <recipe/recipe.go:555> fetching repo metadata from https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=3 DEBU <web/client.go:17> [DEBUG] GET https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=3 DEBU <recipe/recipe.go:555> fetching repo metadata from https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=4 DEBU <web/client.go:17> [DEBUG] GET https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=4 DEBU <recipe/recipe.go:555> fetching repo metadata from https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=5 DEBU <web/client.go:17> [DEBUG] GET https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=5 DEBU <recipe/recipe.go:555> fetching repo metadata from https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=6 DEBU <web/client.go:17> [DEBUG] GET https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=6 DEBU <recipe/recipe.go:555> fetching repo metadata from https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=7 DEBU <web/client.go:17> [DEBUG] GET https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=7 DEBU <recipe/recipe.go:555> fetching repo metadata from https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=8 DEBU <web/client.go:17> [DEBUG] GET https://git.coopcloud.tech/api/v1/orgs/coop-cloud/repos?page=8 DEBU <git/read.go:149> read global ignore paths: .DS_Store *.swp *.swo *.pyc /doc/tags /.envrc .~*# /.rgignore .netcoredbg_hist /.crush /.crush.json /CRUSH.md DEBU <git/read.go:52> git status: /home/user/.abra/recipes/peertube: clean DEBU <git/clone.go:89> git clone: /home/user/.abra/recipes/peertube already exists DEBU <git/read.go:149> read global ignore paths: .DS_Store *.swp *.swo *.pyc /doc/tags /.envrc .~*# /.rgignore .netcoredbg_hist /.crush /.crush.json /CRUSH.md DEBU <git/read.go:52> git status: /home/user/.abra/recipes/peertube: clean DEBU <recipe/git.go:378> git: opening repository in /home/user/.abra/recipes/peertube DEBU <recipe/git.go:398> processing 1.0.0+v3.4.1-buster for peertube DEBU <recipe/git.go:410> git checkout: refs/tags/1.0.0+v3.4.1-buster in /home/user/.abra/recipes/peertube DEBU <formatter/formatter.go:238> stripped library/redis to redis for parsing DEBU <formatter/formatter.go:238> stripped library/postgres to postgres for parsing DEBU <formatter/formatter.go:238> stripped library/nginx to nginx for parsing DEBU <recipe/git.go:398> processing 2.0.0+v4.0.0-bullseye for peertube DEBU <recipe/git.go:410> git checkout: refs/tags/2.0.0+v4.0.0-bullseye in /home/user/.abra/recipes/peertube DEBU <formatter/formatter.go:238> stripped library/redis to redis for parsing DEBU <formatter/formatter.go:238> stripped library/postgres to postgres for parsing DEBU <formatter/formatter.go:238> stripped library/nginx to nginx for parsing DEBU <recipe/git.go:398> processing 2.1.0+v4.1.0-bullseye for peertube DEBU <recipe/git.go:410> git checkout: refs/tags/2.1.0+v4.1.0-bullseye in /home/user/.abra/recipes/peertube DEBU <formatter/formatter.go:238> stripped library/redis to redis for parsing DEBU <formatter/formatter.go:238> stripped library/postgres to postgres for parsing DEBU <formatter/formatter.go:238> stripped library/nginx to nginx for parsing DEBU <recipe/git.go:398> processing 2.1.1+v4.1.1-bullseye for peertube DEBU <recipe/git.go:410> git checkout: refs/tags/2.1.1+v4.1.1-bullseye in /home/user/.abra/recipes/peertube DEBU <formatter/formatter.go:238> stripped library/redis to redis for parsing DEBU <formatter/formatter.go:238> stripped library/postgres to postgres for parsing DEBU <formatter/formatter.go:238> stripped library/nginx to nginx for parsing DEBU <recipe/git.go:398> processing 2.2.0+v4.2.2-bullseye for peertube DEBU <recipe/git.go:410> git checkout: refs/tags/2.2.0+v4.2.2-bullseye in /home/user/.abra/recipes/peertube DEBU <formatter/formatter.go:238> stripped library/redis to redis for parsing DEBU <formatter/formatter.go:238> stripped library/postgres to postgres for parsing DEBU <formatter/formatter.go:238> stripped library/nginx to nginx for parsing DEBU <recipe/git.go:398> processing 3.0.0+v4.3.0-bullseye for peertube DEBU <recipe/git.go:410> git checkout: refs/tags/3.0.0+v4.3.0-bullseye in /home/user/.abra/recipes/peertube DEBU <recipe/recipe.go:237> /home/user/.abra/recipes/peertube/README.md: attempt recipe metadata parse DEBU <git/branch.go:99> successfully checked out refs/heads/main in /home/user/.abra/catalogue DEBU <catalogue/catalogue.go:84> fetched latest git changes for /home/user/.abra/catalogue DEBU <recipe/recipe.go:406> read recipe catalogue from file system cache in /home/user/.abra/catalogue/recipes.json INFO <catalogue/catalogue.go:219> generated recipe catalogue: /home/user/.abra/catalogue/recipes.json ``` So it's missing many of these exciting tags: ``` ➜ git tag -n1 -l 1.0.0+v3.4.1-buster chore: publish first release 2.0.0+v4.0.0-bullseye chore: publish 2.0.0+v4.0.0-bullseye release 2.1.0+v4.1.0-bullseye chore: publish 2.1.0+v4.1.0-bullseye release 2.1.1+v4.1.1-bullseye chore: publish 2.1.1+v4.1.1-bullseye release 2.2.0+v4.2.2-bullseye chore: publish 2.2.0+v4.2.2-bullseye release 3.0.0+v4.3.0-bullseye chore: publish 3.0.0+v4.3.0-bullseye release 4.0.0+v5.0.1-bullseye Major upgrade 4.1.0+v5.2.1-bullseye chore: publish 4.1.0+v5.2.1-bullseye release 5.0.0+v5.2.1-bullseye chore: publish 5.0.0+v5.2.1-bullseye release 5.0.1+v5.2.1-bullseye chore: publish 5.0.1+v5.2.1-bullseye release 6.0.0+v6.0.0-bookworm chore: publish 6.0.0+v6.0.0-bookworm release 6.0.1+v6.0.0-bookworm chore: publish 6.0.1+v6.0.0-bookworm release 6.0.2+v6.0.4-bookworm add tag 6.1.0+v6.3.3-bookworm chore: publish 6.1.0+v6.3.3-bookworm release 6.1.0+v7.3.0-bookworm chore: publish 6.1.0+v7.3.0-bookworm release 6.1.1+v6.3.3-bookworm chore: publish 6.1.1+v6.3.3-bookworm release 7.0.0+v7.0.1-bookworm chore: publish 7.0.0+v7.0.1-bookworm release 7.1.0+v7.1.1-bookworm chore: publish 7.1.0+v7.1.1-bookworm release 7.2.0+v7.3.0-bookworm chore: publish 7.2.0+v7.3.0-bookworm release ``` This is on `abra version dev-c41df87`
nicksellen commented 2025-12-28 15:07:23 +00:00
Copy Link

(copying from matrix comment thread --> https://matrix.to/#/!DfXPgKLoYCvjHithgS:autonomic.zone/$yDGA2ECsQzrVIwsydC4kK5cJ8V-2_qhBYV7oyYlWwFc?via=autonomic.zone&via=matrix.org&via=pub.solar)

ok I dug into it a bit, I think it is because of the broken gitea recipe, and it works locally because you probably already have a gitea repo in ~/.abra/recipes/gitea

I ran the drone plugin locally, and when it gets to gitea it bails with:
FATA <recipe/recipe.go:675> pkt-line 3: EOF

... and it does that locally now after removing my local gitea git repo, and upgrading abra (before it also bailed with with a different error log)

minimal way to recreate from local drone repo:

# run locally
docker run --entrypoint=/bin/bash -it git.coopcloud.tech/toolshed/drone-abra:latest

# now inside container can do a minimal version of what the drone plugin runs
apk add git
abra catalogue generate -d

should end with:

DEBU <git/clone.go:87> git clone: /root/.abra/recipes/gitea cloned successfully
FATA <recipe/recipe.go:675> pkt-line 3: EOF

thats with abra abra version dev-bddf803

might be nice of someone could make it resilient in the case of corrupt repo, although probably simplest given this to just fix/delete/recreate the broken gitea repo, and that's where my access runs out!

(copying from matrix comment thread --> https://matrix.to/#/!DfXPgKLoYCvjHithgS:autonomic.zone/$yDGA2ECsQzrVIwsydC4kK5cJ8V-2_qhBYV7oyYlWwFc?via=autonomic.zone&via=matrix.org&via=pub.solar) ok I dug into it a bit, I think it is because of the broken gitea recipe, and it works locally because you probably already have a gitea repo in ~/.abra/recipes/gitea I ran the drone plugin locally, and when it gets to gitea it bails with: `FATA <recipe/recipe.go:675> pkt-line 3: EOF` ... and it does that locally now after removing my local gitea git repo, and upgrading abra (before it also bailed with with a different error log) minimal way to recreate from local drone repo: ``` # run locally docker run --entrypoint=/bin/bash -it git.coopcloud.tech/toolshed/drone-abra:latest # now inside container can do a minimal version of what the drone plugin runs apk add git abra catalogue generate -d ``` should end with: ``` DEBU <git/clone.go:87> git clone: /root/.abra/recipes/gitea cloned successfully FATA <recipe/recipe.go:675> pkt-line 3: EOF ``` thats with abra `abra version dev-bddf803` might be nice of someone could make it resilient in the case of corrupt repo, although probably simplest given this to just fix/delete/recreate the broken gitea repo, and that's where my access runs out!
decentral1se added the
bug
 label 2026-01-01 17:44:02 +00:00
decentral1se commented 2026-01-01 18:12:25 +00:00
Owner
Copy Link

We unborked that Gitea recipe repository, catalogue generation is back: 5bdaa14364

We unborked that Gitea recipe repository, catalogue generation is back: https://git.coopcloud.tech/toolshed/recipes-catalogue-json/commit/5bdaa14364920c14334c8682d8d2b00ea39c4e20
decentral1se added this to the Abra "next" project 2026-01-01 18:12:31 +00:00
decentral1se moved this to Done in Abra "next" on 2026-01-01 18:12:34 +00:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
Something is not working
build
go build related issues
ci/cd
Building things with CI/CD
critical fix
https://docs.coopcloud.tech/federation/resolutions/passed/010/
design
UI/UX
documentation
Documenting all the things
duplicate
This issue or pull request already exists
easy-first-issue
Something for new people to get stuck into. We hope it's easy!
enhancement
New feature
help wanted
Need some help
i10n
Everything to do with localisation
i18n
Everything to do with internationalisation
installer
Everything to do with the install script.
invalid
Something is wrong
question
More information is needed
release
Release management
release-candidate
Related to the new release candidate
security
Security related
test
Unit/integration testing
wontfix
This won't be fixed
No Label
bug
Milestone
No items
No Milestone
Projects
Clear projects
No project Abra "next"
Assignees
Clear assignees
3wordchant aadil abra-bot ammaratef45 Apfelwurm carla cas coopcloud cyrnel decentral1se fauno iexos jade jmakdah2 joe-irving kawaiipunk knoflook kolaente lambdabundesverband linnealovespie moritz notplants p4u1 pharaohgraphy renovate-bot ripclap simon sixsmith trav val yksflip
No Assignees
3 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: toolshed/abra#740
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?