Launchpad itself

multiple "output" and "series" doubles the job output

Bug #1999591 reported by Corey Bryant
24
This bug affects 4 people
Affects Status Importance Assigned to Milestone
Launchpad itself
Fix Released
Low
Simone Pelosi

Bug Description

I have something similar to the following for .launchpad.yaml (this is simplified for example but still recreates):

pipeline:
- ubuntu-build
- ubuntu-autopkgtest
- cloud-archive-build
- cloud-archive-autopkgtest

jobs:
    ubuntu-build:
        series: jammy
        architectures: amd64
        run: |
          apt build-dep ./ --yes
          dpkg-buildpackage -b -uc -us
          mv ../*.deb ../*.changes ./
        output:
          paths: ["*.deb", "*.changes"]

    ubuntu-autopkgtest:
        series: jammy
        architectures: amd64
        packages:
          - autopkgtest
        input:
          job-name: ubuntu-build
          target-directory: ./
        run: |
          autopkgtest ./files/*.changes -- null

    cloud-archive-build:
        series: focal
        architectures: amd64
        run: |
          apt build-dep ./ --yes
          dpkg-buildpackage -b -uc -us
          mv ../*.deb ../*.changes ./
        output:
          paths: ["*.deb", "*.changes"]

    cloud-archive-autopkgtest:
        series: focal
        architectures: amd64
        packages:
          - autopkgtest
        input:
          job-name: cloud-archive-build
          target-directory: ./
        run: |
          autopkgtest ./files/*.changes -- null

This results in 8 jobs running rather than the expected 4. See screenshot attached.

See original description

Related branches

~pelpsi/launchpad:duplicate_ci_jobs
Colin Watson (community): Approve
Diff: 383 lines (+290/-8)
2 files modified
lib/lp/code/model/cibuild.py (+37/-8)
lib/lp/code/model/tests/test_cibuild.py (+253/-0)
Revision history for this message
Corey Bryant (corey.bryant) wrote :
description: updated
Jürgen Gmach (jugmac00)
Changed in lpcraft:
status: New → Triaged
importance: Undecided → Low
Revision history for this message
Jürgen Gmach (jugmac00) wrote (last edit ):

Corey, thanks for reporting this issue.

I was able to reproduce it, but only in CI with the following configuration file - lpcraft on its own works correctly.
see https://code.launchpad.net/~jugmac00/lpcraft/+git/lpcraft/+merge/434636

```
pipeline:
- aa
- cc

jobs:
    aa:
        series: jammy
        architectures: amd64
        run: |
          echo "1111"
    cc:
        series: focal
        architectures: amd64
        run: |
          echo "3333"
```

This results in 4 builds, see https://code.launchpad.net/~jugmac00/lpcraft/+git/lpcraft/+ref/reproduce-bug-1999591

Colin suspects an issue in Launchpad itself, see https://chat.canonical.com/canonical/pl/1urdsf4dkpgwppg35f343d8ekr

Let's keep the issue here until this is verified.

Revision history for this message
Corey Bryant (corey.bryant) wrote :

Thanks for taking a looks so quickly!

Jürgen Gmach (jugmac00)
Changed in lpcraft:
assignee: nobody → Jürgen Gmach (jugmac00)
status: Triaged → In Progress
affects: lpcraft → launchpad
Jürgen Gmach (jugmac00)
Changed in launchpad:
status: In Progress → Triaged
Revision history for this message
Dimitri John Ledkov (xnox) wrote (last edit ):

Note in the reproducer it seems to be a duplicate set of displayed attached jobs, whilst the build is the same.

[SUCCEEDED] aa:0 (build) => https://code.launchpad.net/~jugmac00/lpcraft/+git/lpcraft/+build/16481
[SUCCEEDED] cc:0 (build) =>
https://code.launchpad.net/~jugmac00/lpcraft/+git/lpcraft/+build/16481
[SUCCEEDED] aa:0 (build) =>
https://code.launchpad.net/~jugmac00/lpcraft/+git/lpcraft/+build/16482
[SUCCEEDED] cc:0 (build) =>
https://code.launchpad.net/~jugmac00/lpcraft/+git/lpcraft/+build/16482

so somehow 2 builds got dispatched, and both of them build both of the jobs.
it was not 4 builds.

What is the correct expected behaviour for the reproducer?
- dispatch only 1 build, that executes both jobs, and attaches two results
- dispatch two builds, one for each job, and each build attaches one result

It feels like
jobs:
- [aa, bb] => should be one build, with two results
- aa => should be one build with one result
- bb => should be one build with one result

based on expected documentation.

Colin Watson (cjwatson)
Changed in launchpad:
assignee: Jürgen Gmach (jugmac00) → Simone Pelosi (pelpsi)
status: Triaged → In Progress
Simone Pelosi (pelpsi)
Changed in launchpad:
status: In Progress → Fix Committed
Colin Watson (cjwatson)
Changed in launchpad:
status: Fix Committed → Fix Released
Revision history for this message
Dan Ryan (techalchemy) wrote :

Hey there,

I've been attempting rebuilds of https://code.launchpad.net/~ubuntu-security/soss/+source/python-coverage/+git/python-coverage/+ref/sbu/6.4.4-multiplat which builds on focal/jammy arm+amd64 and am still seeing this duplication with the fix release

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.