lp:~alextu/plainbox-provider-pc-sanity

Author: Alex Tu
Author Date: 2022-04-08 10:43:37 UTC

platform_meta_test: include jammy

Author: Alex Tu
Author Date: 2022-01-11 07:15:46 UTC

pc-sanity-software-test plan: add miscellanea/ubuntu-desktop-recommends for the test plan on VM

Author: Alex Tu
Author Date: 2022-01-04 15:22:02 UTC

removed the improved test cases base on the CI/CD meeting result

Please refer to the sheet for detail
https://docs.google.com/spreadsheets/d/1gHuPVgc-XTOp51Pa0kWLFynmWySRFEFCucg7cXMBi-I/edit#gid=0

Author: Alex Tu
Author Date: 2021-04-24 09:04:11 UTC

fix the unexpected error from cvescan test.

the error introduced from https://gitlab.com/canonical-mainstream/plainbox-provider-pc-sanity/-/merge_requests/1

 - Add an autopkgtest for cvescan as well.
 - Treat cvescan executing also true, because the output will be examine
in the end.

Author: Alex Tu
Author Date: 2021-04-22 03:32:40 UTC

fix lp build failure: -- SC2164: Use 'cd ... || exit' or 'cd ... || return' in case cd fails.

https://launchpadlibrarian.net/534799333/buildlog_ubuntu-bionic-amd64.plainbox-provider-pc-sanity_1.0.1ubuntu1-0~202104220202+a89720c~ubuntu18.04.1_BUILDING.txt.gz

Author: Alex Tu
Author Date: 2021-04-22 03:32:40 UTC

fix lp build failure: -- SC2164: Use 'cd ... || exit' or 'cd ... || return' in case cd fails.

https://launchpadlibrarian.net/534799333/buildlog_ubuntu-bionic-amd64.plainbox-provider-pc-sanity_1.0.1ubuntu1-0~202104220202+a89720c~ubuntu18.04.1_BUILDING.txt.gz

Author: Alex Tu
Author Date: 2021-03-10 06:30:00 UTC

fix checkbox framework issue: from packaging.pxu

for this issue:
```
$ checkbox-cli run
Using sideloaded provider: plainbox-provider-checkbox, version 0.56.0.dev0 from /var/tmp/checkbox-providers/plainbox-provider-checkbox
Using sideloaded provider: plainbox-provider-pc-sanity, version 1.20.0.dev0 from /var/tmp/checkbox-providers/plainbox-provider-pc-sanity
Using sideloaded provider: plainbox-provider-resource-generic, version 0.47.0.dev0 from /var/tmp/checkbox-providers/plainbox-provider-resource
Undeclared exception AttributeError raised from start_new_session
Traceback (most recent call last):
  File "/usr/bin/checkbox-cli", line 11, in <module>
    load_entry_point('checkbox-ng==1.11.0', 'console_scripts', 'checkbox-cli')()
  File "/usr/lib/python3/dist-packages/checkbox_ng/launcher/checkbox_cli.py", line 123, in main
    subcmd.invoked(ctx)
  File "/usr/lib/python3/dist-packages/checkbox_ng/launcher/subcommands.py", line 653, in invoked
    self.sa.start_new_session(
  File "/usr/lib/python3/dist-packages/plainbox/impl/decorators.py", line 142, in wrapper
    raise exc
  File "/usr/lib/python3/dist-packages/plainbox/impl/decorators.py", line 136, in wrapper
    return func(*args, **kwargs)
  File "/usr/lib/python3/dist-packages/plainbox/impl/session/assistant.py", line 470, in start_new_session
    self._context.add_provider(provider)
  File "/usr/lib/python3/dist-packages/plainbox/impl/session/state.py", line 416, in add_provider
    self.add_unit(unit, False)
  File "/usr/lib/python3/dist-packages/plainbox/impl/session/state.py", line 435, in add_unit
    _("attempting to add the same unit twice: %s" % unit.id))
AttributeError: 'PackagingMetaDataUnit' object has no attribute 'id'
```

Author: Alex Tu
Author Date: 2021-03-09 03:41:22 UTC

gitlab ci: ignore failure from reprotest

Author: Alex Tu
Author Date: 2021-03-06 10:10:57 UTC

fix lintian warning: ancient-standards-version and package-uses-deprecated-debhelper-compat-version

W: plainbox-provider-pc-sanity source: ancient-standards-version 3.9.7 (released 2016-02-01) (current is 4.5.0)
W: plainbox-provider-pc-sanity source: package-uses-deprecated-debhelper-compat-version 9

Author: Alex Tu
Author Date: 2021-03-05 12:37:54 UTC

show bootstrap during autopkgtest

Author: Alex Tu
Author Date: 2021-03-05 12:12:51 UTC

exclude bluetooth obx

Author: Alex Tu
Author Date: 2021-03-05 10:38:29 UTC

move turbo state tests to ppc

Author: Alex Tu
Author Date: 2021-01-16 17:09:43 UTC

cvescan: cat information to submission html file.

Author: Alex Tu
Author Date: 2021-02-05 10:46:39 UTC

remove the platform parameter, sofa we don't need it

Author: Alex Tu
Author Date: 2021-01-09 09:56:50 UTC

move to the plan power-turbostat-residency-automated from plainbox-provider-checkbox

refer to https://code.launchpad.net/~alextu/plainbox-provider-checkbox/+git/plainbox-provider-checkbox/+merge/388726

Author: Alex Tu
Author Date: 2021-01-09 13:51:38 UTC

attachment: bootstrap-pc-sanity-smoke-test: for visibility of testing order.

Author: Alex Tu
Author Date: 2021-01-10 15:53:53 UTC

attachement: to show what test cases are sideloaded

Author: Alex Tu
Author Date: 2021-01-08 06:15:25 UTC

a yaml collect jobs need improvement.

- task from https://docs.google.com/document/d/1MkS4n9HMs772UfrLzEJaB2g_kxuNAgVaj4wX8iWOnrM/edit#heading=h.gxy8ab75nhmh
- yq from `wget https://github.com/mikefarah/yq/releases/download/v4.2.1/yq_linux_arm64`
 - $ bin/yq e ".for-all.[]| path| .[-1]" database/jobs-need-improvement.yaml # to get test IDs for all platform.
 - $ bin/yq e ".for-desktop-only.[]| path| .[-1]" database/jobs-need-improvement.yaml # to get test IDs for all platform.

Author: Alex Tu
Author Date: 2021-01-08 04:40:37 UTC

removed unused return

Author: Alex Tu
Author Date: 2021-01-07 11:59:13 UTC

testing

Author: Alex Tu
Author Date: 2021-01-07 11:05:51 UTC

to only cover oem-meta for focal.

per discussion with jeremyszu that it's hard to cover sutton and stella
in bionic and xenial. So, the plan be changed to:
 - on focal, QA rely on this test case for oem meta.
 - on bionic and xenial, QA just use the old one.

Author: Alex Tu
Author Date: 2021-01-05 10:44:31 UTC

a stand along plan for dgpu switching for convenient

Author: Alex Tu
Author Date: 2021-01-05 10:20:58 UTC

attachement: dpkg -l

Author: Alex Tu
Author Date: 2020-12-28 09:06:31 UTC

check-nvidia.sh: tips for know issue.LP: #1904762

Author: Alex Tu
Author Date: 2020-12-25 06:35:08 UTC

polish by reviewer's comment

Author: Alex Tu
Author Date: 2020-12-21 07:30:14 UTC

pick somerville/platform-meta-test from QA test plan.

from git+ssh://alextu@git.launchpad.net/oem-qa-checkbox b341456c v0.81

Author: Alex Tu
Author Date: 2020-12-19 09:36:38 UTC

move back to hustle-ci

Author: Alex Tu
Author Date: 2020-12-07 07:34:04 UTC

a test case for factory issue

Author: Alex Tu
Author Date: 2020-12-01 06:23:24 UTC

collect the output to checkbox session share

Author: Alex Tu
Author Date: 2020-11-24 07:48:18 UTC

turbo status testing depends on power-management/cpu-low-power-idle

for LP: #1904124, and also added a plan so that we can run all power
state test easier.

because a system failed on power-management/cpu-low-power-idle don't able to get package PC10.
So, it's meanless to check if it stays in PC10 long enough.

Author: Alex Tu
Author Date: 2020-10-19 09:58:01 UTC

a script to check nvidia status

Author: Alex Tu
Author Date: 2020-11-24 03:27:11 UTC

removed non-used sudo and remove the pipline

SALSA_CI_AUTOPKGTEST_SETUP_CMDS not accept multiple line, so to remove
the pipline charater so that people won't be confused.

Author: Alex Tu
Author Date: 2020-11-03 06:27:38 UTC

give more tips for the instruction when turbostat testing failed

Author: Alex Tu
Author Date: 2020-10-29 10:06:59 UTC

dmesg need root permission and also revise a bit of the code.

Author: Alex Tu
Author Date: 2020-10-28 07:48:01 UTC

Merge remote-tracking branch 'os/fix-leak-wrong-pkgs' into HEAD

Merge-Proposal: https://code.launchpad.net/~os369510/plainbox-provider-pc-sanity/+git/plainbox-provider-pc-sanity/+merge/391520

Author: Alex Tu
Author Date: 2020-10-27 16:29:31 UTC

refine

Author: Alex Tu
Author Date: 2020-10-27 03:32:42 UTC

fix typo for bats script and correct the naming of bats script

Author: Alex Tu
Author Date: 2020-05-20 10:33:03 UTC

add autopackage checking build and installation time.

to build testbed: ./autopkgtest.sh build
to run autopkgtest: ./autopkgtest.sh

Author: Alex Tu
Author Date: 2020-10-23 09:09:06 UTC

capture the final JOB_STATUS

Otherwise it show success on checkbox job result.

Author: Alex Tu
Author Date: 2020-10-23 09:06:45 UTC

capture the final JOB_STATUS

Author: Alex Tu
Author Date: 2020-10-16 08:15:00 UTC

pick up missed build dependency

the plainbox provider need checkbox archive during build time.
so, currently all providers are built to ppa:checkbox-dev/ppa by
default.

from https://code.launchpad.net/~alextu/plainbox-provider-pc-sanity/+git/plainbox-provider-pc-sanity/+merge/391868

Author: Alex Tu
Author Date: 2020-10-13 06:33:28 UTC

give more tips for proc-thermal kernel driver testing.

Author: Alex Tu
Author Date: 2020-10-03 16:06:09 UTC

try

Author: Alex Tu
Author Date: 2020-09-29 04:50:31 UTC

left the clean at the end of script to pick up all failure at one time

Author: Alex Tu
Author Date: 2020-09-24 16:57:04 UTC

refine the test case for LP :#1896593

Author: Alex Tu
Author Date: 2020-09-24 16:35:23 UTC

fork the job from plainbox-provider-checkbox to workaround LP: #1892140

This job should be retire after LP: #1892140 fixed

Author: Alex Tu
Author Date: 2020-09-24 10:25:55 UTC

add testtools to collect all pkgs which for testing tools.

requestion from : https://code.launchpad.net/~alextu/pc-enablement/+git/oem-gap-allow-list/+merge/391062

Author: Alex Tu
Author Date: 2020-09-21 03:19:29 UTC

update debug tips for bugs like LP: #1895776

Author: Alex Tu
Author Date: 2020-09-04 14:10:01 UTC

refactor turbostat tests and preparing upstream to ppc

Author: Alex Tu
Author Date: 2020-09-03 10:26:31 UTC

refactor based on plainbox-provider-sru

based on plainbox-provider-sru-1.19.0+git202006190355+pkg65~ubuntu20.04.1

Author: Alex Tu
Author Date: 2020-08-28 16:11:20 UTC

check expected power residency during s2i e.g. cpu pkg c10, s0ix, gfxrc6..etc

this test case refer to Intel document : https://01.org/blogs/qwang59/2020/linux-s0ix-troubleshooting

Author: Alex Tu
Author Date: 2020-09-01 05:55:44 UTC

pick somerville chroot.log checking from oem-qa-checkbox 6596762f

Author: Alex Tu
Author Date: 2020-08-18 07:34:19 UTC

add debsum checking

Author: Alex Tu
Author Date: 2020-08-05 05:32:03 UTC

wait longer to make sure cpu get into sleep and print more reference from debug sys file system

Author: Alex Tu
Author Date: 2020-06-12 06:59:26 UTC

fix: exit soon on no-somerville machines

Author: Alex Tu
Author Date: 2020-06-05 02:57:50 UTC

add tlp diff to smoke test

Author: Alex Tu
Author Date: 2020-05-25 03:42:22 UTC

clean up: remove oem-generic-auto.pxu and rename pm-test-devices.pxu.

 - oem-generic-auto.pxu has be upstreamed to client-cert-auto.
 - rename file name to have 'pc-sanity' prefix so that easier greping.

Author: Alex Tu
Author Date: 2020-05-20 10:33:03 UTC

test autopkgtest

tested passed by command:
autopkgtest -U --setup-commands="sudo add-apt-repository -y -u -s ppa:checkbox-dev/ppa && sudo apt-get install -y prepare-checkbox-sanity" --test-name=help --shell-fail -- lxd autopkgtest/ubuntu/focal/amd64

Author: Alex Tu
Author Date: 2020-04-28 06:18:45 UTC

remove turbostat checking for shortidle

becuase it's not necessary that CPU get into deeper pkg stat during
shortidle.

The request sofar is CPU state should get into deeper pkg state during
long idle.

Author: Alex Tu
Author Date: 2020-04-22 09:41:13 UTC

dell-recovery: double confirm dell-recovery is installed

Author: Alex Tu
Author Date: 2020-04-22 09:14:44 UTC

gate_rste_raid: replaced script from the original one from woodrow

Author: Alex Tu
Author Date: 2020-04-21 11:43:35 UTC

to check turbostat in longidle

detail history: https://trello.com/c/3C0b5Nkt

Author: Alex Tu
Author Date: 2020-04-16 08:04:45 UTC

and i2c_hid checking to plan

Author: Alex Tu
Author Date: 2020-04-15 10:26:45 UTC

add cpu pc stat , thermal driver, dump libsmbios into smoke test plan.