Canonical Driver Test Suite

Merge lp://qastaging/~sylvain-pineau/cdts/cdts_testplans into lp://qastaging/cdts

  1. cdts_testplans
  2. Merge into trunk
Proposed by Sylvain Pineau
Status: Merged
Approved by: Zygmunt Krynicki
Approved revision: 50
Merged at revision: 50
Proposed branch: lp://qastaging/~sylvain-pineau/cdts/cdts_testplans
Merge into: lp://qastaging/cdts
Diff against target: 2194 lines (+1058/-1005)
26 files modified
plainbox-provider-canonical-driver-test-suite/units/ihv-audio.pxu (+53/-0)
plainbox-provider-canonical-driver-test-suite/units/ihv-bluetooth.pxu (+55/-0)
plainbox-provider-canonical-driver-test-suite/units/ihv-camera.pxu (+51/-0)
plainbox-provider-canonical-driver-test-suite/units/ihv-ethernet.pxu (+63/-0)
plainbox-provider-canonical-driver-test-suite/units/ihv-firmware-advanced.pxu (+90/-0)
plainbox-provider-canonical-driver-test-suite/units/ihv-firmware.pxu (+91/-0)
plainbox-provider-canonical-driver-test-suite/units/ihv-graphics.pxu (+151/-0)
plainbox-provider-canonical-driver-test-suite/units/ihv-mediacard.pxu (+101/-0)
plainbox-provider-canonical-driver-test-suite/units/ihv-mobile-broadband.pxu (+51/-0)
plainbox-provider-canonical-driver-test-suite/units/ihv-system-integration.pxu (+171/-0)
plainbox-provider-canonical-driver-test-suite/units/ihv-touch.pxu (+43/-0)
plainbox-provider-canonical-driver-test-suite/units/ihv-usb.pxu (+60/-0)
plainbox-provider-canonical-driver-test-suite/units/ihv-wireless.pxu (+78/-0)
plainbox-provider-canonical-driver-test-suite/whitelists/ihv-audio.whitelist (+0/-48)
plainbox-provider-canonical-driver-test-suite/whitelists/ihv-bluetooth.whitelist (+0/-50)
plainbox-provider-canonical-driver-test-suite/whitelists/ihv-camera.whitelist (+0/-46)
plainbox-provider-canonical-driver-test-suite/whitelists/ihv-ethernet.whitelist (+0/-63)
plainbox-provider-canonical-driver-test-suite/whitelists/ihv-firmware-advanced.whitelist (+0/-85)
plainbox-provider-canonical-driver-test-suite/whitelists/ihv-firmware.whitelist (+0/-86)
plainbox-provider-canonical-driver-test-suite/whitelists/ihv-graphics.whitelist (+0/-156)
plainbox-provider-canonical-driver-test-suite/whitelists/ihv-mediacard.whitelist (+0/-96)
plainbox-provider-canonical-driver-test-suite/whitelists/ihv-mobile-broadband.whitelist (+0/-46)
plainbox-provider-canonical-driver-test-suite/whitelists/ihv-system-integration.whitelist (+0/-163)
plainbox-provider-canonical-driver-test-suite/whitelists/ihv-touch.whitelist (+0/-38)
plainbox-provider-canonical-driver-test-suite/whitelists/ihv-usb.whitelist (+0/-55)
plainbox-provider-canonical-driver-test-suite/whitelists/ihv-wireless.whitelist (+0/-73)
To merge this branch: bzr merge lp://qastaging/~sylvain-pineau/cdts/cdts_testplans
Reviewer Review Type Date Requested Status
Zygmunt Krynicki (community) Approve
Sylvain Pineau (community) Needs Resubmitting
Ara Pulido (community) Needs Fixing
Chris Gregan (community) Approve
Review via email: mp+250293@code.qastaging.launchpad.net

Description of the change

This MR replaces the existing whitelists by new testplan units including the certification status info based on the 14.04 cert client testplan.

To post a comment you must log in.
Revision history for this message
Chris Gregan (cgregan) wrote :

Excellent work! Merge please

review: Approve
Revision history for this message
Ara Pulido (ara) wrote :

Thanks for translating those whitelists!

Some changes are needed.

Comments in-line.

Thanks!

review: Needs Fixing
Revision history for this message
Sylvain Pineau (sylvain-pineau) wrote :

Squash commits into a single one to allow per commit testing
Fix missing jobs/cert status after Ara's review
Added a _name to all cdts testplan

review: Needs Resubmitting
Revision history for this message
Zygmunt Krynicki (zyga) wrote :

Thanks, +1

review: Approve
Revision history for this message
Daniel Manrique (roadmr) wrote :

The attempt to merge lp:~sylvain-pineau/cdts/cdts_testplans into lp:cdts failed. Below is the output from the failed tests.

[precise] starting container
[precise] (timing) 0.06user 0.01system 0:04.22elapsed 1%CPU (0avgtext+0avgdata 7852maxresident)k
[precise] (timing) 0inputs+32outputs (0major+6998minor)pagefaults 0swaps
[precise] provisioning container
[precise] Unable to provision requirements in container!
[precise] stdout: http://paste.ubuntu.com/10424692/
[precise] stderr: http://paste.ubuntu.com/10424693/
[precise] NOTE: unable to execute tests, marked as failed
[precise] Destroying failed container to reclaim resources
[trusty] starting container
[trusty] (timing) 0.05user 0.02system 0:05.52elapsed 1%CPU (0avgtext+0avgdata 7852maxresident)k
[trusty] (timing) 0inputs+32outputs (0major+7488minor)pagefaults 0swaps
[trusty] provisioning container
[trusty] Unable to provision requirements in container!
[trusty] stdout: http://paste.ubuntu.com/10424694/
[trusty] stderr: http://paste.ubuntu.com/10424695/
[trusty] NOTE: unable to execute tests, marked as failed
[trusty] Destroying failed container to reclaim resources

Destroying precise-testing failed
Destroying trusty-testing failed

Revision history for this message
Daniel Manrique (roadmr) wrote :

The attempt to merge lp:~sylvain-pineau/cdts/cdts_testplans into lp:cdts failed. Below is the output from the failed tests.

[precise] starting container
[precise] (timing) 0.06user 0.02system 0:05.25elapsed 1%CPU (0avgtext+0avgdata 7852maxresident)k
[precise] (timing) 0inputs+32outputs (0major+7506minor)pagefaults 0swaps
[precise] provisioning container
[precise] (timing) 35.00user 9.98system 1:04.63elapsed 69%CPU (0avgtext+0avgdata 51700maxresident)k
[precise] (timing) 3392inputs+208outputs (4major+2252143minor)pagefaults 0swaps
[precise-testing] Starting tests...
Found a test script: ./plainbox-provider-canonical-driver-test-suite/requirements/container-tests-canonical-driver-test-suite
[precise-testing] container-tests-canonical-driver-test-suite: FAIL
[precise-testing] stdout: http://paste.ubuntu.com/10425037/
[precise-testing] stderr:
[precise-testing] (timing) Command exited with non-zero status 1
[precise-testing] (timing) 1.61user 0.07system 0:01.70elapsed 98%CPU (0avgtext+0avgdata 27984maxresident)k
[precise-testing] (timing) 0inputs+8outputs (0major+9605minor)pagefaults 0swaps
[precise-testing] Destroying container
[trusty] starting container
[trusty] (timing) 0.05user 0.02system 0:04.23elapsed 1%CPU (0avgtext+0avgdata 7852maxresident)k
[trusty] (timing) 0inputs+32outputs (0major+7019minor)pagefaults 0swaps
[trusty] provisioning container
[trusty] (timing) 35.78user 9.35system 1:02.63elapsed 72%CPU (0avgtext+0avgdata 52740maxresident)k
[trusty] (timing) 9824inputs+224outputs (2major+2034566minor)pagefaults 0swaps
[trusty-testing] Starting tests...
Found a test script: ./plainbox-provider-canonical-driver-test-suite/requirements/container-tests-canonical-driver-test-suite
[trusty-testing] container-tests-canonical-driver-test-suite: FAIL
[trusty-testing] stdout: http://paste.ubuntu.com/10425061/
[trusty-testing] stderr:
[trusty-testing] (timing) Command exited with non-zero status 1
[trusty-testing] (timing) 1.68user 0.06system 0:01.76elapsed 98%CPU (0avgtext+0avgdata 18664maxresident)k
[trusty-testing] (timing) 0inputs+8outputs (0major+7218minor)pagefaults 0swaps
[trusty-testing] Destroying container

You are trying to send an empty document, exiting.
precise-testing doesn't exist
You are trying to send an empty document, exiting.
trusty-testing doesn't exist

Revision history for this message
Zygmunt Krynicki (zyga) wrote :

At first it was a tarmac glitch but it seems we have three issues in the test plan there

lp://qastaging/~sylvain-pineau/cdts/cdts_testplans updated
50. By Sylvain Pineau

providers:cdts: Add new testplans with certification_status

All based on existing IHV whitelists
The certification status is set based on client-cert-14-04.pxu
Deprecated whitelists are removed by this commit.

Revision history for this message
Sylvain Pineau (sylvain-pineau) wrote :

Indeed I left some blank lines in the include sections. Fixed

review: Needs Resubmitting
Revision history for this message
Zygmunt Krynicki (zyga) wrote :

Thanks for fixing this :)

review: Approve

Preview Diff

[H/L] Next/Prev Comment, [J/K] Next/Prev File, [N/P] Next/Prev Hunk
The diff is not available at this time. You can reload the page or download it.

Subscribers

People subscribed via source and target branches