lp://qastaging/~david-schwarz/lava-dispatcher/result_reporting_2011.09

Branch merges

Propose for merging

No branches dependent on this one.

Rejected for merging into lp://qastaging/lava-dispatcher

Linaro Validation Team: Pending requested 2011-10-11

Paul Larson: Pending requested 2011-10-07

Diff: 577 lines (+334/-51)

8 files modified

doc/ls.json (+27/-0)
lava-dispatch (+7/-1)
lava_dispatcher/__init__.py (+33/-17)
lava_dispatcher/actions/__init__.py (+114/-5)
lava_dispatcher/actions/launch_control.py (+38/-9)
lava_dispatcher/actions/ls.py (+51/-0)
lava_dispatcher/actions/results.py (+22/-0)
lava_dispatcher/client.py (+42/-19)

api

Related source package recipes

No recipes using this branch. (?)

Create packaging recipe

Related snap packages

Related bugs

Related blueprints

128. By David Schwarz on 2011-10-07

managed testing: Add server-managed tests and result reporting features

Add test_action decorator for action classes. This decorator allows the
caller of the action optionally to specify the following:

- annotation: Distinguishing information about this instance of the test action
- min_pass / max_pass: Measurement thresholds for the test action. If the
action reports a measurement less than min_pass or greater than max_pass, failure
is reported

Test actions report any measurement stored by their run() method, regardless of
pass/fail status

Test actions may raise a TestFailure exception in their run() method
to report a failure condition with an optional message. This approximates
the ASSERT behavior of JUnit-style frameworks.

Add optional JUnit-style XML file result reporting to submit_results action

Add optional display of results to the lava-dispatcher console

Added TestFailure exception class

Use name of json job file as name of test suite / test_id

Incidental changes:

Allow action classes to be placed in any subdirectory of lava_dispatcher/actions,
not just that path itself

Make retrieval of exit status of command in LavaClient.run_shell_command optional.
Retrieving the status effectively clears the pexpect buffer, which may be undesirable
if the user wishes to use or inspect the output of the command.

127. By Paul Larson on 2011-09-28

Serialize calls to linaro-media-create. This greatly improves
performance when multiple jobs are running in parallel.

126. By Paul Larson on 2011-09-28

Release 0.3.1

125. By Yongqin Liu on 2011-09-27

fix leak of job_name setting

124. By Yongqin Liu on 2011-09-27

merge to trunk:
    add combine process for submit_results_on_host action
    make 0xbench execute first befor monkey in job file
    add busybox test to job file

123. By Yongqin Liu on 2011-09-27

merge for MATER_STR not defined problem

122. By Michael Hudson-Doyle on 2011-09-27

copy device_type from job data to result metadata if present

121. By Paul Larson on 2011-09-23

release 0.3.0

120. By Paul Larson on 2011-09-23

Add LAVA_TEST_URL config option for specifying where to install
lava-test from

119. By Paul Larson on 2011-09-23

Merge python logging branch from ChiThu