Merge lp://qastaging/~azzar1/unity8/record-test-failure into lp://qastaging/unity8
- record-test-failure
- Merge into trunk
Status: | Work in progress |
---|---|
Proposed branch: | lp://qastaging/~azzar1/unity8/record-test-failure |
Merge into: | lp://qastaging/unity8 |
Prerequisite: | lp://qastaging/~ci-train-bot/unity8/unity8-ubuntu-zesty-2291.1 |
Diff against target: |
262 lines (+172/-4) 7 files modified
cmake/modules/QmlTest.cmake (+21/-2) debian/control (+2/-0) debian/tests/qmluitests.sh (+1/-1) tests/CMakeLists.txt (+2/-0) tests/qmltests/Launcher/tst_Launcher.qml (+1/-1) tools/CMakeLists.txt (+6/-0) tools/record_wrapper.py (+139/-0) |
To merge this branch: | bzr merge lp://qastaging/~azzar1/unity8/record-test-failure |
Related bugs: |
Reviewer | Review Type | Date Requested | Status |
---|---|---|---|
Unity8 CI Bot | continuous-integration | Needs Fixing | |
Michał Sawicz | Pending | ||
Review via email: mp+314703@code.qastaging.launchpad.net |
This proposal supersedes a proposal from 2015-07-22.
Commit message
Add rxvfb* target to record screen in case of test failure.
Description of the change
* Are there any related MPs required for this MP to build/function as expected? Please list.
no
* Did you perform an exploratory manual test run of your code change and any related functionality?
yes
* Did you make sure that your branch does not contain spurious tags?
yes
* If you changed the packaging (debian), did you subscribe the ubuntu-unity team to this MP?
nope
* If you changed the UI, has there been a design review?
n/a
Michał Sawicz (saviq) wrote : Posted in a previous version of this proposal | # |
Michał Sawicz (saviq) wrote : Posted in a previous version of this proposal | # |
Wonder if the wrapper should have a mode where it retries the test once when it failed, this way we don't incur any overhead for tests until they fail (obviously could miss recording some failures, but maybe that's ok).
Michał Sawicz (saviq) : Posted in a previous version of this proposal | # |
Andrea Azzarone (azzar1) wrote : Posted in a previous version of this proposal | # |
> I think we need to handle KeyboardInterrupt in record.py, wdyt?
This is already handled in the "finally:" block.
Andrea Azzarone (azzar1) wrote : Posted in a previous version of this proposal | # |
> I think we need to handle KeyboardInterrupt in record.py, wdyt?
This is already handled in the "finally:" block.
Andrea Azzarone (azzar1) wrote : Posted in a previous version of this proposal | # |
> Wonder if the wrapper should have a mode where it retries the test once when
> it failed, this way we don't incur any overhead for tests until they fail
> (obviously could miss recording some failures, but maybe that's ok).
This is going to be hard using that kind of wrapper. What we could do is to first run all xvfb* targets and then running the rxvfb* of the failing tests.
Unity8 CI Bot (unity8-ci-bot) wrote : | # |
FAILED: Continuous integration, rev:2754
https:/
Executed test runs:
SUCCESS: https:/
SUCCESS: https:/
UNSTABLE: https:/
SUCCESS: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
Click here to trigger a rebuild:
https:/
- 2755. By Andrea Azzarone
-
Edit runtests.sh to use rxvfb*...
Unity8 CI Bot (unity8-ci-bot) wrote : | # |
FAILED: Continuous integration, rev:2755
https:/
Executed test runs:
FAILURE: https:/
SUCCESS: https:/
SUCCESS: https:/
deb: https:/
FAILURE: https:/
SUCCESS: https:/
deb: https:/
FAILURE: https:/
SUCCESS: https:/
deb: https:/
FAILURE: https:/
Click here to trigger a rebuild:
https:/
Unity8 CI Bot (unity8-ci-bot) wrote : | # |
FAILED: Continuous integration, rev:2755
https:/
Executed test runs:
FAILURE: https:/
SUCCESS: https:/
FAILURE: https:/
FAILURE: https:/
FAILURE: https:/
FAILURE: https:/
FAILURE: https:/
FAILURE: https:/
Click here to trigger a rebuild:
https:/
Albert Astals Cid (aacid) wrote : | # |
Text conflict in tests/CMakeList
1 conflicts encountered.
- 2756. By Andrea Azzarone
-
Merge trunk.
Andrea Azzarone (azzar1) wrote : | # |
> Text conflict in tests/CMakeList
> 1 conflicts encountered.
Fixed.
Unity8 CI Bot (unity8-ci-bot) wrote : | # |
FAILED: Continuous integration, rev:2756
https:/
Executed test runs:
FAILURE: https:/
SUCCESS: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
FAILURE: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
Click here to trigger a rebuild:
https:/
Unity8 CI Bot (unity8-ci-bot) wrote : | # |
FAILED: Continuous integration, rev:2756
https:/
Executed test runs:
SUCCESS: https:/
SUCCESS: https:/
UNSTABLE: https:/
SUCCESS: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
Click here to trigger a rebuild:
https:/
Unity8 CI Bot (unity8-ci-bot) wrote : | # |
PASSED: Continuous integration, rev:2756
https:/
Executed test runs:
SUCCESS: https:/
SUCCESS: https:/
SUCCESS: https:/
SUCCESS: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
Click here to trigger a rebuild:
https:/
- 2757. By Andrea Azzarone
-
Make sure jenkins runs the r* version of the tests.
Unity8 CI Bot (unity8-ci-bot) wrote : | # |
FAILED: Continuous integration, rev:2757
https:/
Executed test runs:
SUCCESS: https:/
UNSTABLE: https:/
UNSTABLE: https:/
SUCCESS: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
Click here to trigger a rebuild:
https:/
Albert Astals Cid (aacid) wrote : | # |
/build/
- 2758. By Andrea Azzarone
-
Use configure_file to copy record.py to bin dir.
Unity8 CI Bot (unity8-ci-bot) wrote : | # |
FAILED: Continuous integration, rev:2758
https:/
Executed test runs:
SUCCESS: https:/
UNSTABLE: https:/
UNSTABLE: https:/
SUCCESS: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
Click here to trigger a rebuild:
https:/
- 2759. By Andrea Azzarone
-
Rename record.py and install it in ${SHELL_
PRIVATE_ LIBDIR} /tests/ scripts.
Unity8 CI Bot (unity8-ci-bot) wrote : | # |
FAILED: Continuous integration, rev:2759
https:/
Executed test runs:
SUCCESS: https:/
UNSTABLE: https:/
UNSTABLE: https:/
SUCCESS: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
Click here to trigger a rebuild:
https:/
- 2760. By Andrea Azzarone
-
Fix record_wrapper.py searching path.
Unity8 CI Bot (unity8-ci-bot) wrote : | # |
FAILED: Continuous integration, rev:2760
https:/
Executed test runs:
SUCCESS: https:/
UNSTABLE: https:/
UNSTABLE: https:/
SUCCESS: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
Click here to trigger a rebuild:
https:/
- 2761. By Andrea Azzarone
-
Fix permissions.
Unity8 CI Bot (unity8-ci-bot) wrote : | # |
FAILED: Continuous integration, rev:2761
https:/
Executed test runs:
SUCCESS: https:/
UNSTABLE: https:/
UNSTABLE: https:/
SUCCESS: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
Click here to trigger a rebuild:
https:/
- 2762. By Andrea Azzarone
-
Fix debian/control
Unity8 CI Bot (unity8-ci-bot) wrote : | # |
FAILED: Continuous integration, rev:2762
https:/
Executed test runs:
SUCCESS: https:/
UNSTABLE: https:/
UNSTABLE: https:/
SUCCESS: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
Click here to trigger a rebuild:
https:/
- 2763. By Andrea Azzarone
-
Install python3-lxml.
Unity8 CI Bot (unity8-ci-bot) wrote : | # |
PASSED: Continuous integration, rev:2763
https:/
Executed test runs:
SUCCESS: https:/
SUCCESS: https:/
SUCCESS: https:/
SUCCESS: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
Click here to trigger a rebuild:
https:/
- 2764. By Andrea Azzarone
-
Add explicit failing test to check if the test is properly recorded on jenkins.
Unity8 CI Bot (unity8-ci-bot) wrote : | # |
FAILED: Continuous integration, rev:2764
https:/
Executed test runs:
SUCCESS: https:/
UNSTABLE: https:/
UNSTABLE: https:/
SUCCESS: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
SUCCESS: https:/
deb: https:/
Click here to trigger a rebuild:
https:/
Unmerged revisions
- 2764. By Andrea Azzarone
-
Add explicit failing test to check if the test is properly recorded on jenkins.
- 2763. By Andrea Azzarone
-
Install python3-lxml.
- 2762. By Andrea Azzarone
-
Fix debian/control
- 2761. By Andrea Azzarone
-
Fix permissions.
- 2760. By Andrea Azzarone
-
Fix record_wrapper.py searching path.
- 2759. By Andrea Azzarone
-
Rename record.py and install it in ${SHELL_
PRIVATE_ LIBDIR} /tests/ scripts. - 2758. By Andrea Azzarone
-
Use configure_file to copy record.py to bin dir.
- 2757. By Andrea Azzarone
-
Make sure jenkins runs the r* version of the tests.
- 2756. By Andrea Azzarone
-
Merge trunk.
- 2755. By Andrea Azzarone
-
Edit runtests.sh to use rxvfb*...
I think we need to handle KeyboardInterrupt in record.py, wdyt?