Author: Andy Doan
Revision Date: 2014-07-10 16:34:36 UTC

test-runner: simplify run-worker code

The handle_request function was growing too large to debug. It also
was written in a way that made it hard to test with a simple CLI like
we have for the image-builder.

This refactors things so that its easier to test the actual runner w/o
needing anything from rabbit.

Author: Andy Doan
Revision Date: 2014-07-09 15:10:41 UTC

add an integration test (using queues) for image builder

To avoid the mess of trying to get the proper rabbit credentials to
the host system, I've made it so that the real test runs on the target

Author: Andy Doan
Revision Date: 2014-06-18 12:50:12 UTC

revert the consolidation of "main"

Author: Andy Doan
Revision Date: 2014-06-16 22:25:33 UTC

lander: allow a worker to request a 'retry'

Workers like the publisher need to mark a ticket step as needing
to be retried. This adds a function, amqp_utils.progress_retry. When
called by a worker, the lander will pause the ticket and wait until
the ticket is updated to "resume". At this point the lander will resume
execution at this step and see if it can progress

Author: Andy Doan
Revision Date: 2014-06-16 23:16:57 UTC

dumb debug

Author: Andy Doan
Revision Date: 2014-06-16 17:55:45 UTC

enable whoopsie-upload-all in phablet-test-run

Author: Andy Doan
Revision Date: 2014-06-12 18:06:37 UTC

add example of a pyramid based nf-data-collector

= getting started

== Setting up Juju LXC

You'll need a .juju/environments.yaml file with a "local" entry like:

  local:
    type: local
    default-series: precise
    lxc-clone: true
    lxc-clone-aufs: true
    admin-secret: secret

You'll also need your swift credentials set up. I have a .hpcloud-rc file like:

 export JUJU_ENV=local
 export OS_USERNAME="andy.doan@canonical.com"
 export OS_TENANT_NAME="andy_project"
 export OS_PASSWORD=<something special>
 export OS_AUTH_URL="https://region-a.geo-1.identity.hpcloudsvc.com:35357/v2.0"
 export OS_REGION_NAME=region-a.geo-1
 export OS_REQUIRES_TUNNEL=0
 export OS_NETWORK_NAME="evan.dandrea@canonical.com-network"

 # FOR OAUTH TOKENS (you can just put fake values for your needs now)
 export CI_LAUNCHPAD_PPA_OWNER=doanac
 export CI_LAUNCHPAD_USER=doanac
 export CI_OAUTH_CONSUMER_KEY="ci airline testing"
 export CI_OAUTH_TOKEN=<just put a fake value for now>
 export CI_OAUTH_TOKEN_SECRET=<another fake value for now>

 export HP_TENANT_ID=11630049285977
 export HP_ACCESS_KEY_ID=<i think this can be fake data for your needs>
 export HP_SECRET_KEY=<and this can be fake data as well>

You'll now have the settings in-place. In order to iterate rapidly, I
like to ensure juju's template image has all my dependencies pre-installed
so you don't wait for that every time you re-deploy. I do that with a
simple manual hack:

 juju bootstrap
 juju deploy cs:trusty/apache
 # now sit and wait for juju status to show it deployed
 juju destroy-environment --force -y local
 # you'll now have an lxc container named juju-trusty-template. modify
 # it with these commands:
 sudo lxc-start -d --name juju-trusty-template
 sudo lxc-attach --name juju-trusty-template -- add-apt-repository -y ppa:canonical-ci-engineering/ci-airline-phase-0
 sudo lxc-attach --name juju-trusty-template -- apt-get update
 sudo lxc-attach --name juju-trusty-template -- apt-get install -y rabbitmq-server python-amqplib python-pip python-jinja2 mercurial git-core subversion bzr gettext python-django-south python-lazr.enum python-tastypie python-amqplib python-swiftclient postgresql-9.1 postgresql-contrib-9.1 python-psutil dput python-dput lazr.enum python-txstatsd python-tz python-gnupg qemu-utils python-glanceclient python-amqplib python-requests python-novaclient python-psycopg2 pwgen postgresql-client gunicorn python-support pgtune postgresql-9.1-debversion postgresql-plpython-9.1 python-dnspython

 sudo lxc-stop --name juju-trusty-template

= Working with the code

Since you are on trusty and our base is still precise, you'll need a one time
hack in your tree to allow the restish charm to work on trusty:

 ln -s charms/precise charms/trusty

I then use a fairly simple workflow:

 1) <do changes>
 2) juju destroy-environment --force -y local; juju bootstrap
 3) rm -rf tmp/* ; mkdir tmp
 4) ./juju-deployer/deploy.py --build-only --working-dir ./tmp nf-data-collector
 5) cd tmp/charms
 6) ../../branches/juju-deployer/juju-deployer -c ../nf-data-collector.yaml ci-airline-experimental

 7) <check changes>, and go back to step 1 if you need to re-deploy

The actual juju-deployer line (6) which does the real juju work takes
about 2.5 minutes for me with juju-lxc running properly

Author: Andy Doan
Revision Date: 2014-05-15 20:50:44 UTC

https://code.launchpad.net/~robru/phablet-tools/citrain/+merge/219268

Author: Andy Doan
Revision Date: 2014-05-15 14:35:07 UTC

fix for trusty and num-executors

Author: Andy Doan
Revision Date: 2014-05-14 21:43:52 UTC

support configurable number of executors

based on: https://code.launchpad.net/~gandelman-a/charms/precise/jenkins-slave/extension_executors/+merge/191744

Author: Andy Doan
Revision Date: 2014-05-14 20:22:54 UTC

temp hack while waiting for change in unity8

Author: Andy Doan
Revision Date: 2014-05-01 18:21:28 UTC

allow custom wait-script to be used by unlock-device

Also ensure setup-session isn't called when doing a NOSHELL test like
unity8

Author: Andy Doan
Revision Date: 2014-05-01 18:19:33 UTC

update system-settle test for new unlock logic

system-settle-before needs to happen after the device was rebooted
and before we start running the tests. This moves the logic into
a wait-device script that is used by the unlock-script/phablet-test-run

as a consequence, reboot-and-wait is no longer needed

Author: Andy Doan
Revision Date: 2014-04-04 16:00:36 UTC

merge with trunk

Author: Andy Doan
Revision Date: 2014-04-02 22:45:24 UTC

ensure we really kill the emulator

Author: Andy Doan
Revision Date: 2014-04-02 21:05:57 UTC

barry

Author: Andy Doan
Revision Date: 2014-04-01 20:03:40 UTC

ensure directory exists

Author: Andy Doan
Revision Date: 2014-02-26 19:09:48 UTC

add a new "re-run" job

This job will show up like the smoke-daily, but have rerun on the end.
Its a non-publishing job and also includes an option to run
"apt-get upate" after provisioning the device.

Author: Andy Doan
Revision Date: 2014-02-26 04:15:28 UTC

lander: use base-image supplied by ticket

We were using a hard-coded image. The ticket-system now includes
this information, so we can build using that.

Author: Andy Doan
Revision Date: 2014-01-30 17:18:38 UTC

lander: couple of integration bugs

1) typo for reporting pkg building status to ticket system
2) if rabbit-base jobs fail we weren't exiting the job with an error

Author: Andy Doan
Revision Date: 2014-01-27 19:54:39 UTC

add ticket-system information into params

Author: Andy Doan
Revision Date: 2014-01-27 09:21:16 UTC

fix mp comments

logging.INFO is too verbose for normal usage when doing file uploads.
This changes is back. It also removes the redunant "ERROR" from two
log.error lines i added

Author: Andy Doan
Revision Date: 2014-01-26 21:50:33 UTC

add a simple mechanism to store a "unit config" file

Author: Andy Doan
Revision Date: 2014-01-16 22:25:54 UTC

as per fginther

Author: Andy Doan
Revision Date: 2014-01-13 19:36:40 UTC

allow autopilot tests producing junit xml to work with dashboard

This converts autopilot junit xml into utah.yaml for the dashboard.

Also fixes a small bug found in run-smoke

Author: Andy Doan
Revision Date: 2014-01-08 21:08:12 UTC

clarify parameter passing and add progress trigger

parameter passing was being done via a file named child.json. However,
this is really a jenkins parameters file and not really json. This
renames that file and creates it with a few less lines of code.

Author: Andy Doan
Revision Date: 2014-01-06 19:46:09 UTC

oops

Author: Andy Doan
Revision Date: 2014-01-06 19:06:12 UTC

update jobs to deal with parameters properly

this requires the child-jobs to be run from where the master is
located so that they can access its workspace for the parameters
that are being accumulated from job-to-job.

Author: Andy Doan
Revision Date: 2013-12-18 20:32:04 UTC

install txstatsd

Author: Andy Doan
Revision Date: 2013-12-18 18:15:06 UTC

add statsd utils and support to branch-source-builder

Author: Andy Doan
Revision Date: 2013-12-17 23:10:25 UTC

idea for trying txstatsd charm

Author: Andy Doan
Revision Date: 2013-11-15 20:27:59 UTC

make testcases unique

This tries to give unique testcase names by adding _<x> if a procname
is repeated. There's no promise _1 from one run matches _1 on the next,
but it will probably work out that way in practice.

Author: Andy Doan
Revision Date: 2013-11-13 22:47:58 UTC

add "sudo" needed for utah-client

Author: Andy Doan
Revision Date: 2013-11-08 02:52:48 UTC

0.15+20131107

fix json-schema bug in new library version on trusty

Author: Andy Doan
Revision Date: 2013-11-05 16:49:23 UTC

convert to running autopilot tests with new autopilot script

this uses phablet-test-run directly

Author: Andy Doan
Revision Date: 2013-10-29 20:37:59 UTC

fix config bug from MP

Evan discovered this bug.

Author: Andy Doan
Revision Date: 2013-10-29 15:42:48 UTC

health-check-idle template for cking

Author: Andy Doan
Revision Date: 2013-10-28 20:37:53 UTC

backout logging change (being fixed in another branch already)

Author: Andy Doan
Revision Date: 2013-10-24 21:57:52 UTC

add statsd support for test-execution-service (ie MEGA run)

Author: Andy Doan
Revision Date: 2013-10-15 19:17:06 UTC

make phablet-test-run default to unlocking the screen

also clean up the usage text so it displays properly on 80 columns

Author: Andy Doan
Revision Date: 2013-09-26 18:47:37 UTC

make the 5 minute wait for install-and-boot configurable

Author: Andy Doan
Revision Date: 2013-08-23 17:31:37 UTC

fix some broken test cases for the server logic

Author: Andy Doan
Revision Date: 2013-08-08 20:06:38 UTC

touch: don't require utah on the target with --from-host

This allows the --from-host support to not require utah-client
be installed on the target.

It also renames the utah-host and utah-tgt intermediate files so
that the dashboard won't try and parse them for results.

Author: Andy Doan
Revision Date: 2013-07-30 18:33:30 UTC

move phablet-network-bridge-addif to /lib/udev

as per sergio's review. this is where other udev scripts get located

Author: Andy Doan
Revision Date: 2013-07-25 05:17:00 UTC

add notion of rndis networking for touch images

This adds a way to enable networking on touch devices via
the USB connection to the host PC (rndis). This is done by:

step 1: setup up host to be ready with:
  examples/phablet-network-bridge-setup

This sets up a bridge device and the proper port forwarding. It
also sets up a udev rule to add interfaces as they appear and
automatically grab a DHCP address.

step 2: add --rndis to run_utah_phablet.py commands

Author: Andy Doan
Revision Date: 2013-07-17 19:29:46 UTC

allow battery selection to be controlled via environment variable

makes things easier for integrating into run_utah_phablet.py

Author: Andy Doan
Revision Date: 2013-07-16 23:40:10 UTC

simple example to use puts

Author: Andy Doan
Revision Date: 2013-07-11 18:04:35 UTC

convert to use pauls scripts for device ids

Author: Andy Doan
Revision Date: 2013-07-10 22:06:17 UTC

add energy computations to battery probe code

This helps report the actual energy used(mW) in the probe data so that
users don't have to compute this.

Author: Andy Doan
Revision Date: 2013-07-08 22:59:18 UTC

fix timing error for reboot support in autorun

Running under a VM in TMPFS, the activecheck call seems to somehow
run too fast. Retrying seems to make it always work.

Author: Andy Doan
Revision Date: 2013-07-03 18:34:06 UTC

try and reduce apt warnings

Author: Andy Doan
Revision Date: 2013-07-01 17:06:58 UTC

fix bad logic for determining USB_POWER script

Author: Andy Doan
Revision Date: 2013-06-29 17:14:42 UTC

update to bzr branch

Author: Andy Doan
Revision Date: 2013-06-28 16:49:16 UTC

example of utah and autopilot for touch

Author: Andy Doan
Revision Date: 2013-06-20 20:30:46 UTC

add a puts battery implementation

This works in conjunction with the put-server API we've created
and have running on phoenix in the QA lab:

 https://code.launchpad.net/~utah/utah/puts-server

Author: Andy Doan
Revision Date: 2013-05-27 04:21:07 UTC

add jenkins script logic to setup job

Author: Andy Doan
Revision Date: 2013-05-15 18:06:35 UTC

code review fixes from javier

Author: Andy Doan
Revision Date: 2013-05-10 22:04:16 UTC

add a simple way to execute commands via adb in the target

Author: Andy Doan
Revision Date: 2013-05-10 21:50:40 UTC

add a utility to make package installation easier

Author: Andy Doan
Revision Date: 2013-05-07 20:45:26 UTC

get more debugging from latecommand

The latecommands seem to be falling and not giving much detail
as to why. A quick hack is to use "set -x" so we'll at least
know which command was executed before it failed.

Author: Andy Doan
Revision Date: 2013-04-10 16:08:32 UTC

create common template utility functions

This seemed to be a common pattern we could simplify

Author: Andy Doan
Revision Date: 2013-04-09 18:45:42 UTC

add footer support

this broke our google analytics

Author: Andy Doan
Revision Date: 2013-03-28 23:30:39 UTC

oops

Author: Andy Doan
Revision Date: 2013-03-28 21:00:33 UTC

version-0.11.2

Author: Andy Doan
Revision Date: 2013-03-19 21:54:04 UTC

add some logic to remove need for custom preseed

Author: Andy Doan
Revision Date: 2013-03-04 17:39:42 UTC

typo!

Author: Andy Doan
Revision Date: 2013-02-05 04:16:40 UTC

minor bug from last commit

make sure we return the most interest part of this function

Author: Andy Doan
Revision Date: 2013-01-22 21:47:58 UTC

ensure directory permission is always set

Author: Antonio Terceiro
Revision Date: 2013-01-22 18:30:49 UTC

put a newline at the end of ~/.password

this makes `cat ~/.password` less annoying

Author: Andy Doan
Revision Date: 2013-01-14 21:26:37 UTC

fix south migration issues from last commit

Basically you can't just delete an extension that's made changes
to our DB. So this keeps the minimal amount of stuff around from
the extension.

Author: Andy Doan
Revision Date: 2013-01-10 03:01:31 UTC

need some fixes for dispatcher deployed. also including michael's new filter API

Author: Andy Doan
Revision Date: 2012-12-20 18:09:03 UTC

fix issue when running "lava devices/dispath" without activating env

The dispatcher command code requires VIRTUAL_ENV to be set by
the activate script. This adds a fall-through case in the event
we are a part of a normal lava instal.

Author: Andy Doan
Revision Date: 2012-12-18 17:36:32 UTC

doc addition for post-process

Author: Andy Doan
Revision Date: 2012-11-30 15:51:49 UTC

uefi support changes from prakash

Author: Andy Doan
Revision Date: 2012-10-11 19:30:50 UTC

add some sudo things instance-manager needs

Author: Andy Doan
Revision Date: 2012-08-23 22:39:33 UTC

add big_LITTLE suite

only works with builds that include Linaro's bigLITTLE test suite

Author: Andy Doan
Revision Date: 2012-07-01 17:45:26 UTC

make dispatcher field larger

as per review comment a 64byte field like this in postgres is pointless

Author: Andy Doan
Revision Date: 2012-06-27 03:40:12 UTC

fix oddness with logging in tasks

The run_remote command wasn't handling all exceptions which under
certain circumstances made celeryd handle the exception. This is
somewhat okay, but the error gets logged in the worker. When you
think about the scenario where we run the dispatcher on a remote
system, the caller (scheduler in this case) will need to see these
types of errors.

The other issue I hit was that when exceptions come from the
CloudifierDispatcher code, the stdout/stderr references get all
munged up in celery's twisted maze of redirecting its stdout to
its loggers. The only simple way out I found was with the hack:

 sys.stderr.logger.root.handlers[0].stream = logging.sys.__stderr__

This also adds a bit of debbuging to indicate when a command is
received, what arguments were passed, and when it finished

Author: Andy Doan
Revision Date: 2012-06-22 01:48:47 UTC

fix option support for enable_network_after_boot_android

this code always returned true based on how it was written

Author: Andy Doan
Revision Date: 2012-05-23 18:56:08 UTC

merge mabac's script hooks into mpoirer's snowball branch

Author: Andy Doan
Revision Date: 2012-04-24 15:00:37 UTC

Merge mabac's script hooks

Author: Andy Doan
Revision Date: 2012-04-23 17:28:50 UTC

EULA logic on snapshots changed

We were originally able to get the build listings without doing
EULA stuff. This has changed, so cookie logic being added to core
code to be safe.

Author: Andy Doan
Revision Date: 2012-03-21 20:22:31 UTC

update output directory to match snapshots.l.o organization

instead of putting pre-builts in their own directory, they will
now get placed with the hwpack like:

 http://snapshots.linaro.org/oneiric/lt-mx5-oneiric/20120321/1/images/<file>

Author: Andy Doan
Revision Date: 2012-03-19 22:36:01 UTC

debug crap

Author: Andy Doan
Revision Date: 2012-03-06 23:40:50 UTC

Add support for restricted coremark bench

This adds the basic ability to run the coremark benchmark on
Android. Since coremark is a restricted program, the actual
binary is managed separate from this test. The script,
download_test.sh is used by coremark.py to download the proper
binary. Therefore, this test requires install options to be
passed to the install command for example:

 lava-android-test install -o "coremark_url=https://user:pass@1.1.1.1/coremark-linaro4.6" coremark

The above example would download from an HTTP password protected
directory the coremark-linaro4.6 binary.

Author: Andy Doan
Revision Date: 2012-01-18 16:38:03 UTC

first drop

Things working:
 * you can create a report and assign runs to it
   using the admin tool

 * reports show up and you can view rough plots as well
   as drill down to summaries of individual runs

Missing:

 * flot doesn't work great. combining the multiplebars support
   and errorbars isn't quite right. the errorbars measurement
   makes the bottom part of each bar disappear

 * flot error bars don't show up on top of their corresponding
   bar

 * flot titles for skia look terrible. need to be able to write
   them at an angle or something

 * the "Totals" table should be done as a percent diff from the
   android toolchain

Author: Andy Doan
Revision Date: 2011-11-29 18:00:03 UTC

remove the icon that differentiates between internal/external
wiki links

Author: Andy Doan
Revision Date: 2011-11-23 17:09:50 UTC

initial commit of some handy script related to the wiki

Author: Andy Doan
Revision Date: 2011-09-01 20:48:05 UTC

add ability to provide hwpack descriptions to the user

it would have been nice to add these descriptions somewhere
else in the YAML so you don't have to type the hwpack name
multiple times, but that would break backward compatibility
in the file

Author: Andy Doan
Revision Date: 2011-03-16 01:36:29 UTC

Add support for ingoring certain launchpad projects

Author: Andy Doan
Revision Date: 2011-02-18 01:05:20 UTC

Capitalization fix

Author: Andy Doan
Revision Date: 2011-02-11 19:12:55 UTC

updated md5 for stream.c

Author: Andy Doan
Revision Date: 2011-01-24 20:46:40 UTC

The original version mistakenly used maverick instead of natty