Code review comment for lp://qastaging/~zyga/checkbox/fix-1298166

Looks good. I wonder if it would make sense to make the second argument to run_job non-optional, if we'll always be passing the config object we may as well require it explicitly. If you think it's a good idea we can do it later as this fix is good as-is and is high priority.