[0/4] Acceptance Tests: update assets location and cancel tests if missing

Message

Cleber Rosa Sept. 7, 2020, 4:19 a.m. UTC

This updates a couple of asset locations, because their locations on
their origin distributions are not permanently stable.

To minimize the inconvenciente caused by test and job failures in the
future, an option is enabled that will cancel (AKA skip) tests early
when those assets are not available.

Cleber Rosa (3):
  Acceptance tests: use an available kernel image package for arm
  boot linux test: update arm bionic URL
  Acceptance tests: cancel tests on missing assets

Pavel Dovgaluk (1):
  tests: bump avocado version

 tests/Makefile.include                       |   2 +-
 tests/acceptance/boot_linux_console.py       | 164 +++++++++++--------
 tests/acceptance/linux_initrd.py             |   6 +-
 tests/acceptance/linux_ssh_mips_malta.py     |   6 +-
 tests/acceptance/machine_arm_canona1100.py   |   3 +-
 tests/acceptance/machine_arm_integratorcp.py |   9 +-
 tests/acceptance/machine_arm_n8x0.py         |   3 +-
 tests/acceptance/machine_avr6.py             |   3 +-
 tests/acceptance/machine_m68k_nextcube.py    |   3 +-
 tests/acceptance/machine_mips_malta.py       |   6 +-
 tests/acceptance/machine_rx_gdbsim.py        |   9 +-
 tests/acceptance/machine_sparc64_sun4u.py    |   3 +-
 tests/acceptance/machine_sparc_leon3.py      |   3 +-
 tests/acceptance/ppc_prep_40p.py             |   8 +-
 tests/acceptance/replay_kernel.py            |  51 ++++--
 tests/requirements.txt                       |   2 +-
 16 files changed, 171 insertions(+), 110 deletions(-)

Comments

Philippe Mathieu-Daudé Sept. 8, 2020, 8:21 p.m. UTC | #1

Hi Cleber,

On 9/7/20 6:19 AM, Cleber Rosa wrote:
> This updates a couple of asset locations, because their locations on
> their origin distributions are not permanently stable.
> 
> To minimize the inconvenciente caused by test and job failures in the
> future, an option is enabled that will cancel (AKA skip) tests early
> when those assets are not available.
> 
> Cleber Rosa (3):
>   Acceptance tests: use an available kernel image package for arm
>   boot linux test: update arm bionic URL
>   Acceptance tests: cancel tests on missing assets
> 
> Pavel Dovgaluk (1):
>   tests: bump avocado version

I value your patches but I prefer to consider them as
new tests added, and not tests fixed (as discussed elsewhere
in this series). Therefore I'll post another simpler approach
until the discussion gets a consensus.

Regards,

Phil.