mbox series

[v2,0/7] final fixes for 8.2

Message ID 20231201093633.2551497-1-alex.bennee@linaro.org
Headers show
Series final fixes for 8.2 | expand

Message

Alex Bennée Dec. 1, 2023, 9:36 a.m. UTC
8.2 is looking fairly stable but I do have one bug fix for gdbstub
which I came across while debugging something else. The changes for
avocado rationalise all flaky tests under the QEMU_TEST_FLAKY_TESTS
environment variable. The final patch re-adds the flaky tests to the
CI as a manually run allow_fail job so we can still attempt to debug
their failure in the place they tend to fall over.

v2
--

  - addressed some review comments
  - emphasised raising a bug for failing tests
  - drop some tests now missing assets online
  - fix wrong microblaze target for tests

The following still need review:

  gitlab: build the correct microblaze target
  tests/avocado: tag sbsa tests as tcg only
  tests/avocado: drop malta yamon tests
  tests/avocado: drop BootLinuxConsole.test_mips_malta_cpio test

Alex.

Alex Bennée (7):
  gdbstub: use a better signal when we halt for IO reasons
  docs/devel: rationalise unstable gitlab tests under FLAKY_TESTS
  tests/avocado: drop BootLinuxConsole.test_mips_malta_cpio test
  tests/avocado: drop malta yamon tests
  tests/avocado: tag sbsa tests as tcg only
  gitlab: build the correct microblaze target
  gitlab: add optional job to run flaky avocado tests

 docs/devel/testing.rst                   | 32 ++++++++++------
 gdbstub/internals.h                      |  1 +
 gdbstub/system.c                         |  2 +-
 .gitlab-ci.d/buildtest.yml               | 32 +++++++++++++++-
 tests/avocado/boot_linux.py              | 10 +++--
 tests/avocado/boot_linux_console.py      | 28 ++------------
 tests/avocado/intel_iommu.py             |  6 ++-
 tests/avocado/linux_initrd.py            |  7 +++-
 tests/avocado/machine_aarch64_sbsaref.py |  1 +
 tests/avocado/machine_aspeed.py          | 10 +++--
 tests/avocado/machine_mips_malta.py      | 47 ++++--------------------
 tests/avocado/machine_rx_gdbsim.py       | 10 +++--
 tests/avocado/machine_s390_ccw_virtio.py |  3 +-
 tests/avocado/replay_kernel.py           |  8 +++-
 tests/avocado/reverse_debugging.py       | 16 +++++---
 tests/avocado/smmu.py                    |  6 ++-
 tests/avocado/tuxrun_baselines.py        |  5 ++-
 17 files changed, 122 insertions(+), 102 deletions(-)

Comments

Stefan Hajnoczi Dec. 1, 2023, 1:30 p.m. UTC | #1
On Fri, 1 Dec 2023 at 07:56, Alex Bennée <alex.bennee@linaro.org> wrote:
>
> 8.2 is looking fairly stable but I do have one bug fix for gdbstub
> which I came across while debugging something else. The changes for
> avocado rationalise all flaky tests under the QEMU_TEST_FLAKY_TESTS
> environment variable. The final patch re-adds the flaky tests to the
> CI as a manually run allow_fail job so we can still attempt to debug
> their failure in the place they tend to fall over.

Acked-by: Stefan Hajnoczi <stefanha@redhat.com>

>
> v2
> --
>
>   - addressed some review comments
>   - emphasised raising a bug for failing tests
>   - drop some tests now missing assets online
>   - fix wrong microblaze target for tests
>
> The following still need review:
>
>   gitlab: build the correct microblaze target
>   tests/avocado: tag sbsa tests as tcg only
>   tests/avocado: drop malta yamon tests
>   tests/avocado: drop BootLinuxConsole.test_mips_malta_cpio test
>
> Alex.
>
> Alex Bennée (7):
>   gdbstub: use a better signal when we halt for IO reasons
>   docs/devel: rationalise unstable gitlab tests under FLAKY_TESTS
>   tests/avocado: drop BootLinuxConsole.test_mips_malta_cpio test
>   tests/avocado: drop malta yamon tests
>   tests/avocado: tag sbsa tests as tcg only
>   gitlab: build the correct microblaze target
>   gitlab: add optional job to run flaky avocado tests
>
>  docs/devel/testing.rst                   | 32 ++++++++++------
>  gdbstub/internals.h                      |  1 +
>  gdbstub/system.c                         |  2 +-
>  .gitlab-ci.d/buildtest.yml               | 32 +++++++++++++++-
>  tests/avocado/boot_linux.py              | 10 +++--
>  tests/avocado/boot_linux_console.py      | 28 ++------------
>  tests/avocado/intel_iommu.py             |  6 ++-
>  tests/avocado/linux_initrd.py            |  7 +++-
>  tests/avocado/machine_aarch64_sbsaref.py |  1 +
>  tests/avocado/machine_aspeed.py          | 10 +++--
>  tests/avocado/machine_mips_malta.py      | 47 ++++--------------------
>  tests/avocado/machine_rx_gdbsim.py       | 10 +++--
>  tests/avocado/machine_s390_ccw_virtio.py |  3 +-
>  tests/avocado/replay_kernel.py           |  8 +++-
>  tests/avocado/reverse_debugging.py       | 16 +++++---
>  tests/avocado/smmu.py                    |  6 ++-
>  tests/avocado/tuxrun_baselines.py        |  5 ++-
>  17 files changed, 122 insertions(+), 102 deletions(-)
>
> --
> 2.39.2
>
>