From patchwork Wed Jan 8 12:10:22 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: =?utf-8?q?Alex_Benn=C3=A9e?= X-Patchwork-Id: 855712 Delivered-To: patch@linaro.org Received: by 2002:adf:8b05:0:b0:385:e875:8a9e with SMTP id n5csp692109wra; Wed, 8 Jan 2025 04:31:21 -0800 (PST) X-Forwarded-Encrypted: i=2; AJvYcCXQpw/yfdWH0Q3AmVFAJt9jB4el5YlrdN7q/JCH/pCu96b8PNOe0QvvPr4eGtl7NUwKuBuCyQ==@linaro.org X-Google-Smtp-Source: AGHT+IEQLC+cfq2Ny1GQ1SUZVTUxVXP93eF+UCP0ERHjwJe2kjmgPUeOjBd3fkw/CNTmqeWoPE/l X-Received: by 2002:a05:622a:11cc:b0:467:4e9e:1988 with SMTP id d75a77b69052e-46c71028ec2mr41081521cf.28.1736339480956; Wed, 08 Jan 2025 04:31:20 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1736339480; cv=none; d=google.com; s=arc-20240605; b=a7Clbpdy1bkVe0ow5RGlFFWNX/Kb8KJKiY705LXZdR9OWRlwQgr80M+v3Adtdan5A+ c2CDBuCjuSdqs5I96A77Em7WczeJGIiv1gLM6VffwBDYZOn1ikggsDDhWoE4iADyOAM0 P9zIPY944xxIeSurqLY5hJlUuBkp2xrueGrwrro8HQ+jFtVjM2AwSYKO+Xa9AE/CPDsd EcLyVYXBcTq+3GsjB2vmhVRW9ek/s81udh0n6EyDniR4SMKo6MiLEPYRYbC9m6fQx6eH aQ3c+zyf/0MJu6foCItfw/0DylhBqf+tyHYUj2XonvfeuxEGUO8SE7Rf2a9z6lrbLhJN cSyQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=sender:errors-to:list-subscribe:list-help:list-post:list-archive :list-unsubscribe:list-id:precedence:content-transfer-encoding :mime-version:message-id:date:subject:cc:to:from:dkim-signature; bh=K2jiKN5CA7YCpU+KncJDh5WlAvz/7Rx7DwMB2koErBk=; fh=l95L5Maua5HG0vXtrda7YXM3hY8pWBBFNczXRFh+wJU=; b=C80dO9DUUIpqutyN9WQVFuR4yoystrxCFDjajxqav636jXuqSZ/rV4yod1C/2AIiIs TtLh9ujXM4SCPgzg+yjnboKLWd/tNLwoZGx3qbvSNoFe9zmrH1cxtlkJpTi2f7xWM6Uc OewFdypl+ezsnnjY9xrI2SioRBhg1IJqBK5w+MjOpMKYeTUJhkZ2sK0ghiIGHNjUtOp6 5vsj00ytR0bTfclUUSeUTC6I1IWXNCYF7UkS0BWoCsSf870b4CSGy4Wv9UUnvHZe7+eJ IXn7JgnvKMQSI0QXvyEmQDJa6sIk4Sa2OFeGNtUhW6dCiz1O4P4s3aL4H4rbO5cnsDEb hKBg==; dara=google.com ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=YTZKxzqE; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org; dara=neutral header.i=@linaro.org Return-Path: Received: from lists.gnu.org (lists.gnu.org. [209.51.188.17]) by mx.google.com with ESMTPS id d75a77b69052e-46a3ebc00e0si505847991cf.411.2025.01.08.04.31.20 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Wed, 08 Jan 2025 04:31:20 -0800 (PST) Received-SPF: pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; Authentication-Results: mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=YTZKxzqE; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org; dara=neutral header.i=@linaro.org Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1tVV1K-00028j-0M; Wed, 08 Jan 2025 07:18:46 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1tVUue-0000uq-VI for qemu-devel@nongnu.org; Wed, 08 Jan 2025 07:12:06 -0500 Received: from mail-ed1-x52b.google.com ([2a00:1450:4864:20::52b]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1tVUuR-0007Dg-Lh for qemu-devel@nongnu.org; Wed, 08 Jan 2025 07:11:50 -0500 Received: by mail-ed1-x52b.google.com with SMTP id 4fb4d7f45d1cf-5d3bbb0f09dso29183942a12.2 for ; Wed, 08 Jan 2025 04:10:57 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; t=1736338257; x=1736943057; darn=nongnu.org; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date:message-id:reply-to; bh=K2jiKN5CA7YCpU+KncJDh5WlAvz/7Rx7DwMB2koErBk=; b=YTZKxzqEVzqPQPkU0ApZob/DKhaqWaqGyTbk+rMA2zsf/pual5P19NMU6TLW20KZb0 WNstk8xs547vrttqdyEyoAD9RYbu1FlHAd+Ml8a0Sw0LqTIOWZBLn5wNudEtjD1cyRYg MZllN/Gdg10AEG6FwCFEZmYiJTpSFkRfTKko8rusRulDQIJAI/QbQeFrulfoC+FUctCE zO6DpGO9onSvPMAvmsXQbkFSgeqsh+V2yfjD+KaMtrLXzGIShnoWH/vpXhc4AxqKOGx1 nbHToti0S/i0B0TGsyystJ+KRVIe+XSJReor1XFBSBTQ6+S7MtlohNAmVvh4IvTVbKWm 4iHg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1736338257; x=1736943057; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=K2jiKN5CA7YCpU+KncJDh5WlAvz/7Rx7DwMB2koErBk=; b=kG/+N2ZTZiglMvkpGPZdJiHmJW7PWgj1E0WHKttD8ACJcsV94aWYYwusYs1H+Oc9/C zg07lnSMAr5Hldn7aAHQ8nPBduEP22N31w2SkHeChYDDg03/VE3Qj9enVrYiS9ROCM2X JgMD0UPc39+rsT31njMjdT+kIfZJzGAa/yP22ywCNq9KfcacIuoEVDaBYUBEH9bJAubx K+FTAbb0+EgeZX6rl2S7sPjOHE1rWWc/9qWmclzHxSI/zG731+8LDF8s8ULGMm7eESkY PkJicw3i6g7Ru3cG109xcT/4pkJQnV71XnQF5sAnn7BDcCzJzjRkPv5928Xpm4XFg2cX 9CLg== X-Gm-Message-State: AOJu0Yy1c1RF/QdYi0jJCOKJRjdgW0gfBHff0/OuqCa7XQmEFusIS0Dh i5soc3MDgQ7NIoyGs7VFlrn2i90znEgIQA88NN9RuU5hx4FGnXRmLDqVJRWJMr0= X-Gm-Gg: ASbGncv1h92iykJEeubNCfhP+rurb7dl3qqkwAQxIsXHQNzHYM2SCa57BDeInvZGx58 RYVWr+Xq1J/3lzRH2edC8fV2DLpMHLVbfMzZxIn/c8sG3W2+7X7OHRZS17FVLFat4Hk/hjVPBWS +HkuP4UsC1NcAb53xpifjiVP+4Ox6yjOtiakBdNKz+YONxL3LKRqU5epNcoJk3Dv6zWytMHSkkV sTX/lxqurKbLHCLe5D9qTQG5/R3D7QdtMwwwSkMF1+SWE1IzzEW2o0= X-Received: by 2002:a05:6402:2355:b0:5d9:a55:4307 with SMTP id 4fb4d7f45d1cf-5d972e4eeabmr2194247a12.22.1736338256654; Wed, 08 Jan 2025 04:10:56 -0800 (PST) Received: from draig.lan ([85.9.250.243]) by smtp.gmail.com with ESMTPSA id 4fb4d7f45d1cf-5d80679eeb1sm25318198a12.48.2025.01.08.04.10.55 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 08 Jan 2025 04:10:55 -0800 (PST) Received: from draig.lan (localhost [IPv6:::1]) by draig.lan (Postfix) with ESMTP id 8A25F5F8AC; Wed, 8 Jan 2025 12:10:54 +0000 (GMT) From: =?utf-8?q?Alex_Benn=C3=A9e?= To: qemu-devel@nongnu.org Cc: Halil Pasic , Aurelien Jarno , qemu-riscv@nongnu.org, Radoslaw Biernacki , Daniel Henrique Barboza , =?utf-8?q?Alex_Benn=C3=A9e?= , Marcel Apfelbaum , Richard Henderson , Beraldo Leal , Fabiano Rosas , Mark Cave-Ayland , Laurent Vivier , Nicholas Piggin , Marcin Juszkiewicz , Christian Borntraeger , Wainer dos Santos Moschetta , =?utf-8?q?Marc-Andr?= =?utf-8?q?=C3=A9_Lureau?= , Ed Maste , Jiaxun Yang , Bernhard Beschow , Bin Meng , qemu-ppc@nongnu.org, qemu-arm@nongnu.org, Laurent Vivier , Joel Stanley , =?utf-8?q?Philippe_Mathieu-Daud=C3=A9?= , John Snow , "Michael S. Tsirkin" , Pavel Dovgalyuk , Alistair Francis , Liu Zhiwei , Harsh Prateek Bora , Leif Lindholm , Cleber Rosa , Thomas Huth , Paolo Bonzini , qemu-s390x@nongnu.org, Eric Farman , Weiwei Li , =?utf-8?q?Daniel_P=2E_Berrang=C3=A9?= , Markus Armbruster , Daniel Henrique Barboza , Palmer Dabbelt , Peter Maydell , Li-Wen Hsu Subject: [PATCH v4 00/32] testing/next: functional tests, qtest clocks, vm and keymaps (pre-PR-FINAL) Date: Wed, 8 Jan 2025 12:10:22 +0000 Message-Id: <20250108121054.1126164-1-alex.bennee@linaro.org> X-Mailer: git-send-email 2.39.5 MIME-Version: 1.0 Received-SPF: pass client-ip=2a00:1450:4864:20::52b; envelope-from=alex.bennee@linaro.org; helo=mail-ed1-x52b.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=unavailable autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: qemu-devel-bounces+patch=linaro.org@nongnu.org Sender: qemu-devel-bounces+patch=linaro.org@nongnu.org There are number of parts to this series. The first is the updated images for all the guests that didn't make it into 9.2. There are also some new functional tests for virtio-gpu along with some other clean-ups. The qtest patches focus on ensuring things calling clock_step and clock_set actually pay attention to return values. The virtio tests needed a little little re-jigging as they don't need timeout loops at all (v2). We bump libvirt-ci so we can move the riscv64 cross container to testing/trixie which will hopefully make the image less prone to sid breakages. Finally we make a few tweaks to tests/vm which were helpful when chasing the keymap issue. I still think there is a race condition in there somewhere as I can't reliably build the FreeBSD VMs from scratch. The pc-bios dependency fixup I think addresses the failure but I'm a little unsure about the meason stuff. I did a v4 re-spin because I split apart some unrelated changes. I still plan to send the PR at the end of the week. For v2 - add test/vm and lcitool updates - don't move clock_step, remove them for virtio tests For v3 - review comments and checkpatch fixes - MAINTAINERS updates - add zstd uncompress function and use it For v4 - split unrelated changes from vulkan tests - use utility functions for tuxruntest The following still need review: tests/functional: update tuxruntest to use uncompress utility pc-bios: ensure keymaps dependencies set vnc tests tests/vm: allow interactive login as root tests/vm: partially un-tabify help output tests/docker: move riscv64 cross container from sid to trixie tests/functional: extend test_aarch64_virt with vulkan test tests/functional: bail aarch64_virt tests early if missing TCG tests/functional: remove unused kernel_command_line tests/functional: add zstd support to uncompress utility Alex. Alex Bennée (28): tests/functional: update the arm tuxrun tests tests/functional: update the i386 tuxrun tests tests/functional: add a m68k tuxrun tests tests/functional: update the mips32 tuxrun tests tests/functional: update the mips32el tuxrun tests tests/functional: update the mips64 tuxrun tests tests/functional: update the mips64el tuxrun tests tests/functional: update the ppc32 tuxrun tests tests/functional: update the ppc64 tuxrun tests tests/functional: update the riscv32 tuxrun tests tests/functional: update the riscv64 tuxrun tests tests/functional: update the s390x tuxrun tests tests/functional: update the sparc64 tuxrun tests tests/functional: update the x86_64 tuxrun tests tests/qtest: remove clock_steps from virtio tests system/qtest: properly feedback results of clock_[step|set] tests/functional: remove hacky sleep from the tests tests/functional: add zstd support to uncompress utility tests/functional: update tuxruntest to use uncompress utility tests/functional: remove unused kernel_command_line tests/functional: bail aarch64_virt tests early if missing TCG tests/functional: extend test_aarch64_virt with vulkan test tests/lcitool: bump to latest version of libvirt-ci tests/docker: move riscv64 cross container from sid to trixie tests/vm: fix build_path based path tests/vm: partially un-tabify help output tests/vm: allow interactive login as root pc-bios: ensure keymaps dependencies set vnc tests Daniel P. Berrangé (1): tests/lcitool: remove temp workaround for debian mips64el Philippe Mathieu-Daudé (1): dockerfiles: Remove 'MAINTAINER' entry in debian-tricore-cross.docker Pierrick Bouvier (1): tests/functional/aarch64: add tests for FEAT_RME Wainer dos Santos Moschetta (1): MAINTAINERS: Remove myself from reviewers MAINTAINERS | 3 +- system/qtest.c | 23 ++-- tests/qtest/libqos/virtio.c | 4 - .gitlab-ci.d/cirrus/freebsd-14.vars | 2 +- pc-bios/keymaps/meson.build | 17 ++- .../dockerfiles/debian-mips64el-cross.docker | 9 ++ .../dockerfiles/debian-riscv64-cross.docker | 4 +- .../dockerfiles/debian-tricore-cross.docker | 2 - tests/functional/meson.build | 5 + tests/functional/qemu_test/tuxruntest.py | 12 +- tests/functional/qemu_test/uncompress.py | 26 ++++ tests/functional/test_aarch64_rme_sbsaref.py | 69 +++++++++++ tests/functional/test_aarch64_rme_virt.py | 98 +++++++++++++++ tests/functional/test_aarch64_virt.py | 117 ++++++++++++++---- tests/functional/test_arm_tuxrun.py | 28 ++--- tests/functional/test_i386_tuxrun.py | 8 +- tests/functional/test_m68k_tuxrun.py | 34 +++++ tests/functional/test_mips64_tuxrun.py | 8 +- tests/functional/test_mips64el_tuxrun.py | 8 +- tests/functional/test_mips_tuxrun.py | 8 +- tests/functional/test_mipsel_tuxrun.py | 8 +- tests/functional/test_ppc64_tuxrun.py | 16 +-- tests/functional/test_ppc_tuxrun.py | 8 +- tests/functional/test_riscv32_tuxrun.py | 8 +- tests/functional/test_riscv64_tuxrun.py | 16 +-- tests/functional/test_s390x_tuxrun.py | 8 +- tests/functional/test_sparc64_tuxrun.py | 8 +- tests/functional/test_x86_64_tuxrun.py | 8 +- tests/lcitool/libvirt-ci | 2 +- tests/lcitool/mappings.yml | 29 ----- tests/lcitool/refresh | 4 +- tests/qtest/meson.build | 2 +- tests/vm/Makefile.include | 29 ++--- tests/vm/basevm.py | 12 +- tests/vm/generated/freebsd.json | 2 +- 35 files changed, 463 insertions(+), 182 deletions(-) create mode 100755 tests/functional/test_aarch64_rme_sbsaref.py create mode 100755 tests/functional/test_aarch64_rme_virt.py create mode 100644 tests/functional/test_m68k_tuxrun.py