From patchwork Tue Jan 7 16:51:38 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: =?utf-8?q?Alex_Benn=C3=A9e?= X-Patchwork-Id: 855487 Delivered-To: patch@linaro.org Received: by 2002:adf:8b05:0:b0:385:e875:8a9e with SMTP id n5csp317716wra; Tue, 7 Jan 2025 08:54:07 -0800 (PST) X-Forwarded-Encrypted: i=2; AJvYcCVJwyPYJZtTRdEIBNjrrquFuEYnNv1Vl2BAr/GVrwiTYssgBaeFsdM87XCLSrcbkF/K6JxyBQ==@linaro.org X-Google-Smtp-Source: AGHT+IE3ZU1Urx0WUlvWeoH37k5hL8JI+625x8OVW+buWmP73cIeDD8B3adsZH271AjmhY3EgLNN X-Received: by 2002:a05:6214:20aa:b0:6da:dbf0:9640 with SMTP id 6a1803df08f44-6dd2332ed7cmr994835606d6.7.1736268847663; Tue, 07 Jan 2025 08:54:07 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1736268847; cv=none; d=google.com; s=arc-20240605; b=TDcVfFMiB7wYB0OvWjtxvB1/AaLspe1vy6w/Lrxm6Bs9YcDMfNVpEa31aEw4JRk9xx mYduAeK979H5M0P4hxtvFVaXghj0VP9rPaq/rmqm3oskTtXh2RFrMouKqzBEBqr+lNVP tm0NS24qeOVZtfOnKUbFjY9L4je2TremRfNxHbGH+vYFy0y82Ve0tB3aLESNXTwd34gp sNvzI+Khkk6r0xEeZpC1TVRyV0FzlIVrjmV1DBdFxwZmLqCr4aNCLzWNwsHOsYuvrx6d LeRwiQplqTi/75Kn2sK3uzOP2nBKXqk3fRUgxgCTA/lUMkGJ7oSOCwYh2tQVFllYudhQ pCxA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=sender:errors-to:list-subscribe:list-help:list-post:list-archive :list-unsubscribe:list-id:precedence:content-transfer-encoding :mime-version:message-id:date:subject:cc:to:from:dkim-signature; bh=0ETVcdYawHw9PabUk74gz9REVsCEoFRnRmtR83wHydA=; fh=gCrRMsBOO2s5UczjHW2I0Xj39iNRWP/OR2J6q01yAGs=; b=ftnbAiOFDuyF0/8d4WRO2xuctPRyvNdQyqjIoHZC4MgjXADJrzn53qvwDGJGK05Qfl nzNBBGVH+gDeoWMYiNf1sXXkk80sQA5ByihA11iYkz93ltAte65IrEQxbcIa/eQwt1zh 4adG7x7V8ZJLq7TUnHmx0py7hQ5jcprehcc5aNXFFItpzwBG95Pkw7AeQ1SYNzp5HY7w e+ql9wxXmBtfIAJMOWDbemEf6FD3gWBjKl250Ftn3v/tEMScSTOtOpT4/oeAh+KpaHob T8ogRLgXBuCmgPt+usFvI6CDanQcotaMSXKuhbLC94boVsmGqifRDb7ZR6N6oyCCsNdJ agIw==; dara=google.com ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=G5LShjcn; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org; dara=neutral header.i=@linaro.org Return-Path: Received: from lists.gnu.org (lists.gnu.org. [209.51.188.17]) by mx.google.com with ESMTPS id 6a1803df08f44-6dd18367d84si490319436d6.485.2025.01.07.08.54.07 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Tue, 07 Jan 2025 08:54:07 -0800 (PST) Received-SPF: pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; Authentication-Results: mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=G5LShjcn; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org; dara=neutral header.i=@linaro.org Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1tVCoc-00043m-9T; Tue, 07 Jan 2025 11:52:26 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1tVCoa-00042M-Eu for qemu-devel@nongnu.org; Tue, 07 Jan 2025 11:52:24 -0500 Received: from mail-wr1-x42d.google.com ([2a00:1450:4864:20::42d]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1tVCoO-0005p0-6y for qemu-devel@nongnu.org; Tue, 07 Jan 2025 11:52:24 -0500 Received: by mail-wr1-x42d.google.com with SMTP id ffacd0b85a97d-38789e5b6a7so7639696f8f.1 for ; Tue, 07 Jan 2025 08:52:11 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; t=1736268731; x=1736873531; darn=nongnu.org; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date:message-id:reply-to; bh=0ETVcdYawHw9PabUk74gz9REVsCEoFRnRmtR83wHydA=; b=G5LShjcnI+JX+ExDTVg5Mvsk4Vo4hFqKP4NJ1zktuzAziJcRPeXIWV92AtwmP8wbkL fx3mlyD4RrkPAsN+2P9Uve99/dKSe4D/6rzpTuBAIynqypDYfM2xMky3Ze1ZN3RvK4hm qJ0j07O9E63EdZXCi7754FQCAcup19eGcGsIyK63OqM55Ef5/mghej4VhIXReR+qjmLw s7uhZEBpQJGI75jtdSi2nR7deQVZdyM4lH9MfIjDWHtpClroXvXUiZiFhvILYem8z8Iz e22qC+TNH9ETlxaaKqjpb7fBkE34q8QBOoQAZTr0YSe384Y9u/DB/epq8iNmU5O/cyns BAsg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1736268731; x=1736873531; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=0ETVcdYawHw9PabUk74gz9REVsCEoFRnRmtR83wHydA=; b=xAv5aFJ6Aw+7uX1WP2QPm1dH3AyE9zyL6jsuedn/nkhGBsyoeIy85MuyoR3CnUvJZY xfZ/+vbpvr+OatW0FBG7gvWV+D36DazAtx8UZbJhJjtdGqx5EN48ayaGpKq8k/mu10R8 MXLy3Sq9cVKgv7roCIb1WgWdli5mQ8VJPiYMBNhCj5XkRSXrNzSOZ9DSXteHlkHvbxmv 208ljyqxhKzqiWjTjiYCUVqm1IBGuaQuigFm5ArzMGa++xJb4HV00sY7z9/QI/bQjW55 np8MYl/PIV9GMcoFOyA01Gsfx/VUk711Mrd9aZiKJQpJyrgCnZjdc775qlDoRdiE3+7Z BEFA== X-Gm-Message-State: AOJu0YwjQ03s0wxzYG1RvgzPTqVbYVw4GhWcooWgrWBXpWd0cYB926YG CTRoQQ6w795XWABbwUg+mJ7oFWwPkaADm5I/tuQfKnZ0vw14uFch2fkLipbNM28= X-Gm-Gg: ASbGncuINjmQlRwCpxuqiIwAJvunAYiyFdK1m2zV4bSqtERVZK0OjJB0dUHo4WSjjvB SDB7QeffZsblQf5WHWMMfOn+UCAaG1eGcQML9JeY0PlPgQQgrRD5SkZcP32pKQeZaD/n7L6SulJ yRHckFSHWuBxdUO3tcTa055Q82UnK4f7CmB9kuuAobWYHDX0iiyz7n3UqFQumr9fBBKCkq8oBF/ 7DSik8JNk+7zocve7EI6SBSNIzxJlkT2rjF3gZIfEO1e+gPiKOilyc= X-Received: by 2002:a05:6000:154f:b0:385:ef2f:92ad with SMTP id ffacd0b85a97d-38a221e181cmr60459122f8f.10.1736268730689; Tue, 07 Jan 2025 08:52:10 -0800 (PST) Received: from draig.lan ([85.9.250.243]) by smtp.gmail.com with ESMTPSA id ffacd0b85a97d-38a1c828ba0sm50011358f8f.14.2025.01.07.08.52.08 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 07 Jan 2025 08:52:08 -0800 (PST) Received: from draig.lan (localhost [IPv6:::1]) by draig.lan (Postfix) with ESMTP id 0F5C75F869; Tue, 7 Jan 2025 16:52:08 +0000 (GMT) From: =?utf-8?q?Alex_Benn=C3=A9e?= To: qemu-devel@nongnu.org Cc: Mark Cave-Ayland , Beraldo Leal , Ed Maste , Halil Pasic , qemu-ppc@nongnu.org, John Snow , Radoslaw Biernacki , Nicholas Piggin , Markus Armbruster , Leif Lindholm , =?utf-8?q?Marc-Andr=C3=A9_Lureau?= , =?utf-8?q?Philippe_Mathieu-Daud=C3=A9?= , Paolo Bonzini , Bin Meng , Daniel Henrique Barboza , Marcel Apfelbaum , qemu-riscv@nongnu.org, Christian Borntraeger , Wainer dos Santos Moschetta , qemu-s390x@nongnu.org, Alistair Francis , Liu Zhiwei , Fabiano Rosas , Weiwei Li , Harsh Prateek Bora , qemu-arm@nongnu.org, Li-Wen Hsu , Palmer Dabbelt , Daniel Henrique Barboza , Richard Henderson , Cleber Rosa , Marcin Juszkiewicz , Peter Maydell , Laurent Vivier , Aurelien Jarno , Eric Farman , Pavel Dovgalyuk , Jiaxun Yang , Thomas Huth , Laurent Vivier , Joel Stanley , =?utf-8?q?Daniel_P=2E_Berrang=C3=A9?= , =?utf-8?q?Alex?= =?utf-8?q?_Benn=C3=A9e?= , Bernhard Beschow , "Michael S. Tsirkin" Subject: [PATCH v3 00/29] testing/next: functional tests, qtest clocks, vm and keymaps (pre-PR) Date: Tue, 7 Jan 2025 16:51:38 +0000 Message-Id: <20250107165208.743958-1-alex.bennee@linaro.org> X-Mailer: git-send-email 2.39.5 MIME-Version: 1.0 Received-SPF: pass client-ip=2a00:1450:4864:20::42d; envelope-from=alex.bennee@linaro.org; helo=mail-wr1-x42d.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=unavailable autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: qemu-devel-bounces+patch=linaro.org@nongnu.org Sender: qemu-devel-bounces+patch=linaro.org@nongnu.org There are number of parts to this series. The first is the updated images for all the guests that didn't make it into 9.2. There are also some new functional tests for virtio-gpu along with some other clean-ups. The qtest patches focus on ensuring things calling clock_step and clock_set actually pay attention to return values. The virtio tests needed a little little re-jigging as they don't need timeout loops at all (v2). We bump libvirt-ci so we can move the riscv64 cross container to testing/trixie which will hopefully make the image less prone to sid breakages. Finally we make a few tweaks to tests/vm which were helpful when chasing the keymap issue. I still think there is a race condition in there somewhere as I can't reliably build the FreeBSD VMs from scratch. The pc-bios dependency fixup I think addresses the failure but I'm a little unsure about the meason stuff. I'll send a PR for everything that is reviewed later this week. For v2 - add test/vm and lcitool updates - don't move clock_step, remove them for virtio tests For v3 - review comments and checkpatch fixes - MAINTAINERS updates - add zstd uncompress function and use it The following still need review: pc-bios: ensure keymaps dependencies set vnc tests tests/vm: allow interactive login as root tests/vm: partially un-tabify help output tests/docker: move riscv64 cross container from sid to trixie tests/functional: extend test_aarch64_virt with vulkan test tests/functional: add zstd support to uncompress utility tests/qtest: remove clock_steps from virtio tests Alex. Alex Bennée (25): tests/functional: update the arm tuxrun tests tests/functional: update the i386 tuxrun tests tests/functional: add a m68k tuxrun tests tests/functional: update the mips32 tuxrun tests tests/functional: update the mips32el tuxrun tests tests/functional: update the mips64 tuxrun tests tests/functional: update the mips64el tuxrun tests tests/functional: update the ppc32 tuxrun tests tests/functional: update the ppc64 tuxrun tests tests/functional: update the riscv32 tuxrun tests tests/functional: update the riscv64 tuxrun tests tests/functional: update the s390x tuxrun tests tests/functional: update the sparc64 tuxrun tests tests/functional: update the x86_64 tuxrun tests tests/qtest: remove clock_steps from virtio tests system/qtest: properly feedback results of clock_[step|set] tests/functional: remove hacky sleep from the tests tests/functional: add zstd support to uncompress utility tests/functional: extend test_aarch64_virt with vulkan test tests/lcitool: bump to latest version of libvirt-ci tests/docker: move riscv64 cross container from sid to trixie tests/vm: fix build_path based path tests/vm: partially un-tabify help output tests/vm: allow interactive login as root pc-bios: ensure keymaps dependencies set vnc tests Daniel P. Berrangé (1): tests/lcitool: remove temp workaround for debian mips64el Philippe Mathieu-Daudé (1): dockerfiles: Remove 'MAINTAINER' entry in debian-tricore-cross.docker Pierrick Bouvier (1): tests/functional/aarch64: add tests for FEAT_RME Wainer dos Santos Moschetta (1): MAINTAINERS: Remove myself from reviewers MAINTAINERS | 3 +- system/qtest.c | 23 ++-- tests/qtest/libqos/virtio.c | 4 - .gitlab-ci.d/cirrus/freebsd-14.vars | 2 +- pc-bios/keymaps/meson.build | 17 ++- .../dockerfiles/debian-mips64el-cross.docker | 9 ++ .../dockerfiles/debian-riscv64-cross.docker | 4 +- .../dockerfiles/debian-tricore-cross.docker | 2 - tests/functional/meson.build | 5 + tests/functional/qemu_test/uncompress.py | 17 +++ tests/functional/test_aarch64_rme_sbsaref.py | 69 +++++++++++ tests/functional/test_aarch64_rme_virt.py | 98 +++++++++++++++ tests/functional/test_aarch64_virt.py | 114 +++++++++++++++--- tests/functional/test_arm_tuxrun.py | 28 ++--- tests/functional/test_i386_tuxrun.py | 8 +- tests/functional/test_m68k_tuxrun.py | 34 ++++++ tests/functional/test_mips64_tuxrun.py | 8 +- tests/functional/test_mips64el_tuxrun.py | 8 +- tests/functional/test_mips_tuxrun.py | 8 +- tests/functional/test_mipsel_tuxrun.py | 8 +- tests/functional/test_ppc64_tuxrun.py | 16 +-- tests/functional/test_ppc_tuxrun.py | 8 +- tests/functional/test_riscv32_tuxrun.py | 8 +- tests/functional/test_riscv64_tuxrun.py | 16 +-- tests/functional/test_s390x_tuxrun.py | 8 +- tests/functional/test_sparc64_tuxrun.py | 8 +- tests/functional/test_x86_64_tuxrun.py | 8 +- tests/lcitool/libvirt-ci | 2 +- tests/lcitool/mappings.yml | 29 ----- tests/lcitool/refresh | 4 +- tests/qtest/meson.build | 2 +- tests/vm/Makefile.include | 29 ++--- tests/vm/basevm.py | 12 +- tests/vm/generated/freebsd.json | 2 +- 34 files changed, 453 insertions(+), 168 deletions(-) create mode 100755 tests/functional/test_aarch64_rme_sbsaref.py create mode 100755 tests/functional/test_aarch64_rme_virt.py create mode 100644 tests/functional/test_m68k_tuxrun.py