From patchwork Mon Apr 17 13:43:15 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: =?utf-8?q?Alex_Benn=C3=A9e?= X-Patchwork-Id: 673826 Delivered-To: patch@linaro.org Received: by 2002:adf:fcce:0:0:0:0:0 with SMTP id f14csp1515542wrs; Mon, 17 Apr 2023 06:45:17 -0700 (PDT) X-Google-Smtp-Source: AKy350axaFxA01C50f7g0fh84yhugKbntCs4hZ8sBWIwRUABjREV0Q9PSTbeiIZtO+zNS5uM+6X4 X-Received: by 2002:a05:622a:14c6:b0:3e8:77e9:f67f with SMTP id u6-20020a05622a14c600b003e877e9f67fmr24132197qtx.24.1681739117179; Mon, 17 Apr 2023 06:45:17 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1681739117; cv=none; d=google.com; s=arc-20160816; b=n6AL6vR6Az43jmVIVdosKkMy+57N3+x2yXfkfmZtuTE4WZM9ozR0rAKz0B1K7p+7Xk Zn45IP9cF8hIgoACnwPhq4hvd0mFiedm1Ys1nS6DIpqMEKzWP9la/DNyagxP9res8z8x 6qE24lbJ3jp82jE9GD3LulR7KcozgDIRPym95Yh3opM/NgAI2XIiSu+teBqpfOigRIR9 vjnTwLJGXOu3AVTXvRpr+hIQlOX3Yb0vQT3wVpZx4FkpAtbGdDCsFkq6y8DCHtC0v9eM 0x79+R9v2XMuUp+wrIEQTdT5wlNoQYyMrZm81OVv1hKHIHA7WGFEbe/yF1xN0OqaH9bX CwIg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:list-subscribe:list-help:list-post:list-archive :list-unsubscribe:list-id:precedence:content-transfer-encoding :mime-version:message-id:date:subject:cc:to:from:dkim-signature; bh=/AgPMEkJj5uDNj5jnrln7+4tm9L02eo8Q2wwYkrP4dg=; b=dbYEkKaDwuV8SNE9SYt0CKrol7YbcOuhJppwgW4JeXceytk9888MjWC27a2GAmBx4b jxs1fjiw3+KDcgJY2VbPEPoUHIX0sHq/AiPhxsk9QIHQSP/YT2wYVNyAfv6LG4G7bCkg QskuKlWZ6onJ4dUmWI1jvQhsXrfAKVynSq+iHmUYd29GBX2uR2FWDQ70dV5MxKWUrBv+ jASmkRxFpIQcMttiyHXptiZLUigozYMHoOPTRAKzULJWDlPvpXSkjM6NT7HoPqUiq+GK /qdmZTTuoTHtf7hvJ0z6JQFK7Phy5n87suByiE7dPTmgJM/PwbLtHnnmbOi+M9FpQaO1 Nphw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=nBKvT7Oq; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from lists.gnu.org (lists.gnu.org. [209.51.188.17]) by mx.google.com with ESMTPS id az20-20020a05620a171400b0072ce109a7d7si5608945qkb.233.2023.04.17.06.45.17 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Mon, 17 Apr 2023 06:45:17 -0700 (PDT) Received-SPF: pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; Authentication-Results: mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=nBKvT7Oq; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1poP91-00010A-VX; Mon, 17 Apr 2023 09:43:47 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1poP8o-0000wK-FX for qemu-devel@nongnu.org; Mon, 17 Apr 2023 09:43:35 -0400 Received: from mail-wm1-x332.google.com ([2a00:1450:4864:20::332]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1poP8g-0006MK-9r for qemu-devel@nongnu.org; Mon, 17 Apr 2023 09:43:34 -0400 Received: by mail-wm1-x332.google.com with SMTP id 5b1f17b1804b1-3f0aabd1040so41423065e9.1 for ; Mon, 17 Apr 2023 06:43:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; t=1681739003; x=1684331003; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date:message-id:reply-to; bh=/AgPMEkJj5uDNj5jnrln7+4tm9L02eo8Q2wwYkrP4dg=; b=nBKvT7OqUIRWbNLUT7LIF5k+FKkNvL1j5A53WcDnX3NAVruUo+P40n8XIep+TGvOiq IVJd/Iu56ocGPGRgJ74FSA83iSOo18TLLuCvitriFrcTk8emKCtnvCv8g+5NCpNF403v ZbCW0H21PGNiyqt3IFfy5MCoGgu5u7H5frKdNIaRnCurs5V4RB3hgm+cuQ1xGkgWR7g1 nok5+qaFUs7DlvUYCN6NVUArFqx3+q+apOpSK4Qql9TtYA2bTEKXsVkYZnWejt2xgCDr C2+H9QN5k2ntsl6022jzn0tcaG7hLAJ7Bux2AfXetKGn55g0/EdlpaYUzqYY0SNjFdJ9 EUFQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1681739003; x=1684331003; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=/AgPMEkJj5uDNj5jnrln7+4tm9L02eo8Q2wwYkrP4dg=; b=hrI9Ikzx0BWgyhPBPR71vy9WGS0pjbwfrCZxip1H9m7tAGkvJACfMb+UYINc2/36zM 1SN4nb6jjIY2+phSMTpzdKV3U6xtGiH4m3YUdcqkkBh03m7+vK4JqykTjyyVb+wIuLg4 6MhK6r7ZO4BWO2J0GEpubR4bnEipq9swxOvhPcBXD9JqO46KZJCkXZ/zYrPMVxS1PrDB 2X2JFQZDbEQ7J9+Ik73dqntuWT2Wh9FWi1N0jqPecYA6x+1J7G3gPSE8z9hZ5KcfIwgV GvE6F3WrBDEZ9aMaxhYPvjsswix+YWPk5d537L/JeWqeRRZY+GEGKIFqSFlQ9DTUXYSG cdvQ== X-Gm-Message-State: AAQBX9cITv9ys/4Uc9ndm0eg2rHEYEF0vyhgn4c06xMfogKcqd25AeG+ /JCik57ZQVdT5joFUlzU5P0O9g== X-Received: by 2002:a5d:6b89:0:b0:2fa:88d3:f8b8 with SMTP id n9-20020a5d6b89000000b002fa88d3f8b8mr2307948wrx.12.1681739003631; Mon, 17 Apr 2023 06:43:23 -0700 (PDT) Received: from zen.linaroharston ([85.9.250.243]) by smtp.gmail.com with ESMTPSA id i4-20020a5d55c4000000b002f74578f494sm8171246wrw.41.2023.04.17.06.43.22 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 17 Apr 2023 06:43:22 -0700 (PDT) Received: from zen.lan (localhost [127.0.0.1]) by zen.linaroharston (Postfix) with ESMTP id CDDB81FFB7; Mon, 17 Apr 2023 14:43:21 +0100 (BST) From: =?utf-8?q?Alex_Benn=C3=A9e?= To: qemu-devel@nongnu.org Cc: Peter Maydell , Bastian Koppelmann , Markus Armbruster , Beraldo Leal , =?utf-8?q?Alex_Benn=C3=A9e?= , Thomas Huth , Stefan Hajnoczi , =?utf-8?q?Marc-Andr=C3=A9_Lureau?= , =?utf-8?q?Daniel_P=2E_Berrang=C3=A9?= , Cleber Rosa , Radoslaw Biernacki , =?utf-8?q?Philippe_Mathieu-Daud=C3=A9?= , Leif Lindholm , John Snow , Paolo Bonzini , Wainer dos Santos Moschetta , qemu-arm@nongnu.org Subject: [PATCH v4 0/6] testing/next: avocado, docs, gitlab Date: Mon, 17 Apr 2023 14:43:15 +0100 Message-Id: <20230417134321.3627231-1-alex.bennee@linaro.org> X-Mailer: git-send-email 2.39.2 MIME-Version: 1.0 Received-SPF: pass client-ip=2a00:1450:4864:20::332; envelope-from=alex.bennee@linaro.org; helo=mail-wm1-x332.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, T_SCC_BODY_TEXT_LINE=-0.01, T_SPF_TEMPERROR=0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: qemu-devel-bounces+patch=linaro.org@nongnu.org Sender: qemu-devel-bounces+patch=linaro.org@nongnu.org This is the current state of my testing tree. It contains a few patches that didn't make it into 8.0 and more testing fixes including a bump to the avocado release including Thomas' --max-parallel-tasks hack to avoid running the tests in parallel. So far it doesn't look like its causing any problems although I am seeing some timeouts on the BSDs. The following patches need review: tests/avocado: use the new snapshots for testing tests/requirements.txt: bump up avocado-framework version to 101.0 (0 acks, 1 sobs, 1 tbs) Alex Bennée (2): tests/avocado: use the new snapshots for testing qemu-options: finesse the recommendations around -blockdev Kautuk Consul (1): tests/requirements.txt: bump up avocado-framework version to 101.0 Philippe Mathieu-Daudé (1): tests/avocado: Add set of boot tests on SBSA-ref Thomas Huth (2): gitlab-ci: Avoid to re-run "configure" in the device-crash-test jobs scripts/device-crash-test: Add a parameter to run with TCG only MAINTAINERS | 1 + .gitlab-ci.d/buildtest.yml | 6 +- qemu-options.hx | 24 +++- scripts/device-crash-test | 4 +- tests/Makefile.include | 18 ++- tests/avocado/machine_aarch64_sbsaref.py | 158 +++++++++++++++++++++ tests/avocado/tuxrun_baselines.py | 170 +++++++++++++++++++---- tests/requirements.txt | 2 +- 8 files changed, 343 insertions(+), 40 deletions(-) create mode 100644 tests/avocado/machine_aarch64_sbsaref.py