From patchwork Fri Dec 1 09:36:26 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: =?utf-8?q?Alex_Benn=C3=A9e?= X-Patchwork-Id: 748988 Delivered-To: patch@linaro.org Received: by 2002:adf:f9cb:0:b0:32d:baff:b0ca with SMTP id w11csp168671wrr; Fri, 1 Dec 2023 01:39:06 -0800 (PST) X-Google-Smtp-Source: AGHT+IFjGidVN63K/dKK3pWuB0LttU5dDY6xCe9DsT22HSFCrhKyf0eHNZsYcbdoD9C3f2vBL7gy X-Received: by 2002:a67:e909:0:b0:464:4fd1:9387 with SMTP id c9-20020a67e909000000b004644fd19387mr7766402vso.4.1701423546425; Fri, 01 Dec 2023 01:39:06 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1701423546; cv=none; d=google.com; s=arc-20160816; b=tO+zgiH54AVfDMVjDdW3B6D6dCLLIzO148nDI9Ac0G97gRgG/tg9jujftZQjtGj53d OGI4DKlw/J/hlstc7Uqnm5B3W4H0cR6SZT8mq4aHkHuWoOiBV2alFV9lTiViBWvBKqB/ 8ujqLp++6vFcKAFVzxFvuy5vgUMqzk2PLbhJzec4NzJS4H8ictK18eFkNtuTLpB+GoM1 fw+gZ8flxK2LuOau35B7ldgEtOFmWCQNs8eU25x70sSdaL+Q6naP6Cp7YsyhMJd7Ky+L 3Mg8hqb/D6Gz0n6ADUIn9RNp194GMQQuDo9CXNCCdSI41ayz6icl7Ui0g3vy5zTqsGRz Kyiw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:list-subscribe:list-help:list-post:list-archive :list-unsubscribe:list-id:precedence:content-transfer-encoding :mime-version:message-id:date:subject:cc:to:from:dkim-signature; bh=gxbS2bqtSols01ki1dGMQKNbIUJ4Ip2adQtteeYqp2Y=; fh=nUw+LUW/RGBz2SNf0vgpYoxsz7YIcRha0AoZqkhC2t0=; b=GkaAddumsy4q5vhdo1uNVn4KDWgbQRJdTg6U6njxOjIAUUqafilO6N2+t2oT95hQiu qToRLDQWQhJ5aQeosDGvuIPVpiHWbVDjoP9NluUcuv5vwQeL1yjXjvmPiR0YU2BkAa+s BRZf1Lq7lSkrN3sn7mz1F2+ErzQZtAf1pCrO4rW/uRBtZ4HxSgKLb9B1bGHJUEBNXa8M oJgC2D0cUC29OyKTRa6BCRwOVgt9gooe97WAPPsLTPbzZ7VQCUlEWkaUOMqBwtfY/1bj FFhPHMGqNFvIcO9BVyMm8XYXotHlIKWX1ig7Oxw/Szy9wyWMY6Yw/FHP4RQ89NiQbQxa jcBQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=Z1pwXapz; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from lists.gnu.org (lists.gnu.org. [209.51.188.17]) by mx.google.com with ESMTPS id ep2-20020a05621418e200b0067a50dfd0ccsi2891998qvb.609.2023.12.01.01.39.06 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Fri, 01 Dec 2023 01:39:06 -0800 (PST) Received-SPF: pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; Authentication-Results: mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=Z1pwXapz; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1r8zwv-0003nd-K6; Fri, 01 Dec 2023 04:36:41 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1r8zwt-0003lf-TT for qemu-devel@nongnu.org; Fri, 01 Dec 2023 04:36:39 -0500 Received: from mail-wm1-x335.google.com ([2a00:1450:4864:20::335]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1r8zwq-00044j-Iu for qemu-devel@nongnu.org; Fri, 01 Dec 2023 04:36:39 -0500 Received: by mail-wm1-x335.google.com with SMTP id 5b1f17b1804b1-40b399a6529so19105945e9.1 for ; Fri, 01 Dec 2023 01:36:36 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; t=1701423395; x=1702028195; darn=nongnu.org; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date:message-id:reply-to; bh=gxbS2bqtSols01ki1dGMQKNbIUJ4Ip2adQtteeYqp2Y=; b=Z1pwXapzRQyuuwTrBRSpoj72TzS9AVaGqVE+44BIzvmS3NZ102i7Scafo0hg1SEJWl wgLk+2cY05HLcGGvOc14yfkFTbUZkvdzI+8Ja4fRzXfMPBB/0aotsxtt9ygKFA5pgKX1 07gKofORcPOyozWzMEuB6oHQJ7DfhvkFcnzSJydIAIAR1c8aAU4losNbDSkoG2wgH3Ob X15qzDk95W/m7pYapUADc5huB0hG5syMBtUA+X64OYwrouX/7CPKRzXKxjmd7wamPkPB 2iQ+H7vrFqhbk9nW3a05B+WipBkYvfaGQPlJEH+XhOMalmpIr60v4LTt26oWwvpqispW EVAQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1701423395; x=1702028195; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=gxbS2bqtSols01ki1dGMQKNbIUJ4Ip2adQtteeYqp2Y=; b=MulGed4BZ4t6G+ydVyjvHiYnFZ7+vFvbzR/esnPOLmyTNh2kKD0oQvyojFE7xL2A5W ACcwmlKHuLMrHSD3qWjSSufyq9O613Ln72zN719jcKNWdeI43rmvT0H7+KdGr9tD42nM kdfQLxi9yOycE/8On29VJbreGat159KKzsgk1ioTycix5axsTW37nZUVamlNeE7YvZHO rFgth0UVp9ZpUlsv95SiKoNrSRKtQqs++poPtlDM2QYFwe+XxU99EbdJYFH5splsGwwg uXLDWI0dm+W6ui6Ao3Dy9wNZoUwXuxVd2W8tXFEhc6s8zisk91USASdZAOmA/6LLDWAi 1NUg== X-Gm-Message-State: AOJu0YyYQCap6ctifBqfp3IiHfqKX4tCfvvOpo7zvGc6wkdU79gOHDSc WvzD1W4w2MA7pTnchqx+eyKjTg== X-Received: by 2002:a05:600c:1d0a:b0:40b:5e26:2386 with SMTP id l10-20020a05600c1d0a00b0040b5e262386mr495246wms.55.1701423394859; Fri, 01 Dec 2023 01:36:34 -0800 (PST) Received: from draig.lan ([85.9.250.243]) by smtp.gmail.com with ESMTPSA id z3-20020a05600c0a0300b0040839fcb217sm4911959wmp.8.2023.12.01.01.36.34 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 01 Dec 2023 01:36:34 -0800 (PST) Received: from draig.lan (localhost [IPv6:::1]) by draig.lan (Postfix) with ESMTP id DEB025FB5F; Fri, 1 Dec 2023 09:36:33 +0000 (GMT) From: =?utf-8?q?Alex_Benn=C3=A9e?= To: qemu-devel@nongnu.org Cc: Eric Farman , Peter Maydell , Leif Lindholm , Beraldo Leal , Andrew Jeffery , Paolo Bonzini , Marcin Juszkiewicz , Pavel Dovgalyuk , Thomas Huth , qemu-arm@nongnu.org, Radoslaw Biernacki , =?utf-8?q?Alex_?= =?utf-8?q?Benn=C3=A9e?= , Yoshinori Sato , Eric Auger , Halil Pasic , qemu-s390x@nongnu.org, Wainer dos Santos Moschetta , =?utf-8?q?C=C3=A9dric_Le_Goater?= , Christian Borntraeger , Aurelien Jarno , Cleber Rosa , Joel Stanley , =?utf-8?q?Philippe_Mathieu-Daud=C3=A9?= Subject: [PATCH v2 0/7] final fixes for 8.2 Date: Fri, 1 Dec 2023 09:36:26 +0000 Message-Id: <20231201093633.2551497-1-alex.bennee@linaro.org> X-Mailer: git-send-email 2.39.2 MIME-Version: 1.0 Received-SPF: pass client-ip=2a00:1450:4864:20::335; envelope-from=alex.bennee@linaro.org; helo=mail-wm1-x335.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=unavailable autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: qemu-devel-bounces+patch=linaro.org@nongnu.org Sender: qemu-devel-bounces+patch=linaro.org@nongnu.org 8.2 is looking fairly stable but I do have one bug fix for gdbstub which I came across while debugging something else. The changes for avocado rationalise all flaky tests under the QEMU_TEST_FLAKY_TESTS environment variable. The final patch re-adds the flaky tests to the CI as a manually run allow_fail job so we can still attempt to debug their failure in the place they tend to fall over. v2 Acked-by: Stefan Hajnoczi --- - addressed some review comments - emphasised raising a bug for failing tests - drop some tests now missing assets online - fix wrong microblaze target for tests The following still need review: gitlab: build the correct microblaze target tests/avocado: tag sbsa tests as tcg only tests/avocado: drop malta yamon tests tests/avocado: drop BootLinuxConsole.test_mips_malta_cpio test Alex. Alex Bennée (7): gdbstub: use a better signal when we halt for IO reasons docs/devel: rationalise unstable gitlab tests under FLAKY_TESTS tests/avocado: drop BootLinuxConsole.test_mips_malta_cpio test tests/avocado: drop malta yamon tests tests/avocado: tag sbsa tests as tcg only gitlab: build the correct microblaze target gitlab: add optional job to run flaky avocado tests docs/devel/testing.rst | 32 ++++++++++------ gdbstub/internals.h | 1 + gdbstub/system.c | 2 +- .gitlab-ci.d/buildtest.yml | 32 +++++++++++++++- tests/avocado/boot_linux.py | 10 +++-- tests/avocado/boot_linux_console.py | 28 ++------------ tests/avocado/intel_iommu.py | 6 ++- tests/avocado/linux_initrd.py | 7 +++- tests/avocado/machine_aarch64_sbsaref.py | 1 + tests/avocado/machine_aspeed.py | 10 +++-- tests/avocado/machine_mips_malta.py | 47 ++++-------------------- tests/avocado/machine_rx_gdbsim.py | 10 +++-- tests/avocado/machine_s390_ccw_virtio.py | 3 +- tests/avocado/replay_kernel.py | 8 +++- tests/avocado/reverse_debugging.py | 16 +++++--- tests/avocado/smmu.py | 6 ++- tests/avocado/tuxrun_baselines.py | 5 ++- 17 files changed, 122 insertions(+), 102 deletions(-)