From patchwork Mon Jan 8 15:13:52 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: =?utf-8?q?Alex_Benn=C3=A9e?= X-Patchwork-Id: 760775 Delivered-To: patch@linaro.org Received: by 2002:a5d:6e02:0:b0:337:62d3:c6d5 with SMTP id h2csp936279wrz; Mon, 8 Jan 2024 07:16:13 -0800 (PST) X-Google-Smtp-Source: AGHT+IEbtBCnQJFec56CmVOGPkxzaIkmPE2L5jtTLgB6affK1e1BDM9AwdDOeSZSMYatiHrUPuZg X-Received: by 2002:a05:620a:4722:b0:781:e973:29bc with SMTP id bs34-20020a05620a472200b00781e97329bcmr5522017qkb.144.1704726973345; Mon, 08 Jan 2024 07:16:13 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1704726973; cv=none; d=google.com; s=arc-20160816; b=UQp+m1OB6yVfiZy3zaNmCqKavioETjCVVFamq7dUTIvE74jRSg5F1x5trNVaOQW10m 9KkjE/BepioUhwsRl3r0ytqgULLabEgk8N7jegunaT4Gs4Vu/gmLRpCWO8VqRY/czmVv c3EvOudrwV7POHgnif+HdLXJU2nMygub/6Jz2WtCkoeRiAc1YhyZFb292aGp97A037Cw CIJkyBySz5IEeAm63shMwgaohqW1jN82KiO8V4QTexuveQ7e3lDllLOKMVlSlaIcvMnB 0o6F8DipEzIf1/+5ltg8QW9QCRb4higlLIyePB9iiEwiQEMA3u9XOUU/HzyHMcmanPoz 7dQA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:list-subscribe:list-help:list-post:list-archive :list-unsubscribe:list-id:precedence:content-transfer-encoding :mime-version:references:in-reply-to:message-id:date:subject:cc:to :from:dkim-signature; bh=CCcg7ysSyOpy/NHtcycGrXvCgSegX/kK/v3WtacdHyY=; fh=NtC0c/BN25XLBfbNkbcmcqHqcFGdCp1JfAsgzwgoJVk=; b=LB7S1i3/V7ca1Xuew7StIs1HPH6/vz6UOD7Jd3ArtYZOJalQyNQAmwagCg5qERoLVB kyfYnNcP0Hvz/XgLkY1qzxX9b/fsTZwH8HvlU+6jAv31eilsDNLRZRiiSGr0maYT8ukp vVhNE92yKuvyMGMoNNRc972ebQxyXBgeIMb3uiiyKVnJolaiCQdqf3ne6s6Aj4S5npS3 6vZARsxNeSrhry9G7cY0YltbQ2keVZMVdvV2K9XwgDe2fJGcsxJ0Vs3nx1Bc9fj/aba1 yHCEBnx/dMan4+9EnM7PtKmV96e+arIX8gKOvu7EeIY9yqaZFdkJJl8oMP36JgbBRfPe SOgQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=j0FXqPgo; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from lists.gnu.org (lists.gnu.org. [209.51.188.17]) by mx.google.com with ESMTPS id l20-20020a37f514000000b007811762c5aesi7571112qkk.207.2024.01.08.07.16.13 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Mon, 08 Jan 2024 07:16:13 -0800 (PST) Received-SPF: pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; Authentication-Results: mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=j0FXqPgo; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1rMrKN-0004Hl-AO; Mon, 08 Jan 2024 10:14:11 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1rMrKL-0004Ga-42 for qemu-devel@nongnu.org; Mon, 08 Jan 2024 10:14:09 -0500 Received: from mail-wr1-x432.google.com ([2a00:1450:4864:20::432]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1rMrKH-0001d8-GW for qemu-devel@nongnu.org; Mon, 08 Jan 2024 10:14:08 -0500 Received: by mail-wr1-x432.google.com with SMTP id ffacd0b85a97d-33678156e27so1931683f8f.1 for ; Mon, 08 Jan 2024 07:14:05 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; t=1704726844; x=1705331644; darn=nongnu.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=CCcg7ysSyOpy/NHtcycGrXvCgSegX/kK/v3WtacdHyY=; b=j0FXqPgotKUB+gP1zd3Wgzkh8Lp4s5pV5kV4A+WCacIdHiPPYUf9J1X7qgrwMADSlN o/xoTppEi+QbFNd/wpJPXUbXHJY39aL3/6G8a2K2rZZqJp7S/Pc2rCjCi+Udg9bix/qC kmcOS1rd5QKutNYK/kWLu35Ba5oCHXVO3QRya8taDXQDMt0bWPfuMrD1ZeptNVKrR4nB 9LvJqfB+/dRlB3amHriR9NMUyfUTwsznEtjSF+ctPA5w+KVJZG7p/OGU5tzYNc41iltC RNf8g7yNNQacoj8LzVsqzogobp1ap4M8SLl0lFG5pa0eCRvc/TmJyWXL1kaByiF8oPJ3 ZPCw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1704726844; x=1705331644; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=CCcg7ysSyOpy/NHtcycGrXvCgSegX/kK/v3WtacdHyY=; b=gkmyn2LF/9V/S6n4Fyw+TPY6zMKH/7TIzHQy4nOMwfJETnF5NNIWKq/gKpJ5Q/AtOt UPR3LASNGKTyss9uCtr9VI9On5mW6bPryZYxlNJ2SMPwM1g+ZKmRKnhsv7JAoc3eDMyN bqlK8zk8K+zM6sd0POyytu4/sZeIEb1vjdYUKeDQvSR/FVSUGKJhc5Z9e2kr858LQoev jDQJBDlpmjQiaixo2uCvRDvaS2AirANkONXaP7Jn82piQZfHAM6uqOQBCIVGGVgKU6jG mBBq384+d6YELl4TCHXwybNiCBVd+j258HKQNKae+HXUkd4ksEw+E3OFyJc5WPgSPP+L S7LQ== X-Gm-Message-State: AOJu0YxSaoI0ePWoDTCwq84C7TBeHZAYkezvDYL6e7ytqDW2FhB81mZ1 RLIsfvpvWbyxgb87VFMYwo3epGDIpUNP6w== X-Received: by 2002:a5d:4d01:0:b0:336:7e06:390e with SMTP id z1-20020a5d4d01000000b003367e06390emr2009413wrt.134.1704726843906; Mon, 08 Jan 2024 07:14:03 -0800 (PST) Received: from draig.lan ([85.9.250.243]) by smtp.gmail.com with ESMTPSA id o5-20020adfca05000000b00336ee9edbb3sm8028968wrh.94.2024.01.08.07.13.56 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 08 Jan 2024 07:14:01 -0800 (PST) Received: from draig.lan (localhost [IPv6:::1]) by draig.lan (Postfix) with ESMTP id F2BEA5F951; Mon, 8 Jan 2024 15:13:53 +0000 (GMT) From: =?utf-8?q?Alex_Benn=C3=A9e?= To: qemu-devel@nongnu.org Cc: =?utf-8?q?Alex_Benn=C3=A9e?= , Pavel Dovgalyuk , Pavel Dovgalyuk , Paolo Bonzini , Cleber Rosa , =?utf-8?q?Philippe_Mathieu-Daud=C3=A9?= , Wainer dos Santos Moschetta , Beraldo Leal Subject: [PULL 13/13] tests/avocado: remove skips from replay_kernel Date: Mon, 8 Jan 2024 15:13:52 +0000 Message-Id: <20240108151352.2199097-14-alex.bennee@linaro.org> X-Mailer: git-send-email 2.39.2 In-Reply-To: <20240108151352.2199097-1-alex.bennee@linaro.org> References: <20240108151352.2199097-1-alex.bennee@linaro.org> MIME-Version: 1.0 Received-SPF: pass client-ip=2a00:1450:4864:20::432; envelope-from=alex.bennee@linaro.org; helo=mail-wr1-x432.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: qemu-devel-bounces+patch=linaro.org@nongnu.org Sender: qemu-devel-bounces+patch=linaro.org@nongnu.org With the latest fixes for #2010 and #2013 these tests look pretty stable now. Of course the only way to be really sure is to run it in the CI infrastructure and see what breaks. Acked-by: Pavel Dovgalyuk Signed-off-by: Alex Bennée Message-Id: <20231211091346.14616-14-alex.bennee@linaro.org> diff --git a/tests/avocado/replay_kernel.py b/tests/avocado/replay_kernel.py index 1eaa36444cb..6fdcbd6ac3d 100644 --- a/tests/avocado/replay_kernel.py +++ b/tests/avocado/replay_kernel.py @@ -98,13 +98,10 @@ def test_i386_pc(self): self.run_rr(kernel_path, kernel_command_line, console_pattern, shift=5) - # See https://gitlab.com/qemu-project/qemu/-/issues/2010 - @skipUnless(os.getenv('QEMU_TEST_FLAKY_TESTS'), 'Test sometimes gets stuck') def test_x86_64_pc(self): """ :avocado: tags=arch:x86_64 :avocado: tags=machine:pc - :avocado: tags=flaky """ kernel_url = ('https://archives.fedoraproject.org/pub/archive/fedora' '/linux/releases/29/Everything/x86_64/os/images/pxeboot' @@ -135,8 +132,6 @@ def test_mips_malta(self): self.run_rr(kernel_path, kernel_command_line, console_pattern, shift=5) - # See https://gitlab.com/qemu-project/qemu/-/issues/2013 - @skipUnless(os.getenv('QEMU_TEST_FLAKY_TESTS'), 'Test is unstable on GitLab') def test_mips64el_malta(self): """ This test requires the ar tool to extract "data.tar.gz" from @@ -152,7 +147,6 @@ def test_mips64el_malta(self): :avocado: tags=arch:mips64el :avocado: tags=machine:malta - :avocado: tags=flaky """ deb_url = ('http://snapshot.debian.org/archive/debian/' '20130217T032700Z/pool/main/l/linux-2.6/' @@ -200,13 +194,10 @@ def test_arm_virt(self): self.run_rr(kernel_path, kernel_command_line, console_pattern, shift=1) - @skipUnless(os.getenv('QEMU_TEST_FLAKY_TESTS'), 'Test is unstable on GitLab') - def test_arm_cubieboard_initrd(self): """ :avocado: tags=arch:arm :avocado: tags=machine:cubieboard - :avocado: tags=flaky """ deb_url = ('https://apt.armbian.com/pool/main/l/' 'linux-5.10.16-sunxi/linux-image-current-sunxi_21.02.2_armhf.deb') @@ -354,7 +345,6 @@ def test_m68k_mcf5208evb(self): file_path = self.fetch_asset(tar_url, asset_hash=tar_hash) self.do_test_advcal_2018(file_path, 'sanity-clause.elf') - @skip("Test currently broken") # Console stuck as of 5.2-rc1 def test_microblaze_s3adsp1800(self): """ :avocado: tags=arch:microblaze @@ -389,7 +379,6 @@ def test_or1k_sim(self): file_path = self.fetch_asset(tar_url, asset_hash=tar_hash) self.do_test_advcal_2018(file_path, 'vmlinux') - @skip("nios2 emulation is buggy under record/replay") def test_nios2_10m50(self): """ :avocado: tags=arch:nios2