From patchwork Tue Feb 28 19:06:53 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: =?utf-8?q?Alex_Benn=C3=A9e?= X-Patchwork-Id: 657494 Delivered-To: patch@linaro.org Received: by 2002:adf:a3c6:0:0:0:0:0 with SMTP id m6csp3100165wrb; Tue, 28 Feb 2023 11:16:00 -0800 (PST) X-Google-Smtp-Source: AK7set/1QlODX4FRc8fPDQ+nKrYUY5wL2fscQ91uSJcSR+MnL56jUKTgaiD86kJNxPtccVDG7UjU X-Received: by 2002:a05:6214:e88:b0:574:d6d:a317 with SMTP id hf8-20020a0562140e8800b005740d6da317mr7072778qvb.39.1677611760685; Tue, 28 Feb 2023 11:16:00 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1677611760; cv=none; d=google.com; s=arc-20160816; b=j4S9I4V/c7ipl+3TbS0S3HqC3LAUixZnRXHTj/sfw9tfV6cfcLstITFsy/TQgfSu4x uaRM1e1dq+y+xCLWNrbXOn/e0cRGvXKP1RWTgY4i/Wz/xlIGHWW6dDZUsixVC23fd8L0 glJ0e3vvoMHcavOkwZpbCWRWgg2rw5lT4lepp2OvjM6J5UFFvm06P5yjb6OnuvBZiIO1 75GwRigkPUQQH7qZ/bnaFPGJ+BOJlC1wU0AIatbJRGNE6S3gW119IvNuG7BPRufH+mMK cKycaR211CVV6sv8z9Ed3YpGthODMCk6otu8TE0L17wSnAYHYA9Riu6T+Y3KFkLbekiY Hsyw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:list-subscribe:list-help:list-post:list-archive :list-unsubscribe:list-id:precedence:content-transfer-encoding :mime-version:references:in-reply-to:message-id:date:subject:cc:to :from:dkim-signature; bh=juqxsICOPp3A62rldcSyP/QqnqSG5zUxj23C7nES3tg=; b=kSZ7j3SvuxlBw5Z1kAAvX/cW47PKr8LMCt+dXD4/0Mo3x3mQ8LoYNxJayDXTBWtX9r ydKWVLCeM5CxgB1A/mzsCf75XQzuidZpKL/ua4V/nVNYtsfhlUr/1YNMpwRxBrwIfkOQ +t3RfJgh10XFFWfJK+wcIOrslQJkEJAr1BnRGwDMezwIo3nfSGOW2HB967ocjFvHvJxB 3wVHBuQ2BkJal5Dxp8nwYAT5wubR+PEYSnicgK5QwGkLFB+5baVJl1m0hcC8/nRDHBLV 2Ez2J0F+jx0fHCi9jIyPNaiNWkCCirM66mMCnpNmMoGbeoVmgvnISbKpgjq0QCx/5oIj Or4A== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=aEifid6C; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from lists.gnu.org (lists.gnu.org. [209.51.188.17]) by mx.google.com with ESMTPS id s10-20020a0cdc0a000000b0056eb1a4165esi10062846qvk.401.2023.02.28.11.16.00 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Tue, 28 Feb 2023 11:16:00 -0800 (PST) Received-SPF: pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; Authentication-Results: mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=aEifid6C; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1pX5Qr-0000Qi-2A; Tue, 28 Feb 2023 14:14:37 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1pX5Qp-0000Pt-2w for qemu-devel@nongnu.org; Tue, 28 Feb 2023 14:14:35 -0500 Received: from mail-wr1-x430.google.com ([2a00:1450:4864:20::430]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1pX5Qg-0004fL-DO for qemu-devel@nongnu.org; Tue, 28 Feb 2023 14:14:34 -0500 Received: by mail-wr1-x430.google.com with SMTP id t15so10892210wrz.7 for ; Tue, 28 Feb 2023 11:14:25 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=juqxsICOPp3A62rldcSyP/QqnqSG5zUxj23C7nES3tg=; b=aEifid6CNHyOm94lyGmnYvg9LqvQC1l38G5B8CHEY/MpZhu7C5ZZ/o5gZ7lb8B6x/R n52w2h5ULodce8p+8OPv2/1+R8aemxUSZ7dZ9CfhqYubBDUIlSAK0ING3I9LPoOigEp3 hEGAyoDzS6We3/13w1+f7QekweoxMuDt3o286NQo3TqfOkEy0t+7GPkottKgca70YNg6 hQB/7nmluBgrhLGPpuEx5g3SHHPxQp/edpypH2/NZk4etbhE75EEIKFBoIZf8mBvuAms h132Ji9kvGlSReoVfUE4bb6YPSRCy1mPY3N3wBC/GUc6e0mfllyCTqTtHXIPP5vnNeYI GMQg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=juqxsICOPp3A62rldcSyP/QqnqSG5zUxj23C7nES3tg=; b=lfJ66jQ57RIiW4j9t7Dbrcm+76c92xmEP7eRtCOkdAP5CcZcNCyEyrs15X0vSUo81M 2y2R0apain2jGPMRkFpI3MFpe/l8QSNwurqHFlprOCrn2puRXT03VLdUVo30F6aZcJjb FVeqw1nDjyD5NFQmkPNuoOiVHHuoHCPR/GN/ysTi3ALjxnlqhjatLmGRyp7YEnzarbbj uIKcH62ZHKPTc2uXetxHRQ0isk7vTBonkSmzAdeYZu20M7UJQIPPpoEProA16GBryHtr 3JLfvH/g/d3f1Z478jF2XnMsuOp/PuVxF6QwH/+MF+2XOrtunT0XMnTUfWtTu4YvDosd V28A== X-Gm-Message-State: AO0yUKWWQkay+1TlAczlgaXQLDxLVYnRO9c4jS47hmaUWWQ727J/o7rp R0VD3PfYZvdGvqmJddSSmBrM5A== X-Received: by 2002:adf:f583:0:b0:2cb:8f6a:6e7f with SMTP id f3-20020adff583000000b002cb8f6a6e7fmr2974313wro.35.1677611662356; Tue, 28 Feb 2023 11:14:22 -0800 (PST) Received: from zen.linaroharston ([85.9.250.243]) by smtp.gmail.com with ESMTPSA id n5-20020a5d51c5000000b002c70d97af78sm10764063wrv.85.2023.02.28.11.14.20 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 28 Feb 2023 11:14:20 -0800 (PST) Received: from zen.lan (localhost [127.0.0.1]) by zen.linaroharston (Postfix) with ESMTP id 8BCB51FFCB; Tue, 28 Feb 2023 19:06:56 +0000 (GMT) From: =?utf-8?q?Alex_Benn=C3=A9e?= To: qemu-devel@nongnu.org Cc: =?utf-8?q?Marc-Andr=C3=A9_Lureau?= , =?utf-8?q?Daniel_P=2E_Berrang=C3=A9?= , Michael Roth , Peter Maydell , Kevin Wolf , =?utf-8?q?Alex_Benn=C3=A9e?= , Beraldo Leal , Alexander Bulekov , Aurelien Jarno , Markus Armbruster , =?utf-8?q?Philippe_Mathieu-Daud=C3=A9?= , Darren Kenny , Hanna Reitz , Cleber Rosa , John Snow , Ed Maste , qemu-arm@nongnu.org, Fam Zheng , Thomas Huth , Yonggang Luo , qemu-block@nongnu.org, Paolo Bonzini , Stefan Hajnoczi , Bandan Das , Li-Wen Hsu , Pavel Dovgalyuk , Laurent Vivier , Bastian Koppelmann , Qiuhao Li , Wainer dos Santos Moschetta Subject: [PATCH v3 24/24] tests/avocado: disable BootLinuxPPC64 test in CI Date: Tue, 28 Feb 2023 19:06:53 +0000 Message-Id: <20230228190653.1602033-25-alex.bennee@linaro.org> X-Mailer: git-send-email 2.39.2 In-Reply-To: <20230228190653.1602033-1-alex.bennee@linaro.org> References: <20230228190653.1602033-1-alex.bennee@linaro.org> MIME-Version: 1.0 Received-SPF: pass client-ip=2a00:1450:4864:20::430; envelope-from=alex.bennee@linaro.org; helo=mail-wr1-x430.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: qemu-devel-bounces+patch=linaro.org@nongnu.org Sender: qemu-devel-bounces+patch=linaro.org@nongnu.org This test is exceptionally heavyweight (nearly 330s) compared to the two (both endians) TuxRun baseline tests which complete in under 160s. The coverage is slightly reduced but a more directed test could make up the difference. tests/avocado/tuxrun_baselines.py:TuxRunBaselineTest.test_ppc64: Overall coverage rate: lines......: 9.6% (44110 of 458817 lines) functions..: 16.5% (6767 of 41054 functions) branches...: 6.0% (13395 of 222634 branches) tests/avocado/boot_linux.py:BootLinuxPPC64.test_pseries_tcg: Overall coverage rate: lines......: 11.6% (53408 of 458817 lines) functions..: 18.7% (7691 of 41054 functions) branches...: 7.9% (17692 of 224218 branches) So lets skip for GITLAB_CI and also unless AVOCADO_TIMEOUT_EXPECTED is specified by the user. Signed-off-by: Alex Bennée Reviewed-by: Philippe Mathieu-Daudé --- tests/avocado/boot_linux.py | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/tests/avocado/boot_linux.py b/tests/avocado/boot_linux.py index fe0bb180d9..f09f7b1dbf 100644 --- a/tests/avocado/boot_linux.py +++ b/tests/avocado/boot_linux.py @@ -84,6 +84,8 @@ def test_virt_kvm(self): self.launch_and_wait(set_up_ssh_connection=False) +# See the tux_baseline.py tests for almost the same coverage in a lot +# less time. class BootLinuxPPC64(LinuxTest): """ :avocado: tags=arch:ppc64 @@ -91,6 +93,8 @@ class BootLinuxPPC64(LinuxTest): timeout = 360 + @skipUnless(os.getenv('AVOCADO_TIMEOUT_EXPECTED'), 'Test might timeout') + @skipIf(os.getenv('GITLAB_CI'), 'Running on GitLab') def test_pseries_tcg(self): """ :avocado: tags=machine:pseries