From patchwork Thu Oct 20 11:52:03 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: =?utf-8?q?Alex_Benn=C3=A9e?= X-Patchwork-Id: 616721 Delivered-To: patch@linaro.org Received: by 2002:a17:522:c983:b0:460:3032:e3c4 with SMTP id kr3csp229347pvb; Thu, 20 Oct 2022 05:40:35 -0700 (PDT) X-Google-Smtp-Source: AMsMyM43xypmWXTTpU+8rbMrUFsy3BvnEx76FfXR5RdlPl/rNgmM2lS/hKG99BW5QHxWJCB3ZV1d X-Received: by 2002:a05:6214:20a3:b0:4b1:a691:1436 with SMTP id 3-20020a05621420a300b004b1a6911436mr10738791qvd.14.1666269634999; Thu, 20 Oct 2022 05:40:34 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1666269634; cv=none; d=google.com; s=arc-20160816; b=fPevHe36WKcBPaCzSGxwjM7PiC23SKDfhluOKOQlM0Tbt2/H/Ug8WpunbxnJE1qtXH G9e5k/HEJL2eLka5K3mQKC0NILj7vseyFCD6n1owZY0sjlKDCJfjJVVp359055STXRQx JhM/4KSZdUHCbKgOPijR1XOt1qOgigGsciJDzLVYd74HfM4mydE9YTy9/9ao3vOe3o02 7nDEhD0YxX65BG6I55GnwjvqDUV2u0PeYZDKCrRfvf+bnf8SDCGemJX+XTuZU1XOG5sI bu9kYCj1nGf2dti0ic/faxAYYtRh5xzgOHP9yejNEpJejfedy5/aV9OT6p2qbdYH5XaE /1aQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:list-subscribe:list-help:list-post:list-archive :list-unsubscribe:list-id:precedence:content-transfer-encoding :mime-version:references:in-reply-to:message-id:date:subject:cc:to :from:dkim-signature; bh=WjfZFuDfwZki0Motf5d0a8lYGhUl/fr0hF/I9a/jdfg=; b=f0dxQfOdJEeZ4ByDqwKgbumZoBgZtTUzG3rifzMLdhMEpFWlqo1IK3mQ0qIw65xh7U /SK2lE8z+ProGB30nQkfMaGZJWoSQrYncuteswQN9uqMmETADRSsx6ez3LWY5DVmLlSd BUEm6DfdRfIv7qXqB/iYfRI/Hr1x3xZG7eIeHQp+GOuIyNjUDDkoQlZBZIuou+QC7xI7 GVk/168diaIvlTYjOzsg1blvdUuSpCW9WZG1xBEqNnIC73Ydu2OdraB4GGLWfJEhp/xj H+ceJ3YhSEuwXf9EKTK+nMwA2l8642GW8XV64/EshmK++GBQrA+xVQPohuf1Yd0JpVvW CNXw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b="MHBuXt/M"; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from lists.gnu.org (lists.gnu.org. [209.51.188.17]) by mx.google.com with ESMTPS id h11-20020a05620a284b00b006eb3a5ae78esi10567031qkp.157.2022.10.20.05.40.34 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Thu, 20 Oct 2022 05:40:34 -0700 (PDT) Received-SPF: pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; Authentication-Results: mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b="MHBuXt/M"; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: from localhost ([::1]:46730 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1olUqe-0007iP-9v for patch@linaro.org; Thu, 20 Oct 2022 08:40:33 -0400 Received: from [::1] (helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1olUk0-0005FV-5Z for patch@linaro.org; Thu, 20 Oct 2022 08:33:43 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:59706) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1olUDT-0000c5-TU for qemu-devel@nongnu.org; Thu, 20 Oct 2022 08:00:27 -0400 Received: from mail-wr1-x431.google.com ([2a00:1450:4864:20::431]:42774) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1olUDM-00050j-Ir for qemu-devel@nongnu.org; Thu, 20 Oct 2022 08:00:02 -0400 Received: by mail-wr1-x431.google.com with SMTP id bp11so34018855wrb.9 for ; Thu, 20 Oct 2022 04:59:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=WjfZFuDfwZki0Motf5d0a8lYGhUl/fr0hF/I9a/jdfg=; b=MHBuXt/MG2BzTyt5bjkm9Os3FpD5dgAPeF9EoRxBHvDWyh7ASax9r5zj6lPozWIxV1 w+f89UCaJcM40SPDbq6idPEDYxDI0qgUYH/KTHqLdLyjqYSpzeWzmW6EwIT/Qopyd9BZ EwJNcZeyUC6Z2MbopFPqm9XRuSVqD6pC/AEjE5emakgk3U6MK5VBrjsxHcgzQVv7CTog wv4AZMK5MGHU+SN1tsiHxWwfxJ2QCIOs5xvXmyx/Ge9WN7eg5jihnX+zQZp0ebfVrb76 u+ZoQGj/pD8lVw5/0T1H0qOoGPR0oC/GRAbWGVToySWJw+AW9kQid1zEPACaN3aMME8t URgA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=WjfZFuDfwZki0Motf5d0a8lYGhUl/fr0hF/I9a/jdfg=; b=y8Cpaf6c1Hduk30jhbpBOYNcBmfVrmTq54hhYUL6RXQ7zUjVrxfjjJGN/UIaMKtR0W 9Gj9CgLnFx5nrHiZV1Yh3oihwisXLdGl6jPASsGaLbN9E/DbtmScX84et8jcEbRlYyYa N/3/IBZuOzekdMxaBR4BTVqgS/V0oO9rsRRLqXbdxkEOq0d/q1ckz4vr95rm6DsMH7+1 xq/5efNxzROlNrRh0nSGzrJsa8Rr6LPfiYSoYiFwTDdk70b/z34EHo+WBLle4RBVHfo+ 9f9uybZ3kUqVOAf+TxHrY79MsPeWxNUBHpEPH+fQzXk3XSLPEQQvaNod+L3+fBxIDtgL hIvw== X-Gm-Message-State: ACrzQf2Xk3x8HyEaoko2ys2HZwJvceLrsLr5uXDxAx3wJeXEOBza/3ll vabgCJHCpm6nLuC6Ucu1OdXvzw== X-Received: by 2002:adf:e195:0:b0:22f:6117:a932 with SMTP id az21-20020adfe195000000b0022f6117a932mr8523758wrb.572.1666267195151; Thu, 20 Oct 2022 04:59:55 -0700 (PDT) Received: from zen.linaroharston ([185.81.254.11]) by smtp.gmail.com with ESMTPSA id h8-20020a5d4308000000b0022cdb687bf9sm19963414wrq.0.2022.10.20.04.59.52 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 20 Oct 2022 04:59:54 -0700 (PDT) Received: from zen.lan (localhost [127.0.0.1]) by zen.linaroharston (Postfix) with ESMTP id E29761FFCA; Thu, 20 Oct 2022 12:52:11 +0100 (BST) From: =?utf-8?q?Alex_Benn=C3=A9e?= To: qemu-devel@nongnu.org Cc: fam@euphon.net, berrange@redhat.com, f4bug@amsat.org, aurelien@aurel32.net, pbonzini@redhat.com, stefanha@redhat.com, crosa@redhat.com, =?utf-8?q?Alex_Benn=C3=A9e?= , Thomas Huth , Yoshinori Sato , Magnus Damm , =?utf-8?q?Philippe_Mathieu-Daud=C3=A9?= , Wainer dos Santos Moschetta , Beraldo Leal Subject: [PATCH v3 20/26] tests/avocado: disable sh4 rd2 tests on Gitlab Date: Thu, 20 Oct 2022 12:52:03 +0100 Message-Id: <20221020115209.1761864-21-alex.bennee@linaro.org> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20221020115209.1761864-1-alex.bennee@linaro.org> References: <20221020115209.1761864-1-alex.bennee@linaro.org> MIME-Version: 1.0 Received-SPF: pass client-ip=2a00:1450:4864:20::431; envelope-from=alex.bennee@linaro.org; helo=mail-wr1-x431.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, T_SPF_TEMPERROR=0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: qemu-devel-bounces+patch=linaro.org@nongnu.org Sender: "Qemu-devel" Running repeated invocations on a number of test boxes show a fairly high error rate: $ retry.py -n 100 -c -- ./tests/venv/bin/avocado run tests/avocado/boot_linux_console.py:BootLinuxConsole.test_sh4_r2d retry.py called with ['./tests/venv/bin/avocado', 'run', 'tests/avocado/boot_linux_console.py:BootLinuxConsole.test_sh4_r2d'] Results: Run, Ret, Pass/Fail, Time, Total Pass, Total Run ... Results summary: 0: 94 times (94.00%), avg time 2.254 (0.00 varience/0.04 deviation) 1: 3 times (3.00%), avg time 1.837 (0.02 varience/0.14 deviation) 8: 3 times (3.00%), avg time 91.288 (0.02 varience/0.15 deviation) Examining the logs they fall into various categories of un-handled unaligned access by user space and unexpected FPU usage by the kernel which ultimately lead to the failure to reach the login prompt. This could be bugs in the translator that only get hit occasionally or just a flaky kernel - its hard to tell. To avoid these failures gating CI lets skip on GitLab. Signed-off-by: Alex Bennée Cc: Thomas Huth Cc: Yoshinori Sato Cc: Magnus Damm Reviewed-by: Philippe Mathieu-Daudé --- tests/avocado/boot_linux_console.py | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/tests/avocado/boot_linux_console.py b/tests/avocado/boot_linux_console.py index eed4b49e6e..26eaf1a119 100644 --- a/tests/avocado/boot_linux_console.py +++ b/tests/avocado/boot_linux_console.py @@ -1175,6 +1175,10 @@ def test_ppc_mac99(self): self.vm.add_args('-M', 'graphics=off') self.do_test_advcal_2018('15', tar_hash, 'invaders.elf') + # This test has a 6-10% failure rate on various hosts that look + # like issues with a buggy kernel. As a result we don't want it + # gating releases on Gitlab. + @skipIf(os.getenv('GITLAB_CI'), 'Running on GitLab') def test_sh4_r2d(self): """ :avocado: tags=arch:sh4