From patchwork Tue Oct 22 19:16:59 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: =?utf-8?q?Alex_Benn=C3=A9e?= X-Patchwork-Id: 177218 Delivered-To: patch@linaro.org Received: by 2002:a92:409a:0:0:0:0:0 with SMTP id d26csp5298997ill; Tue, 22 Oct 2019 12:23:48 -0700 (PDT) X-Google-Smtp-Source: APXvYqy/dAkGcWpu8aRc07h2ehMgCi/QnycvNj/FWgaGAoSE0EEl6LlVSLvJHYcMB7HVb1L6QA2E X-Received: by 2002:a17:906:5c0a:: with SMTP id e10mr28968743ejq.285.1571772228529; Tue, 22 Oct 2019 12:23:48 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1571772228; cv=none; d=google.com; s=arc-20160816; b=lsdxa+9zHyPQCmcn7eqAdo5itTggLyDJ9V7D7sdND6hXBinUvmYIpnxCVagEULh3rR 7aNbn2q1mqIMHk7GO4iVpNjxJpItAerGnI199PKXOvvAgtxDFqQ/jypAkTPWROb41BtS R0n1/KOsfS33JhKIjRmm5bnZdeYiNgCIMbY4V3XZQBjy9TZiJFaFVfw5zISJLESdLCRg rM2HXSHoJR8rXleCB07ZnXFJuDbfq20QKXS+PO/r5Et7SZPNDiTOZCrxRp3HD7QHLyWu XF4Qk2+3Y0ixtrSRnqCeZhzxk6s4cc2uO/GoZC6h4MnKEh5sKBc2Io9yLBbVJBMYChfy EWBg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:cc:list-subscribe:list-help:list-post:list-archive :list-unsubscribe:list-id:precedence:content-transfer-encoding :mime-version:references:in-reply-to:message-id:date:subject:to:from :dkim-signature; bh=ifdTWY7rA8JzLf+c4o7pX4/w+sZoXMC1jEUoG7lAHv4=; b=EE8xhF3YYr6WxsBkfvMrEYNNHHMapzVFRg58Q4hI+AIzdEfrSsvxlJr38OytH0UC+v TGBCAKsay/TpvoHkLszETZMBvztx8PtefsnqNrZ270gBOcLUEiPdvP6gEbzJuVaUOBoO sh3df0TUdYi3ZfrqWWE3wHWW/Eg6eJDJPm7N0NXq/Sj0jNbigIvy/SdDBSOtB8Ot2dnb l1wROn7f5fmEm4Lv/QJCywHvnwlw63d8e3pX7W43ezhJbYkBldIwczaMECvj5j2s0OI7 N64F7rS9QCWhsgsvRmOR6Z7rZ6QftcEp76YpnXom0iWSQk8KskEQSTqW/PekBgpmw9nN N83g== ARC-Authentication-Results: i=1; mx.google.com; dkim=fail header.i=@linaro.org header.s=google header.b=jPeUPUP6; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from lists.gnu.org (lists.gnu.org. [209.51.188.17]) by mx.google.com with ESMTPS id m39si13584622edc.243.2019.10.22.12.23.48 for (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Tue, 22 Oct 2019 12:23:48 -0700 (PDT) Received-SPF: pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; Authentication-Results: mx.google.com; dkim=fail header.i=@linaro.org header.s=google header.b=jPeUPUP6; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: from localhost ([::1]:42104 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1iMzkw-00024d-4l for patch@linaro.org; Tue, 22 Oct 2019 15:23:46 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:36465) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1iMzej-0002Tl-UY for qemu-devel@nongnu.org; Tue, 22 Oct 2019 15:17:23 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1iMzeh-0005Q5-KL for qemu-devel@nongnu.org; Tue, 22 Oct 2019 15:17:21 -0400 Received: from mail-wr1-x444.google.com ([2a00:1450:4864:20::444]:39600) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1iMzeh-0005Na-EC for qemu-devel@nongnu.org; Tue, 22 Oct 2019 15:17:19 -0400 Received: by mail-wr1-x444.google.com with SMTP id a11so3238597wra.6 for ; Tue, 22 Oct 2019 12:17:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=ifdTWY7rA8JzLf+c4o7pX4/w+sZoXMC1jEUoG7lAHv4=; b=jPeUPUP6T0TNgGu6WSyoaEuW/ws6xMG3ufV7u/6Vsp3BrV0xLEedvQ5mcfkpO2DDbt JvAGXKz7YdkB+dxZy9ReQFLccX3feX9qd/cP/uPrLyg8e6IGl7ihM5vOlbO2xV+rjYvv cgEfYQWFYC0rGfX5CfG77aIb/VlDVZqLxKCosky++5hGf5dKp5QMP3sJeOaDxnqhjBCS CtoH5zJST4JoXvVvv+xq6FoeYBxCEfbnNaI/mAQQDdsN37MRcO/ZyI7XUyjiExImTalW cAw4J92rOCWLuX27LrT/+ui7uZJgYZtZhfm/7Dz9vufIRPbD+FIzAzC1NvDkVkH1++mG 1C8g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=ifdTWY7rA8JzLf+c4o7pX4/w+sZoXMC1jEUoG7lAHv4=; b=BIc6SDj824tlPuVM0PvKAOIEmJa81D87iplX1VzuYA+Ii1CqnB5v39X6shkwpvXV7O 89qF+2ThUH1gI2AcgUb5hd66iJksTGjIpbWj7UHTTPsPem4GFOLXDJxaRlfunUh2/a+x wg7JMg65/BQxHvOkJdyg6z83KTSfZXADHd7ONJD6ThrlTNTGd4M8HQzDt+mir6sEZgnI kPQnhRJmG5+ujmrGMbhV6usg6HZyvzFvY9YAdHxBuiTvO3Qj2fRZi6/7512J9m79mPdU +BDHcS1F5uEpJ2DNlTYQcnl88FJaMEC0NOZ+t3IZwSk/yaz4H2pGu/x24BsADaEQC+Mj BC3w== X-Gm-Message-State: APjAAAXkevrnPJPVZ4y412N1iUbmiQsX/4eduzFwcmq2PS/IFalrWXfD WJOAIrL5Hb9srvpSJC+2ZXV0Fw== X-Received: by 2002:adf:92e7:: with SMTP id 94mr5185809wrn.199.1571771837272; Tue, 22 Oct 2019 12:17:17 -0700 (PDT) Received: from zen.linaroharston ([51.148.130.216]) by smtp.gmail.com with ESMTPSA id m7sm20390526wrv.40.2019.10.22.12.17.09 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 22 Oct 2019 12:17:14 -0700 (PDT) Received: from zen.lan (localhost [127.0.0.1]) by zen.linaroharston (Postfix) with ESMTP id 833DD1FF9E; Tue, 22 Oct 2019 20:17:05 +0100 (BST) From: =?utf-8?q?Alex_Benn=C3=A9e?= To: qemu-devel@nongnu.org Subject: [PATCH v1 14/19] iotests: remove 'linux' from default supported platforms Date: Tue, 22 Oct 2019 20:16:59 +0100 Message-Id: <20191022191704.6134-15-alex.bennee@linaro.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20191022191704.6134-1-alex.bennee@linaro.org> References: <20191022191704.6134-1-alex.bennee@linaro.org> MIME-Version: 1.0 X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-Received-From: 2a00:1450:4864:20::444 X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: fam@euphon.net, Kevin Wolf , berrange@redhat.com, "open list:Block layer core" , stefanb@linux.vnet.ibm.com, John Snow , richard.henderson@linaro.org, f4bug@amsat.org, Max Reitz , cota@braap.org, stefanha@redhat.com, marcandre.lureau@redhat.com, pbonzini@redhat.com, aurelien@aurel32.net Errors-To: qemu-devel-bounces+patch=linaro.org@nongnu.org Sender: "Qemu-devel" From: John Snow verify_platform will check an explicit whitelist and blacklist instead. The default will now be assumed to be allowed to run anywhere. For tests that do not specify their platforms explicitly, this has the effect of enabling these tests on non-linux platforms. For tests that always specified linux explicitly, there is no change. For Python tests on FreeBSD at least; only seven python tests fail: 045 147 149 169 194 199 211 045 and 149 appear to be misconfigurations, 147 and 194 are the AF_UNIX path too long error, 169 and 199 are bitmap migration bugs, and 211 is a bug that shows up on Linux platforms, too. This is at least good evidence that these tests are not Linux-only. If they aren't suitable for other platforms, they should be disabled on a per-platform basis as appropriate. Therefore, let's switch these on and deal with the failures. Reviewed-by: Max Reitz Signed-off-by: John Snow Message-Id: <20191022072135.11188-2-thuth@redhat.com> --- tests/qemu-iotests/iotests.py | 16 +++++++++++----- 1 file changed, 11 insertions(+), 5 deletions(-) -- 2.20.1 diff --git a/tests/qemu-iotests/iotests.py b/tests/qemu-iotests/iotests.py index 3a8f378f90d..75e64ef85be 100644 --- a/tests/qemu-iotests/iotests.py +++ b/tests/qemu-iotests/iotests.py @@ -869,9 +869,14 @@ def verify_protocol(supported=[], unsupported=[]): if not_sup or (imgproto in unsupported): notrun('not suitable for this protocol: %s' % imgproto) -def verify_platform(supported_oses=['linux']): - if True not in [sys.platform.startswith(x) for x in supported_oses]: - notrun('not suitable for this OS: %s' % sys.platform) +def verify_platform(supported=None, unsupported=None): + if unsupported is not None: + if any((sys.platform.startswith(x) for x in unsupported)): + notrun('not suitable for this OS: %s' % sys.platform) + + if supported is not None: + if not any((sys.platform.startswith(x) for x in supported)): + notrun('not suitable for this OS: %s' % sys.platform) def verify_cache_mode(supported_cache_modes=[]): if supported_cache_modes and (cachemode not in supported_cache_modes): @@ -933,7 +938,8 @@ def execute_unittest(output, verbosity, debug): r'Ran \1 tests', output.getvalue())) def execute_test(test_function=None, - supported_fmts=[], supported_oses=['linux'], + supported_fmts=[], + supported_platforms=None, supported_cache_modes=[], unsupported_fmts=[], supported_protocols=[], unsupported_protocols=[]): """Run either unittest or script-style tests.""" @@ -950,7 +956,7 @@ def execute_test(test_function=None, verbosity = 1 verify_image_format(supported_fmts, unsupported_fmts) verify_protocol(supported_protocols, unsupported_protocols) - verify_platform(supported_oses) + verify_platform(supported=supported_platforms) verify_cache_mode(supported_cache_modes) if debug: