From patchwork Thu Dec 10 18:52:33 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Mark Brown X-Patchwork-Id: 341055 Delivered-To: patch@linaro.org Received: by 2002:a02:85a7:0:0:0:0:0 with SMTP id d36csp5805654jai; Thu, 10 Dec 2020 10:58:08 -0800 (PST) X-Google-Smtp-Source: ABdhPJxXaIzeuSjew82HnV2vV47tOYa2+tkxJ/dOZKAfJSkE+zXctSyy6YTXLrH7oE7F4+5/laer X-Received: by 2002:a50:e68a:: with SMTP id z10mr8375388edm.66.1607626688497; Thu, 10 Dec 2020 10:58:08 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1607626688; cv=none; d=google.com; s=arc-20160816; b=ejDdw3oQwPQ6VWBmAhSv3UawNWXzX+P0dnmeVtzVCjGdBT1WfzfdL2bDC74i8hpwXY NYy5+wL2nv+NDEd2KqMRwMGdafs7LBxIQDAPJ+mqRp5P1JibMS0GIE3/Dm8a/iBwxwwW tJF6Xe1jAMpkufYY28GaK7Af42seoa7wMAhzza/hW+zOgTwrucEf9EbNVyq+XbjqZHpA b+8P++9i8LWWQfEUFrzTOpln9cKc+8GQcIadkTDTrIZ803hBxKAEffVUqnoQW9ssuw1m /+qSm5f5yBraejrYRrpEWsHzlG3QZcF+RqK46tKaiBI4LjwupwmFPIqRw7lFTmFt8BUT jTjA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from; bh=n66uivQIB/UQV7/zHNnKZ2zv/v4iV3CrilbNoV/EYYQ=; b=P4PKgoDhfx6u5G8NkmKVc9zr32a/WvSxHvKbWpm47Xjppte3rfm/CeO/6VIH25CkqZ CJ2nCPcK7rAto60Rkg+/gMTsiefI334DUk+lMEf9a5SiLkVXdjj7WLYkFdTE+FpqgUk1 Unlk+EaTReoNpbjO+SaiKmTbGFtuC4yjXcqa62ZpJg0P/FVlXWBTIBWokiv2oL970AiW Ikr2jeQgRwZnpFpethPUZwX/0Uib6vcC8NIH1Knbw6JNhZY/VP2MjAAamOpMipik40W9 4DMsC72h6gF935HTEkJdAfxtWc5/t8ScMbHCaQVwfbult1jB1vwciTu/+wjWcAVfOmrH q1hw== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kselftest-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kselftest-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id 24si3071857ejx.108.2020.12.10.10.58.08; Thu, 10 Dec 2020 10:58:08 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kselftest-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kselftest-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kselftest-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S2390578AbgLJS5H (ORCPT + 6 others); Thu, 10 Dec 2020 13:57:07 -0500 Received: from mail.kernel.org ([198.145.29.99]:34656 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726075AbgLJS5F (ORCPT ); Thu, 10 Dec 2020 13:57:05 -0500 From: Mark Brown Authentication-Results: mail.kernel.org; dkim=permerror (bad message/signature format) To: Shuah Khan , Alexei Starovoitov , Daniel Borkmann , Andrii Nakryiko Cc: Martin KaFai Lau , Song Liu , Yonghong Song , John Fastabend , KP Singh , Daniel Diaz , Veronika Kabatova , netdev@vger.kernel.org, bpf@vger.kernel.org, linux-kselftest@vger.kernel.org, Guillaume Tucker , Kevin Hilman , Mark Brown Subject: [PATCH] selftests: Skip BPF seftests by default Date: Thu, 10 Dec 2020 18:52:33 +0000 Message-Id: <20201210185233.28091-1-broonie@kernel.org> X-Mailer: git-send-email 2.20.1 MIME-Version: 1.0 X-Patch-Hashes: v=1; h=sha256; i=7Xhvzkgs2X5AXYEHO8N7h/4qCSh88rSZtK7RUR5uyKc=; m=NLFbCJ5BO0tEebe5aDGXW+BpeGH7KelNPszypI0wiNo=; p=NP0IeQiNob21poKCDV2rFRlDlnvPgTk/qWODOlZgNeE=; g=10657ae2c8ea502e09f342527ca847c8098f2fb4 X-Patch-Sig: m=pgp; i=broonie@kernel.org; s=0xC3F436CA30F5D8EB; b=iQEzBAABCgAdFiEEreZoqmdXGLWf4p/qJNaLcl1Uh9AFAl/SbQkACgkQJNaLcl1Uh9BTVwf8DRx FtItjWz319skvRSHPOX/iQq3C99DcGdMRQ9v+/pyEhQrdHEBp0g2WohTe/2u//PIZHTQbgtRMSU+N bsNOU0/dDxZzbk+sHVdeIawELWDoE/7pWZTHxCP2RwcSjxP7z+Kj95t5LfejBZFcUBEgmwAdWqCw3 HN5nzxYQdc466bbM5NLjevK8v7ySdo1AkGwvVKsopkn8H6E07xmPbqwWTOeA2xfnaIa7VUbmYuLas SJaTVHW+GygbiEcHSgvMYlq/5PhKxwPJCSy1r4ChUvhvMkdy1NSbC/V5Qfxf+s02o65usz6NkxF7y gvh2eWVMT03qv54xEJjxjlXy1j6xQzg== Precedence: bulk List-ID: X-Mailing-List: linux-kselftest@vger.kernel.org The BPF selftests have build time dependencies on cutting edge versions of tools in the BPF ecosystem including LLVM which are more involved to satisfy than more typical requirements like installing a package from your distribution. This causes issues for users looking at kselftest in as a whole who find that a default build of kselftest fails and that resolving this is time consuming and adds administrative overhead. The fast pace of BPF development and the need for a full BPF stack to do substantial development or validation work on the code mean that people working directly on it don't see a reasonable way to keep supporting older environments without causing problems with the usability of the BPF tests in BPF development so these requirements are unlikely to be relaxed in the immediate future. There is already support for skipping targets so in order to reduce the barrier to entry for people interested in kselftest as a whole let's use that to skip the BPF tests by default when people work with the top level kselftest build system. Users can still build the BPF selftests as part of the wider kselftest build by specifying SKIP_TARGETS, including setting an empty SKIP_TARGETS to build everything. They can also continue to build the BPF selftests individually in cases where they are specifically focused on BPF. This isn't ideal since it means people will need to take special steps to build the BPF tests but the dependencies mean that realistically this is already the case to some extent and it makes it easier for people to pick up and work with the other selftests which is hopefully a net win. Signed-off-by: Mark Brown --- tools/testing/selftests/Makefile | 6 ++++-- 1 file changed, 4 insertions(+), 2 deletions(-) -- 2.20.1 diff --git a/tools/testing/selftests/Makefile b/tools/testing/selftests/Makefile index afbab4aeef3c..8a917cb4426a 100644 --- a/tools/testing/selftests/Makefile +++ b/tools/testing/selftests/Makefile @@ -77,8 +77,10 @@ TARGETS += zram TARGETS_HOTPLUG = cpu-hotplug TARGETS_HOTPLUG += memory-hotplug -# User can optionally provide a TARGETS skiplist. -SKIP_TARGETS ?= +# User can optionally provide a TARGETS skiplist. By default we skip +# BPF since it has cutting edge build time dependencies which require +# more effort to install. +SKIP_TARGETS ?= bpf ifneq ($(SKIP_TARGETS),) TMP := $(filter-out $(SKIP_TARGETS), $(TARGETS)) override TARGETS := $(TMP)