From patchwork Thu Apr 22 01:19:05 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Prike Liang X-Patchwork-Id: 426810 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-18.8 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, HEADER_FROM_DIFFERENT_DOMAINS, INCLUDES_CR_TRAILER, INCLUDES_PATCH, MAILING_LIST_MULTI, MSGID_FROM_MTA_HEADER, SPF_HELO_NONE, SPF_PASS, USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 24000C433ED for ; Thu, 22 Apr 2021 01:19:27 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id E256A61430 for ; Thu, 22 Apr 2021 01:19:26 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S235913AbhDVBUA (ORCPT ); Wed, 21 Apr 2021 21:20:00 -0400 Received: from mail-dm6nam10on2054.outbound.protection.outlook.com ([40.107.93.54]:63200 "EHLO NAM10-DM6-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S234970AbhDVBT7 (ORCPT ); Wed, 21 Apr 2021 21:19:59 -0400 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=C/G094+R3aDGN2JRLeiYfV4U+WfkhtKBTIEjAHmR/gqzyv/5NvJw3E6YugJ2Yxn1YQIZEFQzaPMb58g69WAigsT1ySbo5wSpGzoTzYIxaAWZ+C5ggQq4BEXXsTnLo7irx38iIraNoBWKFwvjqdEw56PRkB9D3jOZOi7MtaiuUpxTOQWNgbg/5I80r4Sb8vvLTtHT+k3kzMSwarz0gpmUARa0hJg8e2Wvpy3EhrrM+GR3IGnOHt00f42F96I+x7ucKavfTMYPdf99ykCuN6W7eI2eYtHBL87MyCRdxWqZbmyjlRnnrEfSpN8/VKiuYiwlRzBZTczKLt2Y1p6fsmxnNA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=s183yfy7xin+VA89uiIhMS4RtC9SO2mLh2+h/QaVISk=; b=FzMhHiRs5rX9VDrep6OX7wjhxIknFAxkv9W8w/Ohe+lpGKxQc4vmLGL0ADfP3dZZ8l1wL0LdjR6nuTYXyfrUgJKjQ1RlXdf/Kd9ZKdZ/mbzzw+y21Jr3LCMfK0x9rv4i1HPIwN6MtrIFEBL9zx69HQuyXFoB5c15F1bH80Ti5GArwy/tV7kSFI8vBiAfo8FTqWbq9woVLk/0qb6kYpJVLlslJaT2GFOe23WRmC0GrwCCkyprv5mJ1hCEMO6l9y68FdK+UMQyVq242cXvarTwtKCrSUc5+MXeM8VzOwVKH1ROMaXQvavsS+j92Ikn1pg64KHXzOcjNA09Jle2HsN+vA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=amd.com; dmarc=pass action=none header.from=amd.com; dkim=pass header.d=amd.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=s183yfy7xin+VA89uiIhMS4RtC9SO2mLh2+h/QaVISk=; b=3++YiFW3YH9Qt2THt7GjuknKspIdVNshTrDa9vzRc71bruioZqfN327hIqWB9LduUcS0GOrYoYBiW1B42PM8zKMtewbdeOnWzwswJLR/RJ+1Kyi+7Vhow+b0bvgcek5HnxSQGa5UmVzYLhrMIXG+Tlr3qU+hdKRQT0kamgiZMoI= Authentication-Results: lists.infradead.org; dkim=none (message not signed) header.d=none; lists.infradead.org; dmarc=none action=none header.from=amd.com; Received: from BYAPR12MB3238.namprd12.prod.outlook.com (2603:10b6:a03:13b::20) by BY5PR12MB3713.namprd12.prod.outlook.com (2603:10b6:a03:1a6::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4065.21; Thu, 22 Apr 2021 01:19:24 +0000 Received: from BYAPR12MB3238.namprd12.prod.outlook.com ([fe80::5870:fcd6:b13a:c49c]) by BYAPR12MB3238.namprd12.prod.outlook.com ([fe80::5870:fcd6:b13a:c49c%5]) with mapi id 15.20.4042.024; Thu, 22 Apr 2021 01:19:24 +0000 From: Prike Liang To: linux-nvme@lists.infradead.org, kbusch@kernel.org, hch@infradead.org, Chaitanya.Kulkarni@wdc.com, gregkh@linuxfoundation.org Cc: stable@vger.kernel.org, Alexander.Deucher@amd.com, Shyam-sundar.S-k@amd.com, Prike Liang , Chaitanya Kulkarni Subject: [PATCH v5 1/2] PCI: add AMD PCIe quirk for nvme shutdown opt Date: Thu, 22 Apr 2021 09:19:05 +0800 Message-Id: <1619054346-4566-2-git-send-email-Prike.Liang@amd.com> X-Mailer: git-send-email 2.7.4 In-Reply-To: <1619054346-4566-1-git-send-email-Prike.Liang@amd.com> References: <1619054346-4566-1-git-send-email-Prike.Liang@amd.com> X-Originating-IP: [180.167.199.189] X-ClientProxiedBy: HKAPR03CA0020.apcprd03.prod.outlook.com (2603:1096:203:c9::7) To BYAPR12MB3238.namprd12.prod.outlook.com (2603:10b6:a03:13b::20) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 Received: from prike.amd.com (180.167.199.189) by HKAPR03CA0020.apcprd03.prod.outlook.com (2603:1096:203:c9::7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256) id 15.20.4087.16 via Frontend Transport; Thu, 22 Apr 2021 01:19:21 +0000 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 0f9708a2-37c0-4620-b12b-08d9052ca9ee X-MS-TrafficTypeDiagnostic: BY5PR12MB3713: X-MS-Exchange-Transport-Forked: True X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:1169; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: P0rmPvjZ5I8SMj46PpXzfSRWn/VErbdu+FtJinUyyBin6sKCj8okbXqGz2zEgVRk0KKScKjc9t/katAqH28Z4W0e7qK6jxOPvIvoYsc4OK0WfN4hLTejaSRcJ3bQQTvU/9u7t1wQy2HsipXw00Y8IVVRxkBtla3BXwOD4uuQLjmRas8F9h9MjE69ncF/ic1iQDDGNtl22h02F9j8B0cKIyjNo8NJv5aPhNR4Kuw/mF/2y0lK0RFNUXH26tjam3evnv2iCLtGsniTl4dDehsP9ydNQl1VTY2lBE+sn6W4CxxBx5ZXLzV7EvHbaCz3T30CL7AzSAOYf7/+5M8ENqeBjwJi67QUhKn152gclp/HiuJB2st15u6FBI9mXhgOTlXkOo6UeG0Z67hI7wyaALR03AzDzg9I+wB5fDZvjzxzHgS6lcbuaZn6S7qvv+rOOgfmMJnm6PH7Z3iJC1psSOa+kiVCHp4sGKCuh3BG2VQOz0bLeY5tkyzSH8fcq7ELQ1crkJWKG53F44tulGI+Fjzb8dmUFjVFR4K/NV9hf3RuZXLvJF/DRezfFYaB5EAIzKEmWtMSnbhfYwmYAZmbr+qU4ARHfjI9eSQpfOd8LvLAxLcqqpNg2LySMqowdkxAZzSk9cQYvHWnIHJLide9EwuufA== X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BYAPR12MB3238.namprd12.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(376002)(396003)(39860400002)(346002)(136003)(366004)(83380400001)(4326008)(8676002)(478600001)(316002)(66946007)(8936002)(2906002)(36756003)(86362001)(54906003)(38100700002)(16526019)(186003)(2616005)(5660300002)(956004)(38350700002)(26005)(6486002)(52116002)(7696005)(6666004)(66476007)(66556008); DIR:OUT; SFP:1101; X-MS-Exchange-AntiSpam-MessageData: qtCOpPE7hc1hdf/NUbx8tfW6UCnCpTomnUu1IVcmeUrEO107967jrvpqIAR5wL4b8bqmExr/RzWDYoiANLY+Sh6sUI5nVHMh86hxhUcmIa7pQisRpBnOozmGPLeqWgGuXRYfT3V5MILNbDslo/frxzXf4yfz43Op4Vh7D8oC535bA79YNDLtRwuyzpPfOSn0t9F8t3sh+zlPH5dySvqyBb/QlNbwwAZy8W+gce+39dwfYEPOWvJNWLfyy3mszDDFZtDJAcBdjGTcrMmZHImmneneGbPBwRlozI2RpgMsvNjPeHHmfxVAEdtNlEf6UbVe0tZ7jVnPqUL5Dr9te2MOFQyRG4h9vS0I9vq8GkpAtvLptus5yeG8JgsmgS34JKrKmEUNFUO6pl/UctXccaWCalr+nysqDiQmH5P4vQyYlOzcZrp+iqmG0n/vs2wxJeSs46qEmK+Jb45Hb8/g5O/OLiKC6mVQ+w9fPvYuwz3xqfU6x5yb6+MYT0Cne7QSPHFIvoAIb7Iwv7HQLumBy5SWoYqpkbAJW2BQzMYTAHvY7qi55Vg+R3lUQpFf7A9uFvwW83t1TtKluDelzu3F0cRQAoSo+D3L/Ex+3JfHhGhReOJoKQ/MPhI2pT+byKIvFMk07vF3xyY9e37CAL59nNrd4ndiYEFeacY66HY42lbHEAP74vlAgllZwhvLfWw+Ao0YyTqhLQr6t+2wHCcV1jmh3hkhsilxjXOqPYr1XezD9ZGCRrlcrJ0472puSBCFGFfmcFgQ5DJaa2Kf/DMxAwC7dQLG5D8i9axcqCaXPXKI8kkfQzSVeMBk3gV5chN6b0ZPwgTLeU61jvLWLqYdo0XTsqBAHr19UQEQWeHc1j3VVzCOZrp6GPqAbf0C3/+8BRcPULhALnUlAysuTg410LZKy3hNoLH3TTRCyEHXdBAvT+OJibwq5K+RI5SAsxuMFL38pg/UQsdhB8zHGBiiWXGJBFUcjZ4/JdXKrQjP7UymeyLArK8lUnPKgHypNwVbt/NysP2Ck+nxiJU8DCP8QYZeNtg/18G1OlzCIgY14IWpiPuSX7XB3SATFWoc1Fwb8yro7eb5BvkNTaS98Uo7L2pNXhsyfTz43tyseU/IkHI182E+ibEFbq2fYH8sV6cyg/MBhyOhOUZ/QNfWIid6YpJj8F2SQPDHBfZOjazMvYmnc9uDmCI7j8yfbLY26z5RSuoSHHaMOEogf595YNegQos/AcwBHY0vsDZBgcA4W00Fr/V716EXwOck+reEBFxInFZKeMRKX4hmiNDrbbhJh2AT7kzbYd/cXP9s+C4M3axOlKn91CjGz6vrfZqyELDS3S8J X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-Network-Message-Id: 0f9708a2-37c0-4620-b12b-08d9052ca9ee X-MS-Exchange-CrossTenant-AuthSource: BYAPR12MB3238.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 22 Apr 2021 01:19:23.9017 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: vdsYwaLSVheKoT6GyehMqLxHVCyDhocXnrF6izxj4zzIqGNql8y1Uh1z+mRdNKXK X-MS-Exchange-Transport-CrossTenantHeadersStamped: BY5PR12MB3713 Precedence: bulk List-ID: X-Mailing-List: stable@vger.kernel.org In the NVMe controller default suspend-resume seems only save/restore the NVMe link state by APST opt and the NVMe remains in D0 during this time. Then the NVMe device will be shutdown by SMU firmware in the s2idle entry and then will lost the NVMe power context during s2idle resume.Finally, the NVMe command queue request will be processed abnormally and result in access timeout.This issue can be settled by using PCIe power set with simple suspend-resume process path instead of APST get/set opt. In this patch prepare a PCIe RC bus flag to identify the platform whether need the quirk. Cc: # 5.10+ Signed-off-by: Prike Liang Signed-off-by: Shyam Sundar S K [ck: split patches for nvme and pcie] Signed-off-by: Chaitanya Kulkarni Suggested-by: Keith Busch Acked-by: Keith Busch --- Changes in v2: Fix the patch format and check chip root complex DID instead of PCIe RP to avoid the storage device plugged in internal PCIe RP by USB adaptor. Changes in v3: According to Christoph Hellwig do NVME PCIe related identify opt better in PCIe quirk driver rather than in NVME module. Changes in v4: Split the fix to PCIe and NVMe part and then call the pci_dev_put() put the device reference count and finally refine the commit info. Changes in v5: According to Christoph Hellwig and Keith Busch better use a passthrough device(bus) gloable flag to identify the NVMe shutdown opt rather than look up the device BDF. --- drivers/pci/probe.c | 5 ++++- drivers/pci/quirks.c | 7 +++++++ include/linux/pci.h | 2 ++ 3 files changed, 13 insertions(+), 1 deletion(-) diff --git a/drivers/pci/probe.c b/drivers/pci/probe.c index 953f15a..34ba691e 100644 --- a/drivers/pci/probe.c +++ b/drivers/pci/probe.c @@ -558,10 +558,13 @@ static struct pci_bus *pci_alloc_bus(struct pci_bus *parent) INIT_LIST_HEAD(&b->resources); b->max_bus_speed = PCI_SPEED_UNKNOWN; b->cur_bus_speed = PCI_SPEED_UNKNOWN; + if (parent) { #ifdef CONFIG_PCI_DOMAINS_GENERIC - if (parent) b->domain_nr = parent->domain_nr; #endif + if (parent->bus_flags & PCI_BUS_FLAGS_DISABLE_ON_S2I) + b->bus_flags |= PCI_BUS_FLAGS_DISABLE_ON_S2I; + } return b; } diff --git a/drivers/pci/quirks.c b/drivers/pci/quirks.c index 653660e3..7c4bb8e 100644 --- a/drivers/pci/quirks.c +++ b/drivers/pci/quirks.c @@ -312,6 +312,13 @@ static void quirk_nopciamd(struct pci_dev *dev) } DECLARE_PCI_FIXUP_FINAL(PCI_VENDOR_ID_AMD, PCI_DEVICE_ID_AMD_8151_0, quirk_nopciamd); +static void quirk_amd_s2i_fixup(struct pci_dev *dev) +{ + dev->bus->bus_flags |= PCI_BUS_FLAGS_DISABLE_ON_S2I; + pci_info(dev, "AMD simple suspend opt enabled\n"); +} +DECLARE_PCI_FIXUP_EARLY(PCI_VENDOR_ID_AMD, 0x1630, quirk_amd_s2i_fixup); + /* Triton requires workarounds to be used by the drivers */ static void quirk_triton(struct pci_dev *dev) { diff --git a/include/linux/pci.h b/include/linux/pci.h index 53f4904..dc65219 100644 --- a/include/linux/pci.h +++ b/include/linux/pci.h @@ -240,6 +240,8 @@ enum pci_bus_flags { PCI_BUS_FLAGS_NO_MMRBC = (__force pci_bus_flags_t) 2, PCI_BUS_FLAGS_NO_AERSID = (__force pci_bus_flags_t) 4, PCI_BUS_FLAGS_NO_EXTCFG = (__force pci_bus_flags_t) 8, + /* Driver must pci_disable_device() for suspend-to-idle */ + PCI_BUS_FLAGS_DISABLE_ON_S2I = (__force pci_bus_flags_t) 16, }; /* Values from Link Status register, PCIe r3.1, sec 7.8.8 */ From patchwork Thu Apr 22 01:19:06 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Prike Liang X-Patchwork-Id: 426253 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-18.8 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, HEADER_FROM_DIFFERENT_DOMAINS, INCLUDES_CR_TRAILER, INCLUDES_PATCH, MAILING_LIST_MULTI, MSGID_FROM_MTA_HEADER, SPF_HELO_NONE, SPF_PASS, USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 236FDC433B4 for ; Thu, 22 Apr 2021 01:19:29 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id EA93A61437 for ; Thu, 22 Apr 2021 01:19:28 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S235803AbhDVBUC (ORCPT ); Wed, 21 Apr 2021 21:20:02 -0400 Received: from mail-co1nam11on2044.outbound.protection.outlook.com ([40.107.220.44]:38746 "EHLO NAM11-CO1-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S234970AbhDVBUB (ORCPT ); Wed, 21 Apr 2021 21:20:01 -0400 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=jaEakwv3hDAXv/X5cDq15D6fC+nV7pyJ+RYfRW6srMre7qGCcwyuyDpjNNsca8SxjW+nQDpl0b4FPMz+dZkT4L7goFtMVEpbFNVMubzOq4XObMr4EtOA+Sth/7l6eIgvYitJ/oJikIlKIe5uLQGNb3WdWj0MkmbLCG2H9CoIMcYVqEq5J0fM23wN7/nht5wOcWGy50Q2cexiksIbIJ1IJIJvaq9+R76R4n4a+R7pklr0IoM5qleq12Q/7ptlLwh+lmZKlBTFg64elO+HwxVDR/IOvtSuE7gJPZ5U8vM5rYi7Tz45BUanc3E891m88HYj1mzeaMvxXofhabaDKkWWPg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=BWncXXwH6G1UOyXKgg+0sAQp/8KYVF8utZLKFfh0cLA=; b=aiJnySp5v1BVNL88J60roQsrfsLfwSetz8bDxoTGk4NTJE6LmqvheLlnVmemaFbwA5lEvv39U+fpz2RiNELFSmBEmrcbvSpXCeMtWlO00okGtk8s3h6aly9ZEqBfaERuy4nS3wJ3ciO4qlnwe+LaVdfENqoD39ZkvV1+wdMu5yYZRettxLMVUcMmFRVVb/InN7anYufPQbq5DCDpujkPWqQWAcgt1Dg3UL6oudrxEV/EH6jFZoJhrzDtn/u2X7SXO+v3gOYnSxKIY5+b953iqayhtgVTwQRvmXLddg+7nL2J/Aj9Ped96jhTPkHRbhSZovxOh9eDGYVTI0ImLmLqaw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=amd.com; dmarc=pass action=none header.from=amd.com; dkim=pass header.d=amd.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=BWncXXwH6G1UOyXKgg+0sAQp/8KYVF8utZLKFfh0cLA=; b=FaHgyG6vJtoTblW1BCMtshd8ZmsUq74ZYiz1tICxoXxvmOGdU//Gbf57C/05XHI6A8/ZMEjO/DcPl8uBYnf6DimC0TBuK4gzgLTqG4UKGvF6rP6BbVBgG33tmkffNsmVdHbaF13G0jQOh0ZKhQY2jYwdMEw8Qr1yWZFJCLtPZds= Authentication-Results: lists.infradead.org; dkim=none (message not signed) header.d=none; lists.infradead.org; dmarc=none action=none header.from=amd.com; Received: from BYAPR12MB3238.namprd12.prod.outlook.com (2603:10b6:a03:13b::20) by BY5PR12MB3713.namprd12.prod.outlook.com (2603:10b6:a03:1a6::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4065.21; Thu, 22 Apr 2021 01:19:27 +0000 Received: from BYAPR12MB3238.namprd12.prod.outlook.com ([fe80::5870:fcd6:b13a:c49c]) by BYAPR12MB3238.namprd12.prod.outlook.com ([fe80::5870:fcd6:b13a:c49c%5]) with mapi id 15.20.4042.024; Thu, 22 Apr 2021 01:19:26 +0000 From: Prike Liang To: linux-nvme@lists.infradead.org, kbusch@kernel.org, hch@infradead.org, Chaitanya.Kulkarni@wdc.com, gregkh@linuxfoundation.org Cc: stable@vger.kernel.org, Alexander.Deucher@amd.com, Shyam-sundar.S-k@amd.com, Prike Liang , Chaitanya Kulkarni Subject: [PATCH v5 2/2] nvme-pci: add AMD PCIe quirk for simple suspend/resume Date: Thu, 22 Apr 2021 09:19:06 +0800 Message-Id: <1619054346-4566-3-git-send-email-Prike.Liang@amd.com> X-Mailer: git-send-email 2.7.4 In-Reply-To: <1619054346-4566-1-git-send-email-Prike.Liang@amd.com> References: <1619054346-4566-1-git-send-email-Prike.Liang@amd.com> X-Originating-IP: [180.167.199.189] X-ClientProxiedBy: HKAPR03CA0020.apcprd03.prod.outlook.com (2603:1096:203:c9::7) To BYAPR12MB3238.namprd12.prod.outlook.com (2603:10b6:a03:13b::20) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 Received: from prike.amd.com (180.167.199.189) by HKAPR03CA0020.apcprd03.prod.outlook.com (2603:1096:203:c9::7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256) id 15.20.4087.16 via Frontend Transport; Thu, 22 Apr 2021 01:19:24 +0000 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 88f2ca99-9845-425f-40b7-08d9052caba0 X-MS-TrafficTypeDiagnostic: BY5PR12MB3713: X-MS-Exchange-Transport-Forked: True X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:1227; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 0ju16tvgnUQcczwCR2frCindUC/q4Q4oUkc+tuxiUAYkVCC+OAXfWrHTYvPiJSXxAscKZDn3mx8iUsvzHOrXljkQCkJyAlAhKfLCftrPBwlbdg6MPa5cYA4Y4tm0XYRTERL8m/pwsGabdr5hQaJQrMGToZhUs7PKLoPniVGtTRjwsWaQoayJdTMpZ1A6bGyWV5o65fP6/FqA/3oxmexoD4Q4Wbm9fIvfEYqU4fv8ZAJEubgnZz1WUgvPMRuve7gmnFJ3jmCC0ZeFnKkVCnXR48a9+BivWSSqzljuosa5IwLWDMXvwFZvkvYgEZJXsPjGsMY0Ob3qQqdIu++YuVmuvQ/VVBLOYrAQBJOeaU5lCoVNLJWPLigfWIkX7g0qV4ZKalYchgkpxBDGJtoaLCsEiRbX+Jd6Hl0N2wMDjYAmLVkrzk+OkuXCgQ1CT92G5C+e7P+D5B4/8Lir1oOEN5OYvTekof7Y5Lx7uCn7oQTlYw8Q9GUeu81buPCgCkYUejHKQ/td5DPyLtTkU68nsvAjeLrNt4o9TmM+AEj8F0pcHgV5qU8DKm5qY9uOY6C4HPWAQLmt5IhwQEGmDvmuD51Xawh4WMboGEM58SilTOh98lyfGX/hl3GVu0v6Lx9eoNSsVrJeQdaAaqZ/fCri8NYJQw== X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BYAPR12MB3238.namprd12.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(376002)(396003)(39860400002)(346002)(136003)(366004)(83380400001)(4326008)(8676002)(478600001)(316002)(66946007)(8936002)(2906002)(36756003)(86362001)(54906003)(38100700002)(16526019)(15650500001)(186003)(2616005)(5660300002)(956004)(38350700002)(26005)(6486002)(52116002)(7696005)(6666004)(66476007)(66556008); DIR:OUT; SFP:1101; X-MS-Exchange-AntiSpam-MessageData: iPiwb3nHSIFOonDHKtu9VzLawQJBArIAuRngpRVv3jdyRT8cIT1tbS7DRwdaFPaWSxdu/1jGiaQDM2BqVZi4cpr0ncRJI7GLBPpjTMMr2gpzrsHY4fSrbIdf3INsi55M98hZUPyi8s0C96ogSkJ9XKuQ4oj49kYqwlJasekW0S5Kt8vW/EHRxSsLvUffkegcAhMLQ/629UjJ3ifAFgPs+n6aYSuRXtrqjkPpVeLJyOK2OPvG6Z9kLnLljm1WVVREz2UCLY8tle9VFKh46wDjZ5e0arKpxrbS9jLMiMdPJKmHT7/+hkL4XkpZYTuWZ5n9Dk6uEOIMecugb5+gv7V65pywy3XzdoLf69LmN19NI/HpcikWCp0JH+7d/kxKsysJwXRXlYsBN5heAKj3/qGxyJhho0azYQiZ/6Y8YXmJvWtAVAQgPz/qePVWo6oFJlE4gvrU5V9Dn7iwHnZf6PjJjzbqutraJtarth+sJxdhMZ97JFwQtJIeE+fpPd+YG/NFzKzzE019p1tsV+PJP0w0HrJbr8Od1Nyy6UOOE3iR9FJ2QJ+kfsFPZqgxhmo8n0uDINEgJqCyBCeGiXo4k4YDhsllhYvSvpgyydxX3yyONO3DW0a6IakumEK4aNw8tV843F2o9WEzf4pzkrdp+g8CU5deKSnxwGBTMlPQOP1PDZA90TLyi3DciV6vFpmqyCuRW6Z+axGs6r8RlShse9KVEciX8nQ4wIDiSFni1Z0Dfh6JNspR/BWG6edcfQvuQ/6b9aj/HQi8xIAdq+pm1U/W6EQrt834vrS6l7tAMi4QALzwVQg/r24UNIy26NMBk3EMJIo1aUk4CHWO5ilBB3CrbThVj+M50RHQh0zaJOjC4F281KSjZKorgkeOaSEPKue7qZJemaZSf/RRnY+K6RH8kt227TOq2aLzlQXeCe7vv/whM29OSsuX/jj+Ue1Ahlh6kkC+t8XL0QpU0SrOu2kIuPHegoqn3/27FkAf3q2Qoft5V6qftzSA9ZnviD+klNAssr0Yz/FkaEKSgFidPpZbW+k5I/iuL2YJViFl65JnVxCmCZ0cflABw/DsXeQEPbx5CUYMxXOtstuFflvE8hI9iXQ31k5kGiTpHLR4CKZjkh+Q/SjQFC8T1o+VK0v6XogB+atEp283D9LXsc1w45H8u4aDnIT3I7b7etP5sYfzpSYsjjJUQn7y/wQhkbWW0ecAW10UYXYkhJuXL2av+R5kNBFOYNYlZOEQCRYT/YYnCzj1+uuxK/VK+jtNHiyF3H2TgnAqQo8bDb991+vHTTMi1UYSyR5eyR0afcA20T60fFLKL0b5E3BzMlxfhsilfJvp X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-Network-Message-Id: 88f2ca99-9845-425f-40b7-08d9052caba0 X-MS-Exchange-CrossTenant-AuthSource: BYAPR12MB3238.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 22 Apr 2021 01:19:26.8450 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: 4QA++AM5HEA0wj9+lPjNVWjDn2qZP9Dg10HDUMeW0Yv+Ex4ftviapp21ZrHf1jlD X-MS-Exchange-Transport-CrossTenantHeadersStamped: BY5PR12MB3713 Precedence: bulk List-ID: X-Mailing-List: stable@vger.kernel.org In the NVMe controller default suspend-resume seems only save/restore the NVMe link state by APST opt and the NVMe remains in D0 during this time. Then the NVMe device will be shutdown by SMU firmware in the s2idle entry and then will lost the NVMe power context during s2idle resume.Finally, the NVMe command queue request will be processed abnormally and result in access timeout.This issue can be settled by using PCIe power set with simple suspend-resume process path instead of APST get/set opt. This patch is updating the nvme_acpi_storage_d3() with previously added quirk. Cc: # 5.10+ Signed-off-by: Prike Liang Signed-off-by: Shyam Sundar S K [ck: split patches for nvme and pcie] Signed-off-by: Chaitanya Kulkarni Suggested-by: Keith Busch Acked-by: Keith Busch --- Changes in v2: Fix the patch format and check chip root complex DID instead of PCIe RP to avoid the storage device plugged in internal PCIe RP by USB adaptor. Changes in v3: According to Christoph Hellwig do NVME PCIe related identify opt better in PCIe quirk driver rather than in NVME module. Changes in v4: Split the fix to PCIe and NVMe part and then call the pci_dev_put() put the device reference count and finally refine the commit info. Changes in v5: According to Christoph Hellwig and Keith Busch better use a passthrough device(bus) gloable flag to identify the NVMe shutdown opt rather than look up the device BDF. --- drivers/nvme/host/pci.c | 2 ++ 1 file changed, 2 insertions(+) diff --git a/drivers/nvme/host/pci.c b/drivers/nvme/host/pci.c index 6bad4d4..617256e 100644 --- a/drivers/nvme/host/pci.c +++ b/drivers/nvme/host/pci.c @@ -2836,6 +2836,8 @@ static bool nvme_acpi_storage_d3(struct pci_dev *dev) acpi_status status; u8 val; + if (dev->bus->bus_flags & PCI_BUS_FLAGS_DISABLE_ON_S2I) + return true; /* * Look for _DSD property specifying that the storage device on the port * must use D3 to support deep platform power savings during