From patchwork Fri Oct 11 14:00:40 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Daire McNamara X-Patchwork-Id: 13832650 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 3BB0CD0D7BA for ; Fri, 11 Oct 2024 15:16:41 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:MIME-Version:Message-ID:Date:Subject:CC :To:From:Reply-To:Content-ID:Content-Description:Resent-Date:Resent-From: Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:In-Reply-To:References: List-Owner; bh=rdC+88Em3RlnyY6kjlsdoNrtcbPZ79uDT3dUUzqlJd8=; b=FsOyvuVc3/OzFl XGgdOtz7xuAXqSL5Wv7T2/4NeS5R+UyVxwL07dZB70fBo8qYQ8fWAFDzybgW3pYUXv18crjLpNasf dztnnmfNXg7QaESDGkmQMQS1w5ns4TyM6cikorPTD9Y11mULtuVX6sHvBd8c9rT06IElWSNxdcrR0 OiJ75caIOpgVueT7Wq2EFtQumpeRUu2qxXTuPb5MEPr+kfxzycbgI3h14TnxGQsez/2I0LL2hRwbv B/QterOxWWDNTIIGT9zF3xnX7JlqC+a1Ulh9jU768se4j46YXIYu0PGtn6BB0QyqUaJ9qSvLqpb1M DtVSLYv35csd1J3NhCyQ==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.98 #2 (Red Hat Linux)) id 1szHNd-0000000Gka4-2lqi; Fri, 11 Oct 2024 15:16:37 +0000 Received: from esa.microchip.iphmx.com ([68.232.153.233]) by bombadil.infradead.org with esmtps (Exim 4.98 #2 (Red Hat Linux)) id 1szGDW-0000000GXQt-1uM6 for linux-riscv@lists.infradead.org; Fri, 11 Oct 2024 14:02:08 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=microchip.com; i=@microchip.com; q=dns/txt; s=mchp; t=1728655326; x=1760191326; h=from:to:cc:subject:date:message-id:mime-version: content-transfer-encoding; bh=sQQRl84OSqc71fs5ZYTHiOsVda3ygHGyCvYxoo3m6Vo=; b=xdk2e9E7oCuhg6mnVDhGx/lgSPa5awbAbgxxmWYE0rVKZl0bcQziDNbb doMpsnTu75w1w3TgDizJRzio5cXKljop1KsR/mJ6QjkTJUwB9HuioDhR7 e7sdRut8AjNPO3/0nr95EeSmWHKBeoTCx0eeMUuMKf8VtueUDnmvtMb4N 0EdAnv8Cq8K+LUBTTCHDdt+Tgb6gxPUMsCgymeDc3TYi29zrV3fTDBoe1 XoZ0FYoQMxM7vJnUaX0kpcJziGDqyOMz9UIJckskPXXgoHmt8i00l4Mnr m+/RBPe2kBHTtk7FvaMnR1wGzpKSPtsJ5d3HQhlJkvq23RU62m78V25Kf w==; X-CSE-ConnectionGUID: PBjGkC+SSZ+djG4FWi+TaQ== X-CSE-MsgGUID: /gNjHoa8S1WzSWJx2oYLbg== X-IronPort-AV: E=Sophos;i="6.11,196,1725346800"; d="scan'208";a="263956557" X-Amp-Result: SKIPPED(no attachment in message) Received: from unknown (HELO email.microchip.com) ([170.129.1.10]) by esa5.microchip.iphmx.com with ESMTP/TLS/ECDHE-RSA-AES128-GCM-SHA256; 11 Oct 2024 07:02:03 -0700 Received: from chn-vm-ex04.mchp-main.com (10.10.85.152) by chn-vm-ex04.mchp-main.com (10.10.85.152) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.35; Fri, 11 Oct 2024 07:01:26 -0700 Received: from wendy.microchip.com (10.10.85.11) by chn-vm-ex04.mchp-main.com (10.10.85.152) with Microsoft SMTP Server id 15.1.2507.35 via Frontend Transport; Fri, 11 Oct 2024 07:01:24 -0700 From: To: , CC: , , , , , , , , , , , Subject: [PATCH v10 0/3] Fix address translations on MPFS PCIe controller Date: Fri, 11 Oct 2024 15:00:40 +0100 Message-ID: <20241011140043.1250030-1-daire.mcnamara@microchip.com> X-Mailer: git-send-email 2.43.2 MIME-Version: 1.0 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20241011_070206_527503_F57CE187 X-CRM114-Status: GOOD ( 12.67 ) X-BeenThere: linux-riscv@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "linux-riscv" Errors-To: linux-riscv-bounces+linux-riscv=archiver.kernel.org@lists.infradead.org From: Daire McNamara Hi all, On Microchip PolarFire SoC (MPFS), the PCIe controller is connected to the CPU via one of three Fabric Interface Connectors (FICs). Each FIC present to the CPU complex as 64-bit AXI-M and 64-bit AXI-S. To preserve compatibility with other PolarFire family members, the PCIe controller is connected to its encapsulating FIC via a 32-bit AXI-M and 32-bit AXI-S interface. Each FIC is implemented in FPGA logic and can incorporate logic along its 64-bit AXI-M to 32-bit AXI-M chain (including address translation) and, likewise, along its 32-bit AXI-S to 64-bit AXI-S chain (again including address translation). In order to reduce the potential support space for the PCIe controller in this environment, MPFS supports certain reference designs for these address translations: reference designs for cache-coherent memory accesses and reference designs for non-cache-coherent memory accesses. The precise details of these reference designs and associated customer guidelines recommending that customers adhere to the addressing schemes used in those reference designs are available from Microchip, but the implication for the PCIe controller address translation between CPU-space and PCIe-space are: For outbound address translation, the PCIe controller address translation tables are treated as if they are 32-bit only. Any further address translation must be done in FPGA fabric. For inbound address translation, the PCIe controller is configurable for two cases: * In the case of cache-coherent designs, the base of the AXI-S side of the address translation must be set to 0 and the size should be 4 GiB wide. The FPGA fabric must complete any address translations based on that 0-based address translation. * In the case of non-cache coherent designs, the base of AXI-S side of the address translation must be set to 0x8000'0000 and the size shall be 2 GiB wide. The FPGA fabric must complete any address translation based on that 0x80000000 base. So, for example, in the non-cache-coherent case, with a device tree property that maps an inbound range from 0x10'0000'0000 in PCIe space to 0x10'0000'0000 in CPU space, the PCIe rootport will translate a PCIe address of 0x10'0000'0000 to an intermediate 32-bit AXI-S address of 0x8000'0000 and the FIC is responsible for translating that intermediate 32-bit AXI-S address of 0x8000'0000 to a 64-bit AXI-S address of 0x10'0000'0000. And similarly, for example, in the cache-coherent case, with a device tree property that maps an inbound range from 0x10'0000'0000 in PCIe space to 0x10'0000'0000 in CPU space, the PCIe rootport will translate a PCIe address of 0x10'0000'0000 to an intermediate 32-bit AXI-S address of 0x0000'0000 and the FIC is responsible for translating that intermediate 32-bit AXI-S address of 0x0000'0000 to a 64-bit AXI-S address of 0x10'0000'0000. See https://lore.kernel.org/all/20220902142202.2437658-1-daire.mcnamara@microchip.com/T/ for backstory. Changes since v9: - Dropped plda_setup_inbound_address_translation() from StarFive driver Changes since v8: - Edits suggested by BHelgass and Ilpo Jarvinen - Dropped the setup_inbound_atr u64 change (passing on openrisc 32-bit without it) Changes since v7: - Rebased on top of 6.11rc1 Changes since v6: - Added Reviewed-by: Ilpo tag to outbound patch - Fixed typos/capitalisation/etc as suggested by Ilpo Changes since v5: - Reverted setup_inbound_atr size parameter to u64 as ci system reported SZ_4G getting truncated to 0 on mips when I try to use size_t or resource_size_t. Added Acked-by tags Changes since v4: - Added more cleanups suggested by Ilpo Jarvinen Added cleanups for inbound v4 and outbound v3. Changes since v3: - Added nice cleanups suggested by Ilpo Jarvinen Changes since v2: - Added Changes since v1: - added bindings patch to allow dma-noncoherent - changed a size_t to u64 to pass 32-bit compile tests - allowed 64-bit outbound pcie translations - tied PCIe side of eCAM translation table to 0 Conor Dooley (1): dt-bindings: PCI: microchip,pcie-host: allow dma-noncoherent Daire McNamara (2): PCI: microchip: Fix outbound address translation tables PCI: microchip: Fix inbound address translation tables .../bindings/pci/microchip,pcie-host.yaml | 2 + .../pci/controller/plda/pcie-microchip-host.c | 123 +++++++++++++++++- drivers/pci/controller/plda/pcie-plda-host.c | 17 ++- drivers/pci/controller/plda/pcie-plda.h | 6 +- 4 files changed, 139 insertions(+), 9 deletions(-) base-commit: 8400291e289ee6b2bf9779ff1c83a291501f017b