From patchwork Tue Oct 12 13:25:03 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Alexandru Elisei X-Patchwork-Id: 12552591 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 2CF59C433EF for ; Tue, 12 Oct 2021 13:23:45 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 0D3F461040 for ; Tue, 12 Oct 2021 13:23:45 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S236819AbhJLNZp (ORCPT ); Tue, 12 Oct 2021 09:25:45 -0400 Received: from foss.arm.com ([217.140.110.172]:42114 "EHLO foss.arm.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S236742AbhJLNZp (ORCPT ); Tue, 12 Oct 2021 09:25:45 -0400 Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id 47813ED1; Tue, 12 Oct 2021 06:23:43 -0700 (PDT) Received: from monolith.cable.virginm.net (unknown [172.31.20.19]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id 4587B3F66F; Tue, 12 Oct 2021 06:23:42 -0700 (PDT) From: Alexandru Elisei To: will@kernel.org, julien.thierry.kdev@gmail.com, kvm@vger.kernel.org Cc: andre.przywara@arm.com, jean-philippe@linaro.org Subject: [PATCH v2 kvmtool 0/7] vfio/pci: Fix MSIX table and PBA size allocation Date: Tue, 12 Oct 2021 14:25:03 +0100 Message-Id: <20211012132510.42134-1-alexandru.elisei@arm.com> X-Mailer: git-send-email 2.33.0 MIME-Version: 1.0 Precedence: bulk List-ID: X-Mailing-List: kvm@vger.kernel.org This series is meant to rework the way the MSIX table and PBA are allocated to prevent situations where the size allocated by kvmtool is larger than the size of the BAR that holds them. Patches 1-3 are fixes for stuff I found when I was investing a bug triggered by the incorrect sizing of the table and PBA. Patch 4 is a preparatory patch. Patch 5 is the proper fix. More details in the commit message. Patch 6 is there to make it easier to catch such errors if the code regresses. Patch 7 is an optimization for guests with larger page sizes than the host. Testing ======= For v2: On an AMD Seattle, host page size 4k and 64k, guest page size 4k and 64k, tested device passthrough with a Realtek RTL8168 NIC. For v1: On an AMD Seattle, host page size 4k and 64k, guest page size 4k and 64k (so 4 tests in total for each device). Tried device passthrough with a Realtek RTL8168 NIC and with a Intel 82574L NIC (not at the same time). No issues encountered, MSIX table and PBA BAR has the same layout as the physical device. On an AMD Ryzen 3900x, host and guest 4k pages, I've assigned an Intel 82574L NIC to the guest. Realtek RTL8168 doesn't work without emulating a PCI Express bus because the drivers falls back to CSI for device configuration. Everything works in the guest, the shared BAR has the same layout in the guest as the physical device. Changelog ========= Since v1: * Rebased on top of dc6646192057 ("arm64: Be more permissive when parsing the kernel header"). * Added reviewed-by tags, many thanks. * Removed comment about aligning table and pba sizes to PAGE_SIZE in vfio_pci_create_msix_table, as per Andre's suggestion. * Added a newline after local variable declaration in vfio_pci_create_msix_table. * Align MSIX table and PBA to the maximum architectural page size in #7 ("vfio/pci: Fix MSIX table and PBA size allocation"), as suggested by Andre. Alexandru Elisei (7): arm/gicv2m: Set errno when gicv2_update_routing() fails vfio/pci.c: Remove double include for assert.h pci: Fix pci_dev_* print macros vfio/pci: Rename PBA offset in device descriptor to fd_offset vfio/pci: Rework MSIX table and PBA physical size allocation vfio/pci: Print an error when offset is outside of the MSIX table or PBA vfio/pci: Align MSIX Table and PBA size to guest maximum page size arm/aarch32/include/kvm/kvm-arch.h | 4 ++ arm/aarch64/include/kvm/kvm-arch.h | 4 ++ arm/gicv2m.c | 10 ++-- include/kvm/pci.h | 10 ++-- include/kvm/vfio.h | 3 +- mips/include/kvm/kvm-arch.h | 3 ++ powerpc/include/kvm/kvm-arch.h | 3 ++ vfio/pci.c | 86 +++++++++++++++++++----------- x86/include/kvm/kvm-arch.h | 3 ++ 9 files changed, 84 insertions(+), 42 deletions(-)