Message ID | 20240906215411.18770-1-saeed@kernel.org (mailing list archive) |
---|---|
State | Changes Requested |
Headers | show
Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 53E67158A00 for <netdev@vger.kernel.org>; Fri, 6 Sep 2024 21:54:15 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1725659656; cv=none; b=bIQzVO5ZDPrpSabQq340TOlIiQ/jG7Fq31cRldCcYNo3V8YRnipI2wapJfGDWr8Pjp/V0VMLFgwsVyg0X1XwD7k1bNs3kY5nj0W+MNZqfep8gAG09tThaJc/Rs5FLemb9ipOJdOKzCnBs/2xl8zqWL4UNQHunMfZzULSUtue24w= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1725659656; c=relaxed/simple; bh=Khy32yCVRN0ySWdAQpbWcfr+nQd65weE78tq/uvxiRI=; h=From:To:Cc:Subject:Date:Message-ID:MIME-Version:Content-Type; b=CAl2oKndDla0R738owIoYrurkgMYbxg4T0jp7vRIRbE8hOwwVQT145dIbNk/9YQX0upKxJB4e4qDd8r176befKwg2DH1g+8e8ocwMLGHOUISP17bQxveMqEZFIYs4l33edJrJqvQYJDXHifFvErPBSe/sFkR09qVF7kW8h66fDo= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=ISc2Frtc; arc=none smtp.client-ip=10.30.226.201 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="ISc2Frtc" Received: by smtp.kernel.org (Postfix) with ESMTPSA id B61C4C4CEC4; Fri, 6 Sep 2024 21:54:15 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1725659655; bh=Khy32yCVRN0ySWdAQpbWcfr+nQd65weE78tq/uvxiRI=; h=From:To:Cc:Subject:Date:From; b=ISc2FrtceTGNomj3EJJ0EkY1F3EdTny15stjb3Fag8tegnE+lCNxnqMXq8SmFlfdf TmYNqhuNNX7/lh5fiokecoHt8KX4zqsxR9aCHKfSWqRzNhTjmbKILwqU/ljAhPDEDY RnnffI0xXxVQvrLbwXTajH0shg0UzEYALg6JTNav8Rf2PU49MXer27Omsmtk7ai5yH oJCG9iwICuGyVsUlSbDqJPdvhwuPSFqA2/ElcwBYdba38dNay1o5SD9sgp2w/nIVfE ZvDvsPWwgFBljZzRGc8G2Qop/zyw1NhM33VqoQRqmu0MrYQ0ucdSY0PXANbnsD8plz ahwo67ZdXG3AQ== From: Saeed Mahameed <saeed@kernel.org> To: "David S. Miller" <davem@davemloft.net>, Jakub Kicinski <kuba@kernel.org>, Paolo Abeni <pabeni@redhat.com>, Eric Dumazet <edumazet@google.com> Cc: Saeed Mahameed <saeedm@nvidia.com>, netdev@vger.kernel.org, Tariq Toukan <tariqt@nvidia.com>, Gal Pressman <gal@nvidia.com>, Leon Romanovsky <leonro@nvidia.com> Subject: [pull request][net-next V3 00/15] mlx5 updates 2024-09-02 Date: Fri, 6 Sep 2024 14:53:55 -0700 Message-ID: <20240906215411.18770-1-saeed@kernel.org> X-Mailer: git-send-email 2.46.0 Precedence: bulk X-Mailing-List: netdev@vger.kernel.org List-Id: <netdev.vger.kernel.org> List-Subscribe: <mailto:netdev+subscribe@vger.kernel.org> List-Unsubscribe: <mailto:netdev+unsubscribe@vger.kernel.org> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit |
From: Saeed Mahameed <saeedm@nvidia.com> This series adds HW steering support in mlx5. For more information please see tag log below. V1->V2: - Fix sparse and checkpatch issue. V2->V3: - Smatch and coccicheck fixes. Please pull and let me know if there is any problem. Thanks, Saeed. The following changes since commit 52fc70a32573707f70d6b1b5c5fe85cc91457393: Merge branch 'rx-sw-tstamp-for-all' (2024-09-06 09:34:19 +0100) are available in the Git repository at: git://git.kernel.org/pub/scm/linux/kernel/git/saeed/linux.git tags/mlx5-updates-2024-09-02 for you to fetch changes up to 225a3a15c7466ca76ad6e973f700f95061c18405: net/mlx5: HWS, added API and enabled HWS support (2024-09-06 14:50:31 -0700) ---------------------------------------------------------------- mlx5-updates-2024-08-29 HW-Managed Flow Steering in mlx5 driver Yevgeny Kliteynik says: ======================= 1. Overview ----------- ConnectX devices support packet matching, modification, and redirection. This functionality is referred as Flow Steering. To configure a steering rule, the rule is written to the device-owned memory. This memory is accessed and cached by the device when processing a packet. The first implementation of Flow Steering was done in FW, and it is referred in the mlx5 driver as Device-Managed Flow Steering (DMFS). Later we introduced SW-managed Flow Steering (SWS or SMFS), where the driver is writing directly to the device's configuration memory (ICM) through RC QP using RDMA operations (RDMA-read and RDAM-write), thus achieving higher rates of rule insertion/deletion. Now we introduce a new flow steering implementation: HW-Managed Flow Steering (HWS or HMFS). In this new approach, the driver is configuring steering rules directly to the HW using the WQs with a special new type of WQE. This way we can reach higher rule insertion/deletion rate with much lower CPU utilization compared to SWS. The key benefits of HWS as opposed to SWS: + HW manages the steering decision tree - HW calculates CRC for each entry - HW handles tree hash collisions - HW & FW manage objects refcount + HW keeps cache coherency: - HW provides tree access locking and synchronization - HW provides notification on completion + Insertion rate isn’t affected by background traffic - Dedicated HW components that handle insertion 2. Performance -------------- Measuring Connection Tracking with simple IPv4 flows w/o NAT, we are able to get ~5 times more flows offloaded per second using HWS. 3. Configuration ---------------- The enablement of HWS mode in eswitch manager is done using the same devlink param that is already used for switching between FW-managed steering and SW-managed steering modes: # devlink dev param set pci/<PCI_ID> name flow_steering_mode cmod runtime value hmfs 4. Upstream Submission ---------------------- HWS support consists of 3 main components: + Steering: - The lower layer that exposes HWS API to upper layers and implements all the management of flow steering building blocks + FS-Core - Implementation of fs_hws layer to enable fs_core to use HWS instead of FW or SW steering - Create HW steering action pools to utilize the ability of HWS to share steering actions among different rules - Add support for configuring HWS mode through devlink command, similar to configuring SWS mode + Connection Tracking - Implementation of CT support for HW steering - Hooks up the CT ops for the new steering mode and uses the HWS API to implement connection tracking. Because of the large number of patches, we need to perform the submission in several separate patch series. This series is the first submission that lays the ground work for the next submissions, where an actual user of HWS will be added. 5. Patches in this series ------------------------- This patch series contains implementation of the first bullet from above. The patches are: [patch 01/15] net/mlx5: Added missing mlx5_ifc definition for HW Steering [patch 02/15] net/mlx5: Added missing definitions in preparation for HW Steering [patch 03/15] net/mlx5: HWS, added actions handling [patch 04/15] net/mlx5: HWS, added tables handling [patch 05/15] net/mlx5: HWS, added rules handling [patch 06/15] net/mlx5: HWS, added definers handling [patch 07/15] net/mlx5: HWS, added matchers functionality [patch 08/15] net/mlx5: HWS, added FW commands handling [patch 09/15] net/mlx5: HWS, added modify header pattern and args handling [patch 10/15] net/mlx5: HWS, added vport handling [patch 11/15] net/mlx5: HWS, added memory management handling [patch 12/15] net/mlx5: HWS, added backward-compatible API handling [patch 13/15] net/mlx5: HWS, added debug dump and internal headers [patch 14/15] net/mlx5: HWS, added send engine and context handling [patch 15/15] net/mlx5: HWS, added API and enabled HWS support ======================= ---------------------------------------------------------------- Yevgeny Kliteynik (15): net/mlx5: Added missing mlx5_ifc definition for HW Steering net/mlx5: Added missing definitions in preparation for HW Steering net/mlx5: HWS, added actions handling net/mlx5: HWS, added tables handling net/mlx5: HWS, added rules handling net/mlx5: HWS, added definers handling net/mlx5: HWS, added matchers functionality net/mlx5: HWS, added FW commands handling net/mlx5: HWS, added modify header pattern and args handling net/mlx5: HWS, added vport handling net/mlx5: HWS, added memory management handling net/mlx5: HWS, added backward-compatible API handling net/mlx5: HWS, added debug dump and internal headers net/mlx5: HWS, added send engine and context handling net/mlx5: HWS, added API and enabled HWS support .../ethernet/mellanox/mlx5/kconfig.rst | 3 + drivers/net/ethernet/mellanox/mlx5/core/Kconfig | 10 + drivers/net/ethernet/mellanox/mlx5/core/Makefile | 21 + drivers/net/ethernet/mellanox/mlx5/core/fs_core.h | 8 +- .../ethernet/mellanox/mlx5/core/steering/dr_cmd.c | 12 +- .../mellanox/mlx5/core/steering/hws/Makefile | 2 + .../mellanox/mlx5/core/steering/hws/mlx5hws.h | 954 +++++++ .../mlx5/core/steering/hws/mlx5hws_action.c | 2604 ++++++++++++++++++++ .../mlx5/core/steering/hws/mlx5hws_action.h | 307 +++ .../mlx5/core/steering/hws/mlx5hws_buddy.c | 149 ++ .../mlx5/core/steering/hws/mlx5hws_buddy.h | 21 + .../mellanox/mlx5/core/steering/hws/mlx5hws_bwc.c | 997 ++++++++ .../mellanox/mlx5/core/steering/hws/mlx5hws_bwc.h | 73 + .../mlx5/core/steering/hws/mlx5hws_bwc_complex.c | 86 + .../mlx5/core/steering/hws/mlx5hws_bwc_complex.h | 29 + .../mellanox/mlx5/core/steering/hws/mlx5hws_cmd.c | 1300 ++++++++++ .../mellanox/mlx5/core/steering/hws/mlx5hws_cmd.h | 361 +++ .../mlx5/core/steering/hws/mlx5hws_context.c | 260 ++ .../mlx5/core/steering/hws/mlx5hws_context.h | 64 + .../mlx5/core/steering/hws/mlx5hws_debug.c | 480 ++++ .../mlx5/core/steering/hws/mlx5hws_debug.h | 40 + .../mlx5/core/steering/hws/mlx5hws_definer.c | 2146 ++++++++++++++++ .../mlx5/core/steering/hws/mlx5hws_definer.h | 834 +++++++ .../mlx5/core/steering/hws/mlx5hws_internal.h | 59 + .../mlx5/core/steering/hws/mlx5hws_matcher.c | 1216 +++++++++ .../mlx5/core/steering/hws/mlx5hws_matcher.h | 107 + .../mlx5/core/steering/hws/mlx5hws_pat_arg.c | 579 +++++ .../mlx5/core/steering/hws/mlx5hws_pat_arg.h | 101 + .../mellanox/mlx5/core/steering/hws/mlx5hws_pool.c | 640 +++++ .../mellanox/mlx5/core/steering/hws/mlx5hws_pool.h | 151 ++ .../mellanox/mlx5/core/steering/hws/mlx5hws_prm.h | 514 ++++ .../mellanox/mlx5/core/steering/hws/mlx5hws_rule.c | 780 ++++++ .../mellanox/mlx5/core/steering/hws/mlx5hws_rule.h | 84 + .../mellanox/mlx5/core/steering/hws/mlx5hws_send.c | 1200 +++++++++ .../mellanox/mlx5/core/steering/hws/mlx5hws_send.h | 270 ++ .../mlx5/core/steering/hws/mlx5hws_table.c | 493 ++++ .../mlx5/core/steering/hws/mlx5hws_table.h | 68 + .../mlx5/core/steering/hws/mlx5hws_vport.c | 86 + .../mlx5/core/steering/hws/mlx5hws_vport.h | 13 + include/linux/mlx5/mlx5_ifc.h | 189 +- include/linux/mlx5/qp.h | 1 + 41 files changed, 17276 insertions(+), 36 deletions(-) create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/Makefile create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws.h create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_action.c create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_action.h create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_buddy.c create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_buddy.h create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_bwc.c create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_bwc.h create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_bwc_complex.c create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_bwc_complex.h create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_cmd.c create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_cmd.h create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_context.c create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_context.h create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_debug.c create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_debug.h create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_definer.c create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_definer.h create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_internal.h create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_matcher.c create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_matcher.h create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_pat_arg.c create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_pat_arg.h create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_pool.c create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_pool.h create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_prm.h create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_rule.c create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_rule.h create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_send.c create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_send.h create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_table.c create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_table.h create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_vport.c create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/steering/hws/mlx5hws_vport.h