From patchwork Tue Mar 26 16:44:55 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Marcin Szycik X-Patchwork-Id: 13604673 X-Patchwork-Delegate: kuba@kernel.org Received: from mgamail.intel.com (mgamail.intel.com [192.198.163.19]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id A74B04A0A for ; Tue, 26 Mar 2024 16:43:45 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=192.198.163.19 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1711471427; cv=none; b=HjO5O83PESJamsp2qCsSBFofOFbMknIQgkO4br1jmf6CXifKI1+BHSBdtccUn61Q3FRI7qNEWb7zy+2NEM5ckyhmWIHEUH+KPBsKZB0UJEc9Q/Z5cur9FHIl3H37M28RyNR2ZMtwSyvaWSboiT281RZvHzOZ9ICOclQUYE94PAs= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1711471427; c=relaxed/simple; bh=IUHvMlawWzgPfC0WV4QxC1756pzh9dMdtNUM8GIIUCc=; h=From:To:Cc:Subject:Date:Message-ID:MIME-Version; b=ZJuot150drelNlhFCzXHsqO0kQo7l712nsU8Qpm9t6slRvLV0L3D749KQvhRofJ1Z/AsRkFwECDLwH35e1dM3qhgFfg5T3qKxoJ98PKlUzouNjbvU4oBEscMzTAMnVpPf/mgH6DslAQdFG/YNTZQ79Xsb7WBeOqfQIAcMLFctno= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linux.intel.com; spf=none smtp.mailfrom=linux.intel.com; dkim=pass (2048-bit key) header.d=intel.com header.i=@intel.com header.b=QA8Zf54+; arc=none smtp.client-ip=192.198.163.19 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linux.intel.com Authentication-Results: smtp.subspace.kernel.org; spf=none smtp.mailfrom=linux.intel.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=intel.com header.i=@intel.com header.b="QA8Zf54+" DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1711471426; x=1743007426; h=from:to:cc:subject:date:message-id:mime-version: content-transfer-encoding; bh=IUHvMlawWzgPfC0WV4QxC1756pzh9dMdtNUM8GIIUCc=; b=QA8Zf54+lDLJ5FLUleyN2RocV4B5mUFXK4lWfUcsFLdroVQevc8e14ai 3OlsRrcN/bBitg5vuSYQLh7uT1J11z0V9hcY2q5+s4NiSklLiEx9DdDgK CQKEfBdmnbETmMckDkX7W741h8SP5t5pNMSrIBMKeJ+ZnBj59Jy6LkYj2 1dK8zgErcmONgJ3h99f0IgcHOOYO6xcSjd0Emp8SBKnRZTpE4wlUw4pcg F0OfzcSwaxhzTcD5WAQDHul97taSZvYcsuoI3cv+l1cMgu/Q5NYZZZ1GR DeLJYd82Ny1XJ9LU+WBswcygWoZHexdXaqCAsmIUiRChE2iXXPr/VnEen Q==; X-CSE-ConnectionGUID: /Rq0zCa9S165K3dMF6OhNQ== X-CSE-MsgGUID: y661wLptR7Kd11ssoffCWg== X-IronPort-AV: E=McAfee;i="6600,9927,11025"; a="6400083" X-IronPort-AV: E=Sophos;i="6.07,156,1708416000"; d="scan'208";a="6400083" Received: from fmviesa005.fm.intel.com ([10.60.135.145]) by fmvoesa113.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 26 Mar 2024 09:43:45 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="6.07,156,1708416000"; d="scan'208";a="20491767" Received: from irvmail002.ir.intel.com ([10.43.11.120]) by fmviesa005.fm.intel.com with ESMTP; 26 Mar 2024 09:43:42 -0700 Received: from mystra-4.igk.intel.com (mystra-4.igk.intel.com [10.123.220.40]) by irvmail002.ir.intel.com (Postfix) with ESMTP id 444F52819C; Tue, 26 Mar 2024 16:43:41 +0000 (GMT) From: Marcin Szycik To: intel-wired-lan@lists.osuosl.org Cc: netdev@vger.kernel.org, mschmidt@redhat.com, anthony.l.nguyen@intel.com, pawel.chmielewski@intel.com, Marcin Szycik , Wojciech Drewek , Liang-Min Wang Subject: [PATCH iwl-next v3] ice: Reset VF on Tx MDD event Date: Tue, 26 Mar 2024 17:44:55 +0100 Message-ID: <20240326164455.735739-1-marcin.szycik@linux.intel.com> X-Mailer: git-send-email 2.41.0 Precedence: bulk X-Mailing-List: netdev@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-Patchwork-Delegate: kuba@kernel.org In cases when VF sends malformed packets that are classified as malicious, sometimes it causes Tx queue to freeze. This frozen queue can be stuck for several minutes being unusable. This behavior can be reproduced with a faulty userspace app running on VF. When Malicious Driver Detection event occurs and the mdd-auto-reset-vf private flag is set, perform a graceful VF reset to quickly bring VF back to operational state. Add a log message to notify about the cause of the reset. Add a helper for this to be reused for both TX and RX events. Reviewed-by: Wojciech Drewek Co-developed-by: Liang-Min Wang Signed-off-by: Liang-Min Wang Signed-off-by: Marcin Szycik Reviewed-by: Przemek Kitszel --- v3: Only auto reset VF if the mdd-auto-reset-vf flag is set v2 [1]: Revert an unneeded formatting change, fix commit message, fix a log message with a correct event name [1] https://lore.kernel.org/netdev/20231102155149.2574209-1-pawel.chmielewski@intel.com --- drivers/net/ethernet/intel/ice/ice_main.c | 47 +++++++++++++++++----- drivers/net/ethernet/intel/ice/ice_sriov.c | 14 ++++--- drivers/net/ethernet/intel/ice/ice_sriov.h | 4 +- 3 files changed, 46 insertions(+), 19 deletions(-) diff --git a/drivers/net/ethernet/intel/ice/ice_main.c b/drivers/net/ethernet/intel/ice/ice_main.c index 3dea0d4c767c..e5d00491e41e 100644 --- a/drivers/net/ethernet/intel/ice/ice_main.c +++ b/drivers/net/ethernet/intel/ice/ice_main.c @@ -1744,6 +1744,35 @@ static void ice_service_timer(struct timer_list *t) ice_service_task_schedule(pf); } +/** + * ice_mdd_maybe_reset_vf - reset VF after MDD event + * @pf: pointer to the PF structure + * @vf: pointer to the VF structure + * @is_rx: true for RX event, false for TX event + * + * Since the queue can get stuck on VF MDD events, the PF can be configured to + * automatically reset the VF by enabling the private ethtool flag + * mdd-auto-reset-vf. + */ +static void ice_mdd_maybe_reset_vf(struct ice_pf *pf, struct ice_vf *vf, + bool is_rx) +{ + struct device *dev = ice_pf_to_dev(pf); + + if (!test_bit(ICE_FLAG_MDD_AUTO_RESET_VF, pf->flags)) + return; + + /* VF MDD event counters will be cleared by reset, so print the event + * prior to reset. + */ + ice_print_vf_mdd_event(vf, is_rx); + + dev_info(dev, "PF-to-VF reset on VF %d due to %s MDD event\n", + vf->vf_id, + is_rx ? "Rx" : "Tx"); + ice_reset_vf(vf, ICE_VF_RESET_NOTIFY | ICE_VF_RESET_LOCK); +} + /** * ice_handle_mdd_event - handle malicious driver detect event * @pf: pointer to the PF structure @@ -1845,6 +1874,8 @@ static void ice_handle_mdd_event(struct ice_pf *pf) if (netif_msg_tx_err(pf)) dev_info(dev, "Malicious Driver Detection event TX_PQM detected on VF %d\n", vf->vf_id); + + ice_mdd_maybe_reset_vf(pf, vf, false); } reg = rd32(hw, VP_MDET_TX_TCLAN(vf->vf_id)); @@ -1855,6 +1886,8 @@ static void ice_handle_mdd_event(struct ice_pf *pf) if (netif_msg_tx_err(pf)) dev_info(dev, "Malicious Driver Detection event TX_TCLAN detected on VF %d\n", vf->vf_id); + + ice_mdd_maybe_reset_vf(pf, vf, false); } reg = rd32(hw, VP_MDET_TX_TDPU(vf->vf_id)); @@ -1865,6 +1898,8 @@ static void ice_handle_mdd_event(struct ice_pf *pf) if (netif_msg_tx_err(pf)) dev_info(dev, "Malicious Driver Detection event TX_TDPU detected on VF %d\n", vf->vf_id); + + ice_mdd_maybe_reset_vf(pf, vf, false); } reg = rd32(hw, VP_MDET_RX(vf->vf_id)); @@ -1876,17 +1911,7 @@ static void ice_handle_mdd_event(struct ice_pf *pf) dev_info(dev, "Malicious Driver Detection event RX detected on VF %d\n", vf->vf_id); - /* Since the queue is disabled on VF Rx MDD events, the - * PF can be configured to reset the VF through ethtool - * private flag mdd-auto-reset-vf. - */ - if (test_bit(ICE_FLAG_MDD_AUTO_RESET_VF, pf->flags)) { - /* VF MDD event counters will be cleared by - * reset, so print the event prior to reset. - */ - ice_print_vf_rx_mdd_event(vf); - ice_reset_vf(vf, ICE_VF_RESET_LOCK); - } + ice_mdd_maybe_reset_vf(pf, vf, true); } } mutex_unlock(&pf->vfs.table_lock); diff --git a/drivers/net/ethernet/intel/ice/ice_sriov.c b/drivers/net/ethernet/intel/ice/ice_sriov.c index 65e1986af777..b56bda9f66e3 100644 --- a/drivers/net/ethernet/intel/ice/ice_sriov.c +++ b/drivers/net/ethernet/intel/ice/ice_sriov.c @@ -1848,19 +1848,21 @@ ice_set_vf_port_vlan(struct net_device *netdev, int vf_id, u16 vlan_id, u8 qos, } /** - * ice_print_vf_rx_mdd_event - print VF Rx malicious driver detect event + * ice_print_vf_mdd_event - print VF Rx malicious driver detect event * @vf: pointer to the VF structure + * @is_rx: true for RX event, false for TX event */ -void ice_print_vf_rx_mdd_event(struct ice_vf *vf) +void ice_print_vf_mdd_event(struct ice_vf *vf, bool is_rx) { struct ice_pf *pf = vf->pf; struct device *dev; dev = ice_pf_to_dev(pf); - dev_info(dev, "%d Rx Malicious Driver Detection events detected on PF %d VF %d MAC %pM. mdd-auto-reset-vfs=%s\n", - vf->mdd_rx_events.count, pf->hw.pf_id, vf->vf_id, - vf->dev_lan_addr, + dev_info(dev, "%d %s Malicious Driver Detection events detected on PF %d VF %d MAC %pM. mdd-auto-reset-vfs=%s\n", + is_rx ? vf->mdd_rx_events.count : vf->mdd_tx_events.count, + is_rx ? "Rx" : "Tx", + pf->hw.pf_id, vf->vf_id, vf->dev_lan_addr, test_bit(ICE_FLAG_MDD_AUTO_RESET_VF, pf->flags) ? "on" : "off"); } @@ -1894,7 +1896,7 @@ void ice_print_vfs_mdd_events(struct ice_pf *pf) if (vf->mdd_rx_events.count != vf->mdd_rx_events.last_printed) { vf->mdd_rx_events.last_printed = vf->mdd_rx_events.count; - ice_print_vf_rx_mdd_event(vf); + ice_print_vf_mdd_event(vf, true); } /* only print Tx MDD event message if there are new events */ diff --git a/drivers/net/ethernet/intel/ice/ice_sriov.h b/drivers/net/ethernet/intel/ice/ice_sriov.h index 8488df38b586..a9d3ee36d0df 100644 --- a/drivers/net/ethernet/intel/ice/ice_sriov.h +++ b/drivers/net/ethernet/intel/ice/ice_sriov.h @@ -57,7 +57,7 @@ ice_get_vf_stats(struct net_device *netdev, int vf_id, void ice_vf_lan_overflow_event(struct ice_pf *pf, struct ice_rq_event_info *event); void ice_print_vfs_mdd_events(struct ice_pf *pf); -void ice_print_vf_rx_mdd_event(struct ice_vf *vf); +void ice_print_vf_mdd_event(struct ice_vf *vf, bool is_tx); bool ice_vc_validate_pattern(struct ice_vf *vf, struct virtchnl_proto_hdrs *proto); u32 ice_sriov_get_vf_total_msix(struct pci_dev *pdev); @@ -68,7 +68,7 @@ static inline void ice_free_vfs(struct ice_pf *pf) { } static inline void ice_vf_lan_overflow_event(struct ice_pf *pf, struct ice_rq_event_info *event) { } static inline void ice_print_vfs_mdd_events(struct ice_pf *pf) { } -static inline void ice_print_vf_rx_mdd_event(struct ice_vf *vf) { } +static inline void ice_print_vf_mdd_event(struct ice_vf *vf, bool is_tx) { } static inline void ice_restore_all_vfs_msi_state(struct ice_pf *pf) { } static inline int