From patchwork Fri Nov 20 19:15:03 2009 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Jim Schutt X-Patchwork-Id: 61720 Received: from vger.kernel.org (vger.kernel.org [209.132.176.167]) by demeter.kernel.org (8.14.2/8.14.2) with ESMTP id nAKJWmv6031252 for ; Fri, 20 Nov 2009 19:32:49 GMT Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1753443AbZKTTcm (ORCPT ); Fri, 20 Nov 2009 14:32:42 -0500 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1753045AbZKTTcm (ORCPT ); Fri, 20 Nov 2009 14:32:42 -0500 Received: from sentry-three.sandia.gov ([132.175.109.17]:54462 "EHLO sentry-three.sandia.gov" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1753443AbZKTTck (ORCPT ); Fri, 20 Nov 2009 14:32:40 -0500 X-WSS-ID: 0KTF9HP-08-QV3-02 X-M-MSG: Received: from sentry.sandia.gov (sentry.sandia.gov [132.175.109.20]) by sentry-three.sandia.gov (Tumbleweed MailGate 3.6.1) with ESMTP id 2DD098FECB5; Fri, 20 Nov 2009 12:15:24 -0700 (MST) Received: from [132.175.109.1] by sentry.sandia.gov with ESMTP (SMTP Relay 01 (Email Firewall v6.3.2)); Fri, 20 Nov 2009 12:15:13 -0700 X-Server-Uuid: 6BFC7783-7E22-49B4-B610-66D6BE496C0E Received: from localhost.localdomain (sale659.sandia.gov [134.253.4.20]) by mailgate.sandia.gov (8.14.1/8.14.1) with ESMTP id nAKJF9tM028412; Fri, 20 Nov 2009 12:15:12 -0700 From: "Jim Schutt" To: linux-rdma@vger.kernel.org cc: sashak@voltaire.com, eitan@mellanox.co.il, jaschut@sandia.gov Subject: [PATCH 04/11] opensm: Track the minimum value in the fabric of data VLs supported. Date: Fri, 20 Nov 2009 12:15:03 -0700 Message-ID: <1258744509-11148-5-git-send-email-jaschut@sandia.gov> X-Mailer: git-send-email 1.5.6.GIT In-Reply-To: <1258744509-11148-1-git-send-email-jaschut@sandia.gov> References: <1258744509-11148-1-git-send-email-jaschut@sandia.gov> X-PMX-Version: 5.5.7.378829, Antispam-Engine: 2.7.2.376379, Antispam-Data: 2009.11.20.190049 X-PerlMx-Spam: Gauge=IIIIIIII, Probability=8%, Report=' BODY_SIZE_3000_3999 0, BODY_SIZE_5000_LESS 0, BODY_SIZE_7000_LESS 0, TO_NO_NAME 0, __HAS_MSGID 0, __HAS_X_MAILER 0, __MIME_TEXT_ONLY 0, __SANE_MSGID 0, __TO_MALFORMED_2 0, __URI_NS ' X-TMWD-Spam-Summary: TS=20091120191514; ID=1; SEV=2.3.1; DFV=B2009112016; IFV=NA; AIF=B2009112016; RPD=5.03.0010; ENG=NA; RPDID=7374723D303030312E30413031303230312E34423036454143322E303038303A534346535441543838363133332C73733D312C6667733D30; CAT=NONE; CON=NONE; SIG=AAAAAAAAAAAAAAAAAAAAAAAAfQ== X-MMS-Spam-Filter-ID: B2009112016_5.03.0010 MIME-Version: 1.0 X-WSS-ID: 6718354B4EG2204794-01-01 Sender: linux-rdma-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-rdma@vger.kernel.org diff --git a/opensm/include/opensm/osm_subnet.h b/opensm/include/opensm/osm_subnet.h index 0302f91..c303e86 100644 --- a/opensm/include/opensm/osm_subnet.h +++ b/opensm/include/opensm/osm_subnet.h @@ -509,6 +509,7 @@ typedef struct osm_subn { uint16_t max_mcast_lid_ho; uint8_t min_ca_mtu; uint8_t min_ca_rate; + uint8_t min_data_vls; boolean_t ignore_existing_lfts; boolean_t subnet_initialization_error; boolean_t force_heavy_sweep; diff --git a/opensm/opensm/osm_port_info_rcv.c b/opensm/opensm/osm_port_info_rcv.c index 8a99064..b0d54c8 100644 --- a/opensm/opensm/osm_port_info_rcv.c +++ b/opensm/opensm/osm_port_info_rcv.c @@ -82,6 +82,7 @@ static void pi_rcv_process_endport(IN osm_sm_t * sm, IN osm_physp_t * p_physp, ib_api_status_t status; ib_net64_t port_guid; uint8_t rate, mtu; + unsigned data_vls; cl_qmap_t *p_sm_tbl; osm_remote_sm_t *p_sm; @@ -91,7 +92,7 @@ static void pi_rcv_process_endport(IN osm_sm_t * sm, IN osm_physp_t * p_physp, /* HACK extended port 0 should be handled too! */ if (osm_physp_get_port_num(p_physp) != 0) { - /* track the minimal endport MTU and rate */ + /* track the minimal endport MTU, rate, and operational VLs */ mtu = ib_port_info_get_mtu_cap(p_pi); if (mtu < sm->p_subn->min_ca_mtu) { OSM_LOG(sm->p_log, OSM_LOG_VERBOSE, @@ -107,6 +108,16 @@ static void pi_rcv_process_endport(IN osm_sm_t * sm, IN osm_physp_t * p_physp, PRIx64 "\n", rate, cl_ntoh64(port_guid)); sm->p_subn->min_ca_rate = rate; } + + data_vls = 1U << (ib_port_info_get_op_vls(p_pi) - 1); + if (data_vls >= IB_MAX_NUM_VLS) + data_vls = IB_MAX_NUM_VLS - 1; + if ((uint8_t)data_vls < sm->p_subn->min_data_vls) { + OSM_LOG(sm->p_log, OSM_LOG_VERBOSE, + "Setting endport minimal data VLs to:%u defined by port:0x%" + PRIx64 "\n", data_vls, cl_ntoh64(port_guid)); + sm->p_subn->min_data_vls = data_vls; + } } if (port_guid != sm->p_subn->sm_port_guid) { diff --git a/opensm/opensm/osm_state_mgr.c b/opensm/opensm/osm_state_mgr.c index c3f49dc..b6c41a6 100644 --- a/opensm/opensm/osm_state_mgr.c +++ b/opensm/opensm/osm_state_mgr.c @@ -1132,6 +1132,12 @@ repeat_discovery: sm->p_subn->force_reroute = FALSE; sm->p_subn->subnet_initialization_error = FALSE; + /* Reset tracking values in case limiting component got removed + * from fabric. */ + sm->p_subn->min_ca_mtu = IB_MAX_MTU; + sm->p_subn->min_ca_rate = IB_MAX_RATE; + sm->p_subn->min_data_vls = IB_MAX_NUM_VLS - 1; + /* rescan configuration updates */ if (!config_parsed && osm_subn_rescan_conf_files(sm->p_subn) < 0) OSM_LOG(sm->p_log, OSM_LOG_ERROR, "ERR 331A: " diff --git a/opensm/opensm/osm_subnet.c b/opensm/opensm/osm_subnet.c index 2cfcbe6..19ba730 100644 --- a/opensm/opensm/osm_subnet.c +++ b/opensm/opensm/osm_subnet.c @@ -526,6 +526,7 @@ ib_api_status_t osm_subn_init(IN osm_subn_t * p_subn, IN osm_opensm_t * p_osm, p_subn->max_mcast_lid_ho = IB_LID_MCAST_END_HO; p_subn->min_ca_mtu = IB_MAX_MTU; p_subn->min_ca_rate = IB_MAX_RATE; + p_subn->min_data_vls = IB_MAX_NUM_VLS - 1; p_subn->ignore_existing_lfts = TRUE; /* we assume master by default - so we only need to set it true if STANDBY */