| Message ID | 20110724201229.966262587@systemfabricworks.com (mailing list archive) |
|---|---|
| State | New, archived |
| Headers | show |
On Sun, Jul 24, 2011 at 9:43 PM, <rpearson@systemfabricworks.com> wrote: +config INFINIBAND_RXE + tristate "Software RDMA over Ethernet (RoCE) driver" + depends on INET && PCI && INFINIBAND + ---help--- + This driver implements the InfiniBand RDMA transport over + the Linux network stack. It enables a system with a Shouldn't that read "an Ethernet network" instead of "the Linux network stack" ? + standard Ethernet adapter to interoperate with a RoCE + adapter or with another system running the RXE driver. + Documentation on InfiniBand and RoCE can be downloaded at + www.infinibandta.org and www.openfabrics.org. (See also + siw which is a similar software driver for iWARP.) Isn't RoCE an official IBTA standard ? If so, seems like a good idea to me to mention that here. Bart. -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
> -----Original Message----- > From: linux-rdma-owner@vger.kernel.org [mailto:linux-rdma- > owner@vger.kernel.org] On Behalf Of Bart Van Assche > Sent: Friday, August 05, 2011 1:44 PM > To: rpearson@systemfabricworks.com > Cc: linux-rdma@vger.kernel.org > Subject: Re: [patch v2 37/37] add Kconfig > > On Sun, Jul 24, 2011 at 9:43 PM, <rpearson@systemfabricworks.com> wrote: > +config INFINIBAND_RXE > + tristate "Software RDMA over Ethernet (RoCE) driver" > + depends on INET && PCI && INFINIBAND > + ---help--- > + This driver implements the InfiniBand RDMA transport over > + the Linux network stack. It enables a system with a > > Shouldn't that read "an Ethernet network" instead of "the Linux network > stack" ? Technically it will run over more than just Ethernet. RXE plugs in at the same place as IP on top of the netdev core. There are some assumptions about the size of the L2 address that make it work better on Ethernet but I used to run it over the loopback device and it also runs over VLANs. > > + standard Ethernet adapter to interoperate with a RoCE > + adapter or with another system running the RXE driver. > + Documentation on InfiniBand and RoCE can be downloaded at > + www.infinibandta.org and www.openfabrics.org. (See also > + siw which is a similar software driver for iWARP.) > > Isn't RoCE an official IBTA standard ? If so, seems like a good idea > to me to mention that here. I'll do that for v3. > > Bart. > -- > To unsubscribe from this list: send the line "unsubscribe linux-rdma" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
On Fri, Aug 5, 2011 at 9:19 PM, Bob Pearson <rpearson@systemfabricworks.com> wrote: >> -----Original Message----- >> From: linux-rdma-owner@vger.kernel.org [mailto:linux-rdma- >> owner@vger.kernel.org] On Behalf Of Bart Van Assche >> Sent: Friday, August 05, 2011 1:44 PM >> To: rpearson@systemfabricworks.com >> Cc: linux-rdma@vger.kernel.org >> Subject: Re: [patch v2 37/37] add Kconfig >> >> On Sun, Jul 24, 2011 at 9:43 PM, <rpearson@systemfabricworks.com> wrote: >> +config INFINIBAND_RXE >> + tristate "Software RDMA over Ethernet (RoCE) driver" >> + depends on INET && PCI && INFINIBAND >> + ---help--- >> + This driver implements the InfiniBand RDMA transport over >> + the Linux network stack. It enables a system with a >> >> Shouldn't that read "an Ethernet network" instead of "the Linux network >> stack" ? > > Technically it will run over more than just Ethernet. RXE plugs in at the > same place as IP on top of the netdev core. > There are some assumptions about the size of the L2 address that make it > work better on Ethernet but I used to run it over the loopback device and it > also runs over VLANs. In that case I propose to change "Linux network stack" into "Linux network driver" - that's all what the rxe driver uses from the network stack, and there is more in the Linux network stack than only the network drivers. >> + standard Ethernet adapter to interoperate with a RoCE >> + adapter or with another system running the RXE driver. >> + Documentation on InfiniBand and RoCE can be downloaded at >> + www.infinibandta.org and www.openfabrics.org. (See also >> + siw which is a similar software driver for iWARP.) >> >> Isn't RoCE an official IBTA standard ? If so, seems like a good idea >> to me to mention that here. > > I'll do that for v3. Thanks. Maybe it's a good idea to mention also that while RoCE benefits from a lossless converged Ethernet network, that the protocol also works over a regular (not lossless) Ethernet network. Bart. -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
Index: infiniband/drivers/infiniband/Kconfig =================================================================== --- infiniband.orig/drivers/infiniband/Kconfig +++ infiniband/drivers/infiniband/Kconfig @@ -51,6 +51,7 @@ source "drivers/infiniband/hw/cxgb3/Kcon source "drivers/infiniband/hw/cxgb4/Kconfig" source "drivers/infiniband/hw/mlx4/Kconfig" source "drivers/infiniband/hw/nes/Kconfig" +source "drivers/infiniband/hw/rxe/Kconfig" source "drivers/infiniband/ulp/ipoib/Kconfig" Index: infiniband/drivers/infiniband/Makefile =================================================================== --- infiniband.orig/drivers/infiniband/Makefile +++ infiniband/drivers/infiniband/Makefile @@ -8,6 +8,7 @@ obj-$(CONFIG_INFINIBAND_CXGB3) += hw/cx obj-$(CONFIG_INFINIBAND_CXGB4) += hw/cxgb4/ obj-$(CONFIG_MLX4_INFINIBAND) += hw/mlx4/ obj-$(CONFIG_INFINIBAND_NES) += hw/nes/ +obj-$(CONFIG_INFINIBAND_RXE) += hw/rxe/ obj-$(CONFIG_INFINIBAND_IPOIB) += ulp/ipoib/ obj-$(CONFIG_INFINIBAND_SRP) += ulp/srp/ obj-$(CONFIG_INFINIBAND_ISER) += ulp/iser/ Index: infiniband/drivers/infiniband/hw/rxe/Kconfig =================================================================== --- /dev/null +++ infiniband/drivers/infiniband/hw/rxe/Kconfig @@ -0,0 +1,28 @@ +config INFINIBAND_RXE + tristate "Software RDMA over Ethernet (RoCE) driver" + depends on INET && PCI && INFINIBAND + ---help--- + This driver implements the InfiniBand RDMA transport over + the Linux network stack. It enables a system with a + standard Ethernet adapter to interoperate with a RoCE + adapter or with another system running the RXE driver. + Documentation on InfiniBand and RoCE can be downloaded at + www.infinibandta.org and www.openfabrics.org. (See also + siw which is a similar software driver for iWARP.) + + The driver is split into two layers, one interfaces with the + Linux RDMA stack and implements a kernel or user space + verbs API. The user space verbs API requires a support + library named librxe which is loaded by the generic user + space verbs API, libibverbs. The other layer interfaces + with the Linux network stack at layer 3. + + There are three kernel modules provided with RXE. + + ib_rxe - attaches to the Linux RDMA stack + ib_rxe_net - attaches to the Linux network stack + ib_rxe_sample - provides a simple sample network layer + driver that provides a loopback interface. + + Rxe_cfg provided with librxe is a configuration tool that + loads and unloads the ib_rxe and ib_rxe_net kernel modules
Kconfig file Signed-off-by: Bob Pearson <rpearson@systemfabricworks.com> --- drivers/infiniband/Kconfig | 1 + drivers/infiniband/Makefile | 1 + drivers/infiniband/hw/rxe/Kconfig | 28 ++++++++++++++++++++++++++++ 3 files changed, 30 insertions(+) -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html