[v2,00/12] NFSD RDMA transport improvements

Message

Chuck Lever Feb. 4, 2024, 11:16 p.m. UTC

These were left over from the last series (for 6.8).

The idea here is to post all work needed for sending one Reply with
just a single ib_post_send() -- the Send WR and all Write WRs are
chained together.

The purpose of that is to reduce the number of doorbells and
completions per RPC, which will hopefully improve transport
scalability per NIC.

Changes since v1:
- CQ overrun crashes have been addressed

---

Chuck Lever (12):
      svcrdma: Reserve an extra WQE for ib_drain_rq()
      svcrdma: Report CQ depths in debugging output
      svcrdma: Update max_send_sges after QP is created
      svcrdma: Increase the per-transport rw_ctx count
      svcrdma: Fix SQ wake-ups
      svcrdma: Prevent a UAF in svc_rdma_send()
      svcrdma: Fix retry loop in svc_rdma_send()
      svcrdma: Post Send WR chain
      svcrdma: Move write_info for Reply chunks into struct svc_rdma_send_ctxt
      svcrdma: Post the Reply chunk and Send WR together
      svcrdma: Post WRs for Write chunks in svc_rdma_sendto()
      svcrdma: Add Write chunk WRs to the RPC's Send WR chain


 include/linux/sunrpc/svc_rdma.h            |  55 ++++-
 include/trace/events/rpcrdma.h             |   4 +
 net/sunrpc/xprtrdma/svc_rdma_backchannel.c |   2 +-
 net/sunrpc/xprtrdma/svc_rdma_rw.c          | 245 ++++++++++++++-------
 net/sunrpc/xprtrdma/svc_rdma_sendto.c      | 151 ++++++++-----
 net/sunrpc/xprtrdma/svc_rdma_transport.c   |  15 +-
 6 files changed, 320 insertions(+), 152 deletions(-)

--
Chuck Lever