| Message ID | 20220407131403.26040-3-liangwenpeng@huawei.com (mailing list archive) |
|---|---|
| State | Changes Requested |
| Delegated to: | Jason Gunthorpe |
| Headers | show |
| Series | RDMA/hns: Add NOP operation for sending WR | expand |
On Thu, Apr 07, 2022 at 09:14:03PM +0800, Wenpeng Liang wrote: > From: Yangyang Li <liyangyang20@huawei.com> > > The NOP operation is a no-op, mainly used in scenarios where SQWQE requires > page alignment or WQE size alignment. Each NOP WR consumes one SQWQE, but > the hardware does not operate and directly generates a CQE. The IB > specification does not specify this type of WR. > > Signed-off-by: Yangyang Li <liyangyang20@huawei.com> > Signed-off-by: Wenpeng Liang <liangwenpeng@huawei.com> > --- > drivers/infiniband/hw/hns/hns_roce_hw_v2.c | 9 +++++++++ > drivers/infiniband/hw/hns/hns_roce_hw_v2.h | 9 +++++++++ > 2 files changed, 18 insertions(+) Where is it used? Jason
On 2022/4/7 21:20, Jason Gunthorpe wrote: > On Thu, Apr 07, 2022 at 09:14:03PM +0800, Wenpeng Liang wrote: >> From: Yangyang Li <liyangyang20@huawei.com> >> >> The NOP operation is a no-op, mainly used in scenarios where SQWQE requires >> page alignment or WQE size alignment. Each NOP WR consumes one SQWQE, but >> the hardware does not operate and directly generates a CQE. The IB >> specification does not specify this type of WR. >> >> Signed-off-by: Yangyang Li <liyangyang20@huawei.com> >> Signed-off-by: Wenpeng Liang <liangwenpeng@huawei.com> >> --- >> drivers/infiniband/hw/hns/hns_roce_hw_v2.c | 9 +++++++++ >> drivers/infiniband/hw/hns/hns_roce_hw_v2.h | 9 +++++++++ >> 2 files changed, 18 insertions(+) > > Where is it used? > This function has a precondition. The driver needs to provide two interfaces to the user, one interface is used to fill the wqe, and the other is used to ring the doorbell. If the content of the wqe is repeated, then the user does not need to fill this wqe again but directly rings the doorbell. If the user's wqe used to complete the specified work request does not fill the send queue, then the user can fill the remaining wqe in the send queue as a NOP operation. This feature requires some cooperating code and does not meet the upstream conditions. Therefore, I will revoke this patch. Thanks, Wenpeng > Jason > . >
diff --git a/drivers/infiniband/hw/hns/hns_roce_hw_v2.c b/drivers/infiniband/hw/hns/hns_roce_hw_v2.c index cf5455cda9c4..0494e3330be0 100644 --- a/drivers/infiniband/hw/hns/hns_roce_hw_v2.c +++ b/drivers/infiniband/hw/hns/hns_roce_hw_v2.c @@ -73,6 +73,9 @@ static inline void set_data_seg_v2(struct hns_roce_v2_wqe_data_seg *dseg, #define HR_IB_OPC_MAP(ib_key, hr_key) \ [IB_WR_ ## ib_key] = 1 + HNS_ROCE_V2_WQE_OP_ ## hr_key +#define HR_PRIV_OPC_MAP(hr_key) \ + [HNS_ROCE_WR_ ## hr_key] = 1 + HNS_ROCE_V2_WQE_OP_ ## hr_key + static const u32 hns_roce_op_code[] = { HR_IB_OPC_MAP(RDMA_WRITE, RDMA_WRITE), HR_IB_OPC_MAP(RDMA_WRITE_WITH_IMM, RDMA_WRITE_WITH_IMM), @@ -86,6 +89,7 @@ static const u32 hns_roce_op_code[] = { HR_IB_OPC_MAP(MASKED_ATOMIC_CMP_AND_SWP, ATOM_MSK_CMP_AND_SWAP), HR_IB_OPC_MAP(MASKED_ATOMIC_FETCH_AND_ADD, ATOM_MSK_FETCH_AND_ADD), HR_IB_OPC_MAP(REG_MR, FAST_REG_PMR), + HR_PRIV_OPC_MAP(NOP), }; static u32 to_hr_opcode(u32 ib_opcode) @@ -540,6 +544,7 @@ static int set_rc_opcode(struct hns_roce_dev *hr_dev, break; case IB_WR_SEND: case IB_WR_SEND_WITH_IMM: + case HNS_ROCE_WR_NOP: break; case IB_WR_ATOMIC_CMP_AND_SWP: case IB_WR_ATOMIC_FETCH_AND_ADD: @@ -3852,6 +3857,9 @@ static int get_cur_qp(struct hns_roce_cq *hr_cq, struct hns_roce_v2_cqe *cqe, #define HR_IB_WC_OP_MAP(hr_key, ib_key) \ [HNS_ROCE_V2_WQE_OP_ ## hr_key] = 1 + IB_WC_ ## ib_key +#define HR_PRIV_WC_OP_MAP(hr_key) \ + [HNS_ROCE_V2_WQE_OP_ ## hr_key] = 1 + HNS_ROCE_WC_ ## hr_key + static const u32 wc_send_op_map[] = { HR_IB_WC_OP_MAP(SEND, SEND), HR_IB_WC_OP_MAP(SEND_WITH_INV, SEND), @@ -3866,6 +3874,7 @@ static const u32 wc_send_op_map[] = { HR_IB_WC_OP_MAP(ATOM_MSK_FETCH_AND_ADD, MASKED_FETCH_ADD), HR_IB_WC_OP_MAP(FAST_REG_PMR, REG_MR), HR_IB_WC_OP_MAP(BIND_MW, REG_MR), + HR_PRIV_WC_OP_MAP(NOP), }; static int to_ib_wc_send_op(u32 hr_opcode) diff --git a/drivers/infiniband/hw/hns/hns_roce_hw_v2.h b/drivers/infiniband/hw/hns/hns_roce_hw_v2.h index 0d87b627601e..9e7f7148a9ad 100644 --- a/drivers/infiniband/hw/hns/hns_roce_hw_v2.h +++ b/drivers/infiniband/hw/hns/hns_roce_hw_v2.h @@ -170,6 +170,14 @@ enum { #define GID_LEN_V2 16 +enum { + HNS_ROCE_WR_NOP = IB_WR_RESERVED4, +}; + +enum { + HNS_ROCE_WC_NOP = HNS_ROCE_WR_NOP, +}; + enum { HNS_ROCE_V2_WQE_OP_SEND = 0x0, HNS_ROCE_V2_WQE_OP_SEND_WITH_INV = 0x1, @@ -184,6 +192,7 @@ enum { HNS_ROCE_V2_WQE_OP_FAST_REG_PMR = 0xa, HNS_ROCE_V2_WQE_OP_LOCAL_INV = 0xb, HNS_ROCE_V2_WQE_OP_BIND_MW = 0xc, + HNS_ROCE_V2_WQE_OP_NOP = 0x13, HNS_ROCE_V2_WQE_OP_MASK = 0x1f, };