From patchwork Wed Feb 15 07:25:56 2017 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Dan Williams X-Patchwork-Id: 9573453 X-Patchwork-Delegate: herbert@gondor.apana.org.au Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork.web.codeaurora.org (Postfix) with ESMTP id B5FC360493 for ; Wed, 15 Feb 2017 07:26:19 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id A5F7728417 for ; Wed, 15 Feb 2017 07:26:19 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id 9AAF928446; Wed, 15 Feb 2017 07:26:19 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-6.4 required=2.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID, RCVD_IN_DNSWL_HI, RCVD_IN_SORBS_SPAM autolearn=unavailable version=3.3.1 Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 9D56128417 for ; Wed, 15 Feb 2017 07:26:18 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1750711AbdBOH0A (ORCPT ); Wed, 15 Feb 2017 02:26:00 -0500 Received: from mail-oi0-f49.google.com ([209.85.218.49]:35552 "EHLO mail-oi0-f49.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1750800AbdBOHZ6 (ORCPT ); Wed, 15 Feb 2017 02:25:58 -0500 Received: by mail-oi0-f49.google.com with SMTP id j15so82725196oih.2 for ; Tue, 14 Feb 2017 23:25:57 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=intel-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=MntUGXDLJGg3v2M5AiyPPZxLehddhgykYF6frf/tEfs=; b=M68uagliqox1DBZ0RQFr45MDr2IupqO52LxI1TKFbYoOz49v3juB6l+z4Y/hTqa7xL 44vGLkIT0aBj3Ig40nnZg4OLib6x3nuibl7e2eOGRy3B4Oa4pOADsltyOrARqyqKJXMa WAm2kAVMRIdpPSn2/9W3VjM9Ee5+b2VoGOwoI0bxgokocmFcbQZN/IdRVhgF+vkDQxwU zE0FSgKsl9YUPJkjRoBwZDWB80y6JkSC87atq1cYelgxLDVx1qSkH5OiQuXlB2juPRy6 gtKahQSSpmk/aNqGOKtHt2LIwwEPDswgW9lUQXV7vhkl4CYri4c3kawkIOpTlWtAhHYW OiTw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=MntUGXDLJGg3v2M5AiyPPZxLehddhgykYF6frf/tEfs=; b=WwQVrBMwbgqsRnHetfGS+slzWrcRWDu46nOY1+jOFYS9A0l6mXlfT60Qu+832nepGz c881sJJhvP+8aR14Oihxn0lYGLsR1nmn50X8HTy/+ebUfh2dri+sFe+BS9rl+3foA+Zd vkcEoG+ZAh1dDdlZ1qUwnH6klnQXddDUn3jQLPfCUj35fx3PQ85I3muuXj4/nWweCuEc JHdho4kij4t2eMoNXeNZNiQejKjepAAFW+S6u6fenbzIdp4xMM51/y+Qh6Q71lOtWtEG WJbQlU160i85IAgfEtXNAwetCKzFsAnLxNGkkEbBg/2gqpIo3CEFz4ljC0gkIVMFY5Lx 0ggA== X-Gm-Message-State: AMke39nD49q98kMv6+iveRVPVmJMDLqOGTUo9HwX1XZ/5fEBKh76/F5CEtGhV6o9H0wiOr5GaYGxWyGqGM8B0XcH X-Received: by 10.202.222.84 with SMTP id v81mr19099619oig.194.1487143557126; Tue, 14 Feb 2017 23:25:57 -0800 (PST) MIME-Version: 1.0 Received: by 10.157.27.228 with HTTP; Tue, 14 Feb 2017 23:25:56 -0800 (PST) In-Reply-To: References: <1487055112-5185-1-git-send-email-anup.patel@broadcom.com> <1487055112-5185-4-git-send-email-anup.patel@broadcom.com> From: Dan Williams Date: Tue, 14 Feb 2017 23:25:56 -0800 Message-ID: Subject: Re: [PATCH v4 3/4] dmaengine: Add Broadcom SBA RAID driver To: Anup Patel Cc: Vinod Koul , Rob Herring , Mark Rutland , Herbert Xu , "David S . Miller" , Jassi Brar , Ray Jui , Scott Branden , Jon Mason , Rob Rice , BCM Kernel Feedback , "dmaengine@vger.kernel.org" , Device Tree , "linux-arm-kernel@lists.infradead.org" , "linux-kernel@vger.kernel.org" , linux-crypto@vger.kernel.org, linux-raid Sender: linux-crypto-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-crypto@vger.kernel.org X-Virus-Scanned: ClamAV using ClamSMTP On Tue, Feb 14, 2017 at 11:03 PM, Anup Patel wrote: > On Wed, Feb 15, 2017 at 12:13 PM, Dan Williams wrote: >> On Tue, Feb 14, 2017 at 10:25 PM, Anup Patel wrote: >>> On Tue, Feb 14, 2017 at 10:04 PM, Dan Williams wrote: >>>> On Mon, Feb 13, 2017 at 10:51 PM, Anup Patel wrote: >>>>> The Broadcom stream buffer accelerator (SBA) provides offloading >>>>> capabilities for RAID operations. This SBA offload engine is >>>>> accessible via Broadcom SoC specific ring manager. >>>>> >>>>> This patch adds Broadcom SBA RAID driver which provides one >>>>> DMA device with RAID capabilities using one or more Broadcom >>>>> SoC specific ring manager channels. The SBA RAID driver in its >>>>> current shape implements memcpy, xor, and pq operations. >>>>> >>>>> Signed-off-by: Anup Patel >>>>> Reviewed-by: Ray Jui >>>>> --- >>>>> drivers/dma/Kconfig | 13 + >>>>> drivers/dma/Makefile | 1 + >>>>> drivers/dma/bcm-sba-raid.c | 1694 ++++++++++++++++++++++++++++++++++++++++++++ >>>>> 3 files changed, 1708 insertions(+) >>>>> create mode 100644 drivers/dma/bcm-sba-raid.c >>>>> >>>>> diff --git a/drivers/dma/Kconfig b/drivers/dma/Kconfig >>>>> index 263495d..bf8fb84 100644 >>>>> --- a/drivers/dma/Kconfig >>>>> +++ b/drivers/dma/Kconfig >>>>> @@ -99,6 +99,19 @@ config AXI_DMAC >>>>> controller is often used in Analog Device's reference designs for FPGA >>>>> platforms. >>>>> >>>>> +config BCM_SBA_RAID >>>>> + tristate "Broadcom SBA RAID engine support" >>>>> + depends on (ARM64 && MAILBOX && RAID6_PQ) || COMPILE_TEST >>>>> + select DMA_ENGINE >>>>> + select DMA_ENGINE_RAID >>>>> + select ASYNC_TX_ENABLE_CHANNEL_SWITCH >>>> >>>> I thought you agreed to drop this. Its usage is broken. >>> >>> If ASYNC_TX_ENABLE_CHANNEL_SWITCH is not selected >>> then async_dma_find_channel() will only try to find channel >>> with DMA_ASYNC_TX capability. >>> >>> The DMA_ASYNC_TX capability is set by >>> dma_async_device_register() when all Async Tx >>> capabilities are supported by a DMA devices namely >>> DMA_INTERRUPT, DMA_MEMCPY, DMA_XOR, >>> DMA_XOR_VAL, DMA_PQ, and DMA_PQ_VAL. >>> >>> We only support DMA_MEMCPY, DMA_XOR, and >>> DMA_PQ capabilities in BCM-SBA-RAID driver so >>> DMA_ASYNC_TX capability is never set for the >>> DMA device registered by BCM-SBA-RAID driver. >>> >>> Due to above, if ASYNC_TX_ENABLE_CHANNEL_SWITCH >>> is not selected then Async Tx APIs fail to find DMA >>> channel provided by BCM-SBA-RAID hence the >>> option ASYNC_TX_ENABLE_CHANNEL_SWITCH is >>> required for BCM-SBA-RAID. >>> >>> The DMA mappings are violated by channel switching >>> only if we switch form DMA channel A to DMA channel >>> B and both these DMA channels have different underlying >>> "struct device". In most of the cases DMA mappings >>> are not violated because DMA channels having >>> Async Tx capabilities are provided using same >>> underlying "struct device". >> >> No, fix the infrastructure. Do not put local hack in your driver for >> this global problem [1]. > > There is no hack in the driver. We need > ASYNC_TX_ENABLE_CHANNEL_SWITCH > based on current state of dmaengine framework. > > The framework should be fixed as separate patchset. > > We have other RAID drivers such as xgene-dma and > mv_xor_v2 who also require > ASYNC_TX_ENABLE_CHANNEL_SWITCH due > to same reason. > > Fixing the framework and improving framework is > a ongoing process. I don't see why that should > stop this patchset. > Because this driver is turning on a dangerous compile time option and is not using the functionality. If this silicon IP block appears in another product in the future paired with another DMA engine then the assumptions about a safe/single dma-device is violated. The realization of how async_tx was breaking DMA mapping api assumptions came after some of these dma-drivers were added to the kernel. We should stop making the problem worse. I should have submitted a patch like the below at the time we discovered this problem, but unfortunately it languished when I stopped maintaining the iop-adma and ioat drivers. diff --git a/drivers/dma/Kconfig b/drivers/dma/Kconfig index 263495d0adbd..6b30eb9ad125 100644 --- a/drivers/dma/Kconfig +++ b/drivers/dma/Kconfig @@ -35,6 +35,7 @@ comment "DMA Devices" #core config ASYNC_TX_ENABLE_CHANNEL_SWITCH + depends on BROKEN bool config ARCH_HAS_ASYNC_TX_FIND_CHANNEL