From patchwork Tue Jan 16 13:25:39 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Jeffy Chen X-Patchwork-Id: 10167029 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork.web.codeaurora.org (Postfix) with ESMTP id 6556560325 for ; Tue, 16 Jan 2018 13:45:20 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 5601E26785 for ; Tue, 16 Jan 2018 13:45:20 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id 4A9F02853A; Tue, 16 Jan 2018 13:45:20 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-4.2 required=2.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,RCVD_IN_DNSWL_MED autolearn=unavailable version=3.3.1 Received: from bombadil.infradead.org (bombadil.infradead.org [65.50.211.133]) (using TLSv1.2 with cipher AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.wl.linuxfoundation.org (Postfix) with ESMTPS id 933B726785 for ; Tue, 16 Jan 2018 13:45:19 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20170209; h=Sender: Content-Transfer-Encoding:Content-Type:MIME-Version:Cc:List-Subscribe: List-Help:List-Post:List-Archive:List-Unsubscribe:List-Id:References: In-Reply-To:Message-Id:Date:Subject:To:From:Reply-To:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Owner; bh=gkwueFzseC8uZ5cXj3ustVKDc7OPnl7zgeLstIFmpjo=; b=Rp3jEncwUqPQIw/0CfsVSzxNt/ NWvXeZb6Mk22C1YAR4UdN3zd5VzVzeaMtt3yH8KP1vZgLdTwfbX+nCNY1wRiFHsVWgrApyvDz8A9B XDegUu7QG0GKtdYXt1cl/zMewf5ERzSdaR+GWNAF+BH9EYjIW/n1Chi05nJP/TWu6Nkf4PSuKug2i aXvq0xVGMw+OLq5R22IzmOcPkMuuapANEDibf8v7VavQFbmh0VwEo11w4Nt0X9evaMPMmXW7qfH9v 2ZtJd4NfuHSDj7Xczbf2f1cqtH6Zh7aX62ZT8HGFYSe/FlKWM5BAO6oH9TwnG3RTrkI+OL/pmkrtF 4bCgZBFg==; Received: from localhost ([127.0.0.1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.89 #1 (Red Hat Linux)) id 1ebRYD-00023g-G3; Tue, 16 Jan 2018 13:45:17 +0000 Received: from merlin.infradead.org ([2001:8b0:10b:1231::1]) by bombadil.infradead.org with esmtps (Exim 4.89 #1 (Red Hat Linux)) id 1ebRXW-0000oC-Nh; Tue, 16 Jan 2018 13:44:34 +0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=merlin.20170209; h=References:In-Reply-To:Message-Id:Date: Subject:Cc:To:From:Sender:Reply-To:MIME-Version:Content-Type: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id: List-Help:List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=R85USlE0TlctQfRTjlPqvqIA1Jntq34htmb3JE8SwPU=; b=3aK+LTSk5s25NMUNYbft7KYP1 p3+yS6QuyhV4kIivbxEYimXhyDCA36SNcVREvZiX9t5vysHTAUnc5c9+nfAGacv5SsQq9CZfpE5EH C9qmjeDCv6MGOLwBra5NEgisd4w0aUHbuou8Sh+rrehiWlUj1lJkq5gRVzBHdgvJUm1NILc90UtT8 19HUCRS8KJkD318NFl8YqapQYnCy61WBUuaSa9GroxBRiEZ2apiZtSuZmSsyukbG1Jjd6elX4liht ZhVUOHP+VIH2Mvs+/KRiK+A5C0OrKDnixe1QBob/8woI4ETKiG7DHYglnpljxYcyZxFvsx0PCZYUz vhGsygs+w==; Received: from regular1.263xmail.com ([211.150.99.138]) by merlin.infradead.org with esmtps (Exim 4.89 #1 (Red Hat Linux)) id 1ebRHF-0000fI-Ms; Tue, 16 Jan 2018 13:27:47 +0000 Received: from jeffy.chen?rock-chips.com (unknown [192.168.167.190]) by regular1.263xmail.com (Postfix) with ESMTP id 6DB037921; Tue, 16 Jan 2018 21:27:28 +0800 (CST) X-263anti-spam: KSV:0; X-MAIL-GRAY: 0 X-MAIL-DELIVERY: 1 X-KSVirus-check: 0 X-ABS-CHECKED: 4 Received: from localhost (localhost [127.0.0.1]) by smtp.263.net (Postfix) with ESMTPA id 0605D3C0; Tue, 16 Jan 2018 21:27:24 +0800 (CST) X-RL-SENDER: jeffy.chen@rock-chips.com X-FST-TO: linux-kernel@vger.kernel.org X-SENDER-IP: 103.29.142.67 X-LOGIN-NAME: jeffy.chen@rock-chips.com X-UNIQUE-TAG: <0dca3cf4280e68d625cd01cd52787668> X-ATTACHMENT-NUM: 0 X-SENDER: cjf@rock-chips.com X-DNS-TYPE: 0 Received: from localhost (unknown [103.29.142.67]) by smtp.263.net (Postfix) whith ESMTP id 19797RAVEYI; Tue, 16 Jan 2018 21:27:30 +0800 (CST) From: Jeffy Chen To: linux-kernel@vger.kernel.org Subject: [PATCH v2 12/13] iommu/rockchip: Add runtime PM support Date: Tue, 16 Jan 2018 21:25:39 +0800 Message-Id: <20180116132540.18939-13-jeffy.chen@rock-chips.com> X-Mailer: git-send-email 2.11.0 In-Reply-To: <20180116132540.18939-1-jeffy.chen@rock-chips.com> References: <20180116132540.18939-1-jeffy.chen@rock-chips.com> X-BeenThere: linux-rockchip@lists.infradead.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Upstream kernel work for Rockchip platforms List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: xxm@rock-chips.com, Joerg Roedel , Jeffy Chen , tfiga@chromium.org, jcliang@chromium.org, linux-rockchip@lists.infradead.org, iommu@lists.linux-foundation.org, robin.murphy@arm.com, linux-arm-kernel@lists.infradead.org, Heiko Stuebner MIME-Version: 1.0 Sender: "Linux-rockchip" Errors-To: linux-rockchip-bounces+patchwork-linux-rockchip=patchwork.kernel.org@lists.infradead.org X-Virus-Scanned: ClamAV using ClamSMTP When the power domain is powered off, the IOMMU cannot be accessed and register programming must be deferred until the power domain becomes enabled. Add runtime PM support, and use runtime PM device link from IOMMU to master to startup and shutdown IOMMU. Signed-off-by: Jeffy Chen --- Changes in v2: None drivers/iommu/rockchip-iommu.c | 191 ++++++++++++++++++++++++++++++----------- 1 file changed, 143 insertions(+), 48 deletions(-) diff --git a/drivers/iommu/rockchip-iommu.c b/drivers/iommu/rockchip-iommu.c index c2d3ac82184e..c8de1456a016 100644 --- a/drivers/iommu/rockchip-iommu.c +++ b/drivers/iommu/rockchip-iommu.c @@ -18,11 +18,13 @@ #include #include #include +#include #include #include #include #include #include +#include #include #include @@ -98,6 +100,12 @@ struct rk_iommu { struct iommu_device iommu; struct list_head node; /* entry in rk_iommu_domain.iommus */ struct iommu_domain *domain; /* domain to which iommu is attached */ + struct mutex pm_mutex; /* serializes power transitions */ +}; + +struct rk_iommudata { + struct device_link *link; /* runtime PM link from IOMMU to master */ + struct rk_iommu *iommu; }; static struct device *dma_dev; @@ -675,9 +683,15 @@ static void rk_iommu_zap_iova(struct rk_iommu_domain *rk_domain, list_for_each(pos, &rk_domain->iommus) { struct rk_iommu *iommu; iommu = list_entry(pos, struct rk_iommu, node); - rk_iommu_enable_clocks(iommu); - rk_iommu_zap_lines(iommu, iova, size); - rk_iommu_disable_clocks(iommu); + + /* Only zap TLBs of IOMMUs that are powered on. */ + if (pm_runtime_get_if_in_use(iommu->dev) > 0) { + rk_iommu_enable_clocks(iommu); + rk_iommu_zap_lines(iommu, iova, size); + rk_iommu_disable_clocks(iommu); + + pm_runtime_put(iommu->dev); + } } spin_unlock_irqrestore(&rk_domain->iommus_lock, flags); } @@ -875,28 +889,19 @@ static size_t rk_iommu_unmap(struct iommu_domain *domain, unsigned long _iova, static struct rk_iommu *rk_iommu_from_dev(struct device *dev) { - return dev->archdata.iommu; + struct rk_iommudata *data = dev->archdata.iommu; + + return data ? data->iommu : NULL; } -static void rk_iommu_detach_device(struct iommu_domain *domain, - struct device *dev) +static void rk_iommu_shutdown(struct rk_iommu *iommu) { - struct rk_iommu *iommu; - struct rk_iommu_domain *rk_domain = to_rk_domain(domain); - unsigned long flags; int i; - /* Allow 'virtual devices' (eg drm) to detach from domain */ - iommu = rk_iommu_from_dev(dev); - if (!iommu) - return; - - spin_lock_irqsave(&rk_domain->iommus_lock, flags); - list_del_init(&iommu->node); - spin_unlock_irqrestore(&rk_domain->iommus_lock, flags); - /* Ignore error while disabling, just keep going */ WARN_ON(rk_iommu_enable_clocks(iommu)); + + mutex_lock(&iommu->pm_mutex); rk_iommu_enable_stall(iommu); rk_iommu_disable_paging(iommu); for (i = 0; i < iommu->num_mmu; i++) { @@ -904,46 +909,30 @@ static void rk_iommu_detach_device(struct iommu_domain *domain, rk_iommu_write(iommu->bases[i], RK_MMU_DTE_ADDR, 0); } rk_iommu_disable_stall(iommu); - rk_iommu_disable_clocks(iommu); + mutex_unlock(&iommu->pm_mutex); - iommu->domain = NULL; - - dev_dbg(dev, "Detached from iommu domain\n"); + rk_iommu_disable_clocks(iommu); } -static int rk_iommu_attach_device(struct iommu_domain *domain, - struct device *dev) +static int rk_iommu_startup(struct rk_iommu *iommu) { - struct rk_iommu *iommu; + struct iommu_domain *domain = iommu->domain; struct rk_iommu_domain *rk_domain = to_rk_domain(domain); - unsigned long flags; int ret, i; - /* - * Allow 'virtual devices' (e.g., drm) to attach to domain. - * Such a device does not belong to an iommu group. - */ - iommu = rk_iommu_from_dev(dev); - if (!iommu) - return 0; - - if (iommu->domain) - rk_iommu_detach_device(iommu->domain, dev); - ret = rk_iommu_enable_clocks(iommu); if (ret) return ret; + mutex_lock(&iommu->pm_mutex); ret = rk_iommu_enable_stall(iommu); if (ret) - goto err_disable_clocks; + goto err_unlock_mutex; ret = rk_iommu_force_reset(iommu); if (ret) goto err_disable_stall; - iommu->domain = domain; - for (i = 0; i < iommu->num_mmu; i++) { rk_iommu_write(iommu->bases[i], RK_MMU_DTE_ADDR, rk_domain->dt_dma); @@ -955,21 +944,90 @@ static int rk_iommu_attach_device(struct iommu_domain *domain, if (ret) goto err_disable_stall; - spin_lock_irqsave(&rk_domain->iommus_lock, flags); - list_add_tail(&iommu->node, &rk_domain->iommus); - spin_unlock_irqrestore(&rk_domain->iommus_lock, flags); - - dev_dbg(dev, "Attached to iommu domain\n"); - rk_iommu_disable_stall(iommu); + mutex_unlock(&iommu->pm_mutex); + rk_iommu_disable_clocks(iommu); return 0; err_disable_stall: rk_iommu_disable_stall(iommu); -err_disable_clocks: +err_unlock_mutex: + mutex_unlock(&iommu->pm_mutex); rk_iommu_disable_clocks(iommu); + return ret; +} + +static void rk_iommu_detach_device(struct iommu_domain *domain, + struct device *dev) +{ + struct rk_iommu *iommu; + struct rk_iommu_domain *rk_domain = to_rk_domain(domain); + unsigned long flags; + + /* Allow 'virtual devices' (eg drm) to detach from domain */ + iommu = rk_iommu_from_dev(dev); + if (!iommu) + return; + + dev_dbg(dev, "Detaching from iommu domain\n"); + + /* iommu already detached */ + if (iommu->domain != domain) + return; + + iommu->domain = NULL; + + spin_lock_irqsave(&rk_domain->iommus_lock, flags); + list_del_init(&iommu->node); + spin_unlock_irqrestore(&rk_domain->iommus_lock, flags); + + if (pm_runtime_get_if_in_use(iommu->dev) > 0) { + rk_iommu_shutdown(iommu); + pm_runtime_put(iommu->dev); + } +} + +static int rk_iommu_attach_device(struct iommu_domain *domain, + struct device *dev) +{ + struct rk_iommu *iommu; + struct rk_iommu_domain *rk_domain = to_rk_domain(domain); + unsigned long flags; + int ret; + + /* + * Allow 'virtual devices' (e.g., drm) to attach to domain. + * Such a device does not belong to an iommu group. + */ + iommu = rk_iommu_from_dev(dev); + if (!iommu) + return 0; + + dev_dbg(dev, "Attaching to iommu domain\n"); + + /* iommu already attached */ + if (iommu->domain == domain) + return 0; + + if (iommu->domain) + rk_iommu_detach_device(iommu->domain, dev); + + iommu->domain = domain; + + spin_lock_irqsave(&rk_domain->iommus_lock, flags); + list_add_tail(&iommu->node, &rk_domain->iommus); + spin_unlock_irqrestore(&rk_domain->iommus_lock, flags); + + if (pm_runtime_get_if_in_use(iommu->dev) <= 0) + return 0; + + ret = rk_iommu_startup(iommu); + if (ret) + rk_iommu_detach_device(data->domain, dev); + + pm_runtime_put(iommu->dev); return ret; } @@ -1059,6 +1117,7 @@ static int rk_iommu_add_device(struct device *dev) { struct iommu_group *group; struct rk_iommu *iommu; + struct rk_iommudata *data = dev->archdata.iommu; iommu = rk_iommu_from_dev(dev); if (!iommu) @@ -1070,6 +1129,7 @@ static int rk_iommu_add_device(struct device *dev) iommu_group_put(group); iommu_device_link(&iommu->iommu, dev); + data->link = device_link_add(dev, iommu->dev, DL_FLAG_PM_RUNTIME); return 0; } @@ -1077,11 +1137,13 @@ static int rk_iommu_add_device(struct device *dev) static void rk_iommu_remove_device(struct device *dev) { struct rk_iommu *iommu; + struct rk_iommudata *data = dev->archdata.iommu; iommu = rk_iommu_from_dev(dev); if (!iommu) return; + device_link_del(data->link); iommu_device_unlink(&iommu->iommu, dev); iommu_group_remove_device(dev); } @@ -1101,6 +1163,11 @@ static int rk_iommu_of_xlate(struct device *dev, struct of_phandle_args *args) { struct platform_device *iommu_dev; + struct rk_iommudata *data; + + data = devm_kzalloc(dma_dev, sizeof(*data), GFP_KERNEL); + if (!data) + return -ENOMEM; iommu_dev = of_find_device_by_node(args->np); if (!iommu_dev) { @@ -1108,7 +1175,9 @@ static int rk_iommu_of_xlate(struct device *dev, return -ENODEV; } - dev->archdata.iommu = platform_get_drvdata(iommu_dev); + data->iommu = platform_get_drvdata(iommu_dev); + dev->archdata.iommu = data; + of_dev_put(iommu_dev); return 0; @@ -1204,6 +1273,8 @@ static int rk_iommu_probe(struct platform_device *pdev) bus_set_iommu(&platform_bus_type, &rk_iommu_ops); + pm_runtime_enable(dev); + return 0; err_remove_sysfs: iommu_device_sysfs_remove(&iommu->iommu); @@ -1216,6 +1287,8 @@ static int rk_iommu_remove(struct platform_device *pdev) { struct rk_iommu *iommu = platform_get_drvdata(pdev); + pm_runtime_disable(&pdev->dev); + iommu_device_unregister(&iommu->iommu); iommu_device_sysfs_remove(&iommu->iommu); rk_iommu_put_clocks(iommu); @@ -1223,6 +1296,27 @@ static int rk_iommu_remove(struct platform_device *pdev) return 0; } +static int __maybe_unused rk_iommu_suspend(struct device *dev) +{ + struct rk_iommu *iommu = dev_get_drvdata(dev); + + rk_iommu_shutdown(iommu); + return 0; +} + +static int __maybe_unused rk_iommu_resume(struct device *dev) +{ + struct rk_iommu *iommu = dev_get_drvdata(dev); + + return rk_iommu_startup(iommu); +} + +static const struct dev_pm_ops rk_iommu_pm_ops = { + SET_RUNTIME_PM_OPS(rk_iommu_suspend, rk_iommu_resume, NULL) + SET_SYSTEM_SLEEP_PM_OPS(pm_runtime_force_suspend, + pm_runtime_force_resume) +}; + static const struct of_device_id rk_iommu_dt_ids[] = { { .compatible = "rockchip,iommu" }, { /* sentinel */ } @@ -1235,6 +1329,7 @@ static struct platform_driver rk_iommu_driver = { .driver = { .name = "rk_iommu", .of_match_table = rk_iommu_dt_ids, + .pm = &rk_iommu_pm_ops, .suppress_bind_attrs = true, }, };