From patchwork Thu Oct 19 02:48:00 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Ming Qian(OSS)" X-Patchwork-Id: 13428203 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id E08A0CDB483 for ; Thu, 19 Oct 2023 02:49:08 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:MIME-Version:References:In-Reply-To: Message-Id:Date:Subject:Cc:To:From:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=S+nBpvfJKtO1UK9fzCDSkeCm3HquXExMFle+Pp58oAU=; b=u7fsOvkc2ixOO/ 8Cxk2gTkZqrgppxDsy/qxpMirmLfQ3syjoclZkyHhfBIbg/G2DiydfIVKp0+V/blMvHLOhwMEnDQT Y7dtcrhF+Z7i/731dkJ65zrww1OrWuaDntoK502gqemkmRDjPzDk2sKDimq3Pq9Cf3NKT9piU/U+J oXn9SxsxChpdzKbxRtq6EzZ0G3/q66MWCffkQKWSzPm1oppybIJND3U9FH2Slq28Afpp41V4nvCMw C30UVnNqRQjXlZ2uEkLSOY/y1K0X0RWNKrM18Xfmh18SlxUSUlymbKGMNJeH4IUefBPB8fjq9sYel uPgmVRPuyydKAcYUc97w==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.96 #2 (Red Hat Linux)) id 1qtJ5V-00GA1j-2K; Thu, 19 Oct 2023 02:48:41 +0000 Received: from mail-db5eur01on061d.outbound.protection.outlook.com ([2a01:111:f400:fe02::61d] helo=EUR01-DB5-obe.outbound.protection.outlook.com) by bombadil.infradead.org with esmtps (Exim 4.96 #2 (Red Hat Linux)) id 1qtJ5O-00G9yR-2l for linux-arm-kernel@lists.infradead.org; Thu, 19 Oct 2023 02:48:38 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=npakqqRpS+dM5gAOuhsNxonZxMkG7UtPIP+3gGsg4cnep34vbpacROm8xHqt864jhNlqU/RKI3FKvVT11ptnIANCL8RFro15UFKyVZtmxrnuF6hA1FkGcskhAAcjXqfJUunbvlEIh1IRuNB/15GOQZBxvzeoL5Nw2GCXk9dk6pddcUKT0mf+Ifdxzv4xtGkRqnPLE9sQhuycxhDf5N5p0pSupp+j+DJruXT0sabY2nrF/7O/z9LNp7LKcv4Tq0zCRbwsdw5wvFlubhdKB5qjMDKbnIQMdQ0mMA72I0SI0JFqFAQKarnfmy8AnDWCAPt0EDC56VVLjUwNZDi3drI4Yg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=sDkbFghCYRIxXLS77RafNyTXHs8bWVMebLyp4TESW+Y=; b=k0RgNyyfrDKL04ae8EV1RMZKzfjK+4wYPVLhNToyU08MQc7bOAen+M6KDpchpfHDZcTvhXV9sKyTmaTBWZ2mBuuuAWiZTPY62AyDOsbGg/Gp9fG3EIdeY5zflAX2uFQDwgbKgicaLCA92xw2TrWrtRxU3IgjfnKb44R2OZpFFK7LKFBeTvfaxCHP765oyvyr1J7xhXxwEkDC+SLs9iBX2oV4i0mKp2NOfCgZqay/w4VBKi8S24b7noajsSDfhKLKfFYGL7W4W+LP0tq13XkH7OSinOMUjO7/7Jn0Wrv21fzJz8dAWeHXWzjUK8J87FKCbdajeTSUe0qJ+3BW6i1oRg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=oss.nxp.com; dmarc=pass action=none header.from=oss.nxp.com; dkim=pass header.d=oss.nxp.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=NXP1.onmicrosoft.com; s=selector2-NXP1-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=sDkbFghCYRIxXLS77RafNyTXHs8bWVMebLyp4TESW+Y=; b=SqVn62fhKJ4z4x39dX2nKENY7kpx7iSl4fx7BCRqTeM+rRghsDARknzO+SLkyTLolQAr0hjzNdO6K2k/MuquP4pXiFWUR/SM+TePtNiUr9SGpjcESyyQ0g7meaZvCX8OicOxTUcZNh7uw+NiHy+m+N3Xsh1vpnjZsDtAglrM/zA= Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=oss.nxp.com; Received: from AM6PR04MB6341.eurprd04.prod.outlook.com (2603:10a6:20b:d8::14) by AS5PR04MB10000.eurprd04.prod.outlook.com (2603:10a6:20b:682::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6863.46; Thu, 19 Oct 2023 02:48:27 +0000 Received: from AM6PR04MB6341.eurprd04.prod.outlook.com ([fe80::6e53:39fc:f010:30d5]) by AM6PR04MB6341.eurprd04.prod.outlook.com ([fe80::6e53:39fc:f010:30d5%4]) with mapi id 15.20.6907.021; Thu, 19 Oct 2023 02:48:27 +0000 From: "Ming Qian (OSS)" To: mirela.rabulea@oss.nxp.com, robh+dt@kernel.org, shawnguo@kernel.org Cc: krzysztof.kozlowski+dt@linaro.org, conor+dt@kernel.org, mchehab@kernel.org, hverkuil-cisco@xs4all.nl, s.hauer@pengutronix.de, kernel@pengutronix.de, festevam@gmail.com, xiahong.bao@nxp.com, eagle.zhou@nxp.com, tao.jiang_2@nxp.com, ming.qian@nxp.com, linux-imx@nxp.com, devicetree@vger.kernel.org, linux-media@vger.kernel.org, linux-kernel@vger.kernel.org, linux-arm-kernel@lists.infradead.org Subject: [PATCH v5 1/3] dt-bindings: media: imx-jpeg: Assign slot for imx jpeg encoder/decoder Date: Thu, 19 Oct 2023 10:48:00 +0800 Message-Id: X-Mailer: git-send-email 2.38.1 In-Reply-To: References: X-ClientProxiedBy: SG2PR01CA0165.apcprd01.prod.exchangelabs.com (2603:1096:4:28::21) To AM6PR04MB6341.eurprd04.prod.outlook.com (2603:10a6:20b:d8::14) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: AM6PR04MB6341:EE_|AS5PR04MB10000:EE_ X-MS-Office365-Filtering-Correlation-Id: 40c46a79-31cc-4fa5-1503-08dbd04ddee3 X-MS-Exchange-SharedMailbox-RoutingAgent-Processed: True X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: oxaAzVpTSeyE0psmEMAs2O48BThD/m3vdf13CJwZxK9PlvFuZtwxDOkx8ZmvKQMavljgka7DhIblJAmiLrURz51UTKZxvICzLh4kEvJi7cIQx59ngxH+IvWZ1Hg9ztCQCPaaLwi3gncMwzVNqP4U6Mvnj1HpQQxWFrkuZLeGWRoAONZNHnk2LLxOCGrzHoMpR+j3RmONW9J9rJ6KDHTxZcY8OlzZFD2HQh/yKhqyeXwz5YY4KyQuKCXIgCpG9jik2BTcFnv4AJ0vyy/7J8Ivm5eLM1wZLGasgpgWh5g7srOkKD9vdCqT40iBFukfox2j/6Rhj/1xDVA1rk5tl4o5kErqv3L3CGxbQwoHSNDNVEn+QNCL0Y2/1SvnRT6dkA8iHi+A8pyDkAXFryVrk2L3IhE89imGzVbMtFDLChAa1yTrzt8uGAirvSk/xFdg0PtT4DFaiHfs2voxRoH+WFImvTyjl6KDn/4Pa2yiKGhOqQp1RD5JveHBpcUwWWB9TpdIIqNrfxNvDThD/rkB4Zq+teEVIjHNM12lCfccxF6DzmYLjFL6uYhS5Oa1pnForRxsgHEEgInvHtUjft1Qko5i66PyYYJT8ErV6g2dJTnl1nVaiGgjfRXP1AD3SlexVgD/ X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:AM6PR04MB6341.eurprd04.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230031)(346002)(39860400002)(376002)(136003)(366004)(396003)(230922051799003)(1800799009)(186009)(64100799003)(451199024)(38350700005)(6512007)(86362001)(36756003)(9686003)(8676002)(66476007)(66946007)(38100700002)(316002)(83380400001)(52116002)(6506007)(6666004)(66556008)(41300700001)(6486002)(478600001)(8936002)(7416002)(5660300002)(4326008)(2906002)(26005);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: Qnpto59hkfTOxNbb09MM+GDmjVzJgyed5YfqHVmlzs1STsOcBK4VWpKWFnbeTjBdA1xEw4cp5D/VMkzDxuSQGKpIITI2lWptOoXa24hGLAATlhCLLsSfIV3ulGnDb7gXcRav8hLJMWLxesvONIz9s52PUfWzkjh+DfLX0dcFfxvVl2YMhLF7roonpLs9/QHIpH7HfxKERLKIXK4EMotWtKwOu0fHpUyd7MvwGT5Y7Yp0hhcYZ4Gz3O7oPfJ/eGy8OoDbpiSigRwPSovifQdObergOU2kOHNTl8hRtl1Fa5LS3tRFemMXw6rs9u5/Mv+MoV18Ka4ZLz5vYg8GG12gKkrWd65yamx/U9McHyAC7eg5vnBxwbMB7FAtEQD6Kzmjjr7SJ/+2xEAemfy4/3KygbHxXii2Sl3XEsFzOA0lekbXX+AkTArTxYtkg2Fd/W9Wi/uqhP6mhrFLOr3VK3wrc7wXQtbb7E+3lWWak4835Ge/KmR2fZRlkSC1fxprsIuN/4FrVvr4NxrPR/vUAh6GHHwPliCHUSWK4mqzWsFvKzq5PopXY6BEXaJWX8H8yqoofaxD1djyd691FJCSC4Lx1kuYJzitU0QpEgmK0jPhzG6FlkGzjISkDvhQnoa2p1BygYFAg76aEwYkR50x8RFYm4/wO7yyFVq04BNzWGcU/Keq/fH2YgwJL5FCnUjOeU0ltc8RuP2tGHUpMteOjQer1HK0zZxodBbQVqM69eKKILBUjtAH+YH0sXupH78NPREeTs69cm9EhUeXmrIOwNpd2yLDtmSlne0LlAtV5WP5RpPfSAL251xuszVgSC8U/Xit7LTXeN+v7DIbsp4pMNLvQAeB8QRGKCtDHu2JCyLO+NUcl9GPVQ98xxB2QPNjHv4ajCbFHGvBx+x0pXDdGfTg72EYMb83jclN8Ez43/nJXxN4tMbUoQT/8LQy9cx6Qa18jginj/g/Y7RUwRb+Y5E9C24xrQSmXkkk2sWoc+i/rkp5ZBmBLM/WoHtLW95pGSksYCn6hBBySO59Pzb2b/qd/OOY/am67gM/Jzfe99wn1ejq1xwAy6mzheOzDfNzctOguatDWzkpnaVQ2ZDEtAYh7P8nhPQZyWgC4li2vV9/E/uuBXYM4vs3NyNsops0hATPdDQj6XxVnvT4VqlnTWaaH0P6iUuZUeUXYN0FJzFzDcxDDchq7wV2i4fgMuYLLWfPNKTGVJ1IhjrAJEHWrpRub6HYHO1MykKmj+z+Y9sidDVmQe8kTQF2Diw72AYF54iqteYuqcHUSIl3KBV2Lr9qKNlW0IMJakLMh0cFsjqoNbl8UqvJVaPGroa5Hj7ymU5bpMkvnUSMRZaCLwQYAAsRzvA5ysKeeuDFq5J0SIyWRhWwyZAy8AYgbcEkxyoxJHW+M6cHN/93sdMO7Kyk1nsNRVmod0Zam4MbRQCdCvhXNDP6RC9cYp5AcR+UadZyNmXD+4chaAEqTSUwtCrtfnv92m3mkoBOq6eI4V6bM2u50b8mcydwLMnLBnV/mNd76gCLWSk5YgF9DRKTt4aviHo+I+3KkzcadEFoATRUSsviMfACkrNXx4tlYreH/JfnaTGK X-OriginatorOrg: oss.nxp.com X-MS-Exchange-CrossTenant-Network-Message-Id: 40c46a79-31cc-4fa5-1503-08dbd04ddee3 X-MS-Exchange-CrossTenant-AuthSource: AM6PR04MB6341.eurprd04.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 19 Oct 2023 02:48:27.6523 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 686ea1d3-bc2b-4c6f-a92c-d99c5c301635 X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: Sw00ZjvIflnSull+7kd7fN2GOrk1LEyrou2RL54OsJ7gaLWLOzgZ04aME47bUwhPdEEks3HnFL2PDLJxRcxl1w== X-MS-Exchange-Transport-CrossTenantHeadersStamped: AS5PR04MB10000 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20231018_194834_896161_33DA4597 X-CRM114-Status: GOOD ( 17.74 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org From: Ming Qian This IP includes a jpeg wrapper and a jpeg engine, the wrapper is working on descriptor based manner. It supports up to 4 slots, each slot can have its own chained descriptors. Host won't configure the engine directly, but fill some descriptors to encode or decode one jpeg picture. Then configure the descriptors to certain slot register. The jpeg wrapper will schedule between different slots. When some slot is finished, the slot interrupt will be triggered. The purpose of slot is that engine can be shared across multiple VMS and os. Currently, power domains and interrupts are enabled for all 4 slots, but only one slot is used. There is no benefit in using more that one slot from within the same OS, as the slots are scheduled in round-robin manner and not executed in parallel. Use the property "nxp,slot" to assign a single slot, and just expose the parts of the h/w for the assigned slot. For example, only put slot 1's power-domains entry in the DT when slot 1 is assigned. If not specified, 0 is used by default. Signed-off-by: Ming Qian --- v5 - improve commit message - improve property description v4 - improve commit message - drop line making the property required, to avoid ABI break v3 - add vender prefix, change property slot to nxp,slot - add type for property slot v2 - add a new property in bindings document .../bindings/media/nxp,imx8-jpeg.yaml | 46 +++++++++---------- 1 file changed, 22 insertions(+), 24 deletions(-) diff --git a/Documentation/devicetree/bindings/media/nxp,imx8-jpeg.yaml b/Documentation/devicetree/bindings/media/nxp,imx8-jpeg.yaml index 3d9d1db37040..0961856bdcab 100644 --- a/Documentation/devicetree/bindings/media/nxp,imx8-jpeg.yaml +++ b/Documentation/devicetree/bindings/media/nxp,imx8-jpeg.yaml @@ -32,19 +32,27 @@ properties: maxItems: 1 interrupts: - description: | - There are 4 slots available in the IP, which the driver may use - If a certain slot is used, it should have an associated interrupt - The interrupt with index i is assumed to be for slot i - minItems: 1 # At least one slot is needed by the driver - maxItems: 4 # The IP has 4 slots available for use + description: + Interrupt number for slot + maxItems: 1 power-domains: description: List of phandle and PM domain specifier as documented in Documentation/devicetree/bindings/power/power_domain.txt - minItems: 2 # Wrapper and 1 slot - maxItems: 5 # Wrapper and 4 slots + minItems: 1 # Mixed power domain + maxItems: 2 # Wrapper and 1 slot + + nxp,slot: + $ref: /schemas/types.yaml#/definitions/uint32 + description: + Integer number of slot index used. This IP includes a jpeg wrapper, the + wrapper is working on descriptor based manner. It supports up to 4 slots, + each slot can have its own chained descriptors. The purpose is to share + the jpeg engine across multiple VMS and os. We use this property to + assign a single slot. If not specified, 0 is used by default. + minimum: 0 + maximum: 3 required: - compatible @@ -62,28 +70,18 @@ examples: jpegdec: jpegdec@58400000 { compatible = "nxp,imx8qxp-jpgdec"; reg = <0x58400000 0x00050000 >; - interrupts = , - , - , - ; + interrupts = ; power-domains = <&pd IMX_SC_R_MJPEG_DEC_MP>, - <&pd IMX_SC_R_MJPEG_DEC_S0>, - <&pd IMX_SC_R_MJPEG_DEC_S1>, - <&pd IMX_SC_R_MJPEG_DEC_S2>, - <&pd IMX_SC_R_MJPEG_DEC_S3>; + <&pd IMX_SC_R_MJPEG_DEC_S0>; + nxp,slot = <0>; }; jpegenc: jpegenc@58450000 { compatible = "nxp,imx8qm-jpgenc", "nxp,imx8qxp-jpgenc"; reg = <0x58450000 0x00050000 >; - interrupts = , - , - , - ; + interrupts = ; power-domains = <&pd IMX_SC_R_MJPEG_ENC_MP>, - <&pd IMX_SC_R_MJPEG_ENC_S0>, - <&pd IMX_SC_R_MJPEG_ENC_S1>, - <&pd IMX_SC_R_MJPEG_ENC_S2>, - <&pd IMX_SC_R_MJPEG_ENC_S3>; + <&pd IMX_SC_R_MJPEG_ENC_S0>; + nxp,slot = <0>; }; ...