From patchwork Fri Jan 17 07:57:19 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ming Qian X-Patchwork-Id: 13942965 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id C9007C02183 for ; Fri, 17 Jan 2025 08:00:31 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender:List-Subscribe:List-Help :List-Post:List-Archive:List-Unsubscribe:List-Id:MIME-Version:Content-Type: Content-Transfer-Encoding:Message-ID:Date:Subject:Cc:To:From:Reply-To: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:In-Reply-To:References:List-Owner; bh=8supK/9NAMDRwuUddAVjDP6hqlfZ8jq/qFC7+pM/ckU=; b=1rIts3QA24J5yxAKWekvLcFInM xSrbvmj8anYeXhGRefhXrHHuYYILxRVZAWdlPWerxxhGo6fBpJESHq0bK5InRBSumqgf+GhBeuqy8 8p1WAaxSA8sY2C75Jd326NWOmj2N42j/4hfgccavgGVQx6budou03xf1ut9iQiz7mgSJ/ZeuoAJV5 YYJtvcH69cFm3Vd5pXZU7Mug/17cJ0pT+w6aEAq8jwhfNJn23d7eAovZ1y2Tm9zBuXTyo1if3vE0M brGAwoaBP+IJCo3y2/sW2O6o1QDZwkcGumB06Sd39f7KA5STOwlafkM7qebdM4HOF/6TsqAbLm5X5 KXbOgS9g==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.98 #2 (Red Hat Linux)) id 1tYhH9-0000000HGnu-32GS; Fri, 17 Jan 2025 08:00:19 +0000 Received: from mail-northeuropeazlp170130004.outbound.protection.outlook.com ([2a01:111:f403:c200::4] helo=DUZPR83CU001.outbound.protection.outlook.com) by bombadil.infradead.org with esmtps (Exim 4.98 #2 (Red Hat Linux)) id 1tYhEt-0000000HGPm-2cJz for linux-arm-kernel@lists.infradead.org; Fri, 17 Jan 2025 07:58:00 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=GoFW46BjG/NIi9Iv18935KLTd2TdDwhlE0XY7oWDWpEeHsoLLkZR+1U3R9R1c1Q9TotFKEGZ3r+0AEzQTZj/KQ4TDEvFEDcZvr8ZbYx2HY7zurlehDEKp+FpXxE7LE/zj5AM115uCg8M63Q2zNZN3ZDWkSeBAYiKEK3xLgCim/HK0OX9FWDoKLMZW3f1vapfFe76MtXoEQ5P0heU/Y5T4WQhCVazAe1TPT89GySKTMi07clvvSRasV2pJVOozAEzTW2OMw1Mz39iakHi9cEM7JGtr2e6+gNm7mvr95vu+jcdEEVcWov/ZfhupYx61U5XYJ8c7pAi9U0sbHISpXd1Kw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=8supK/9NAMDRwuUddAVjDP6hqlfZ8jq/qFC7+pM/ckU=; b=cyItiwZQLNxm7+upiRzVIbJ4wQCeyYAUn8oFmNiJ2cyWTpkOJxPuviG4cdW1aIHhik1WbGJawgDxJHrhZ+hPypq6O9Qr0aM4SH+XclZaxFJPnIJHmXP2/bWXcu6spdiljlOXjqVrLFxlPpk2kWhRct09LdW/2FSlM18ONXXkzwJb5FTw2X2BzTNMoT9vYycYxJ5+mTzNqrUmNfP1NPIYsD0H5tQm+qaJOaugmzPJ7MSQQEJdzsmDI4HOtpayrMyXvIVf8vWAKO9bS3hZD7i5xiXylDtUth1QlnSV+/Sk7bdItLGV1WMspGvjcY9CWKHJx0Y9HIW4UStTOqtKdT95tw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=oss.nxp.com; dmarc=pass action=none header.from=oss.nxp.com; dkim=pass header.d=oss.nxp.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=NXP1.onmicrosoft.com; s=selector1-NXP1-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=8supK/9NAMDRwuUddAVjDP6hqlfZ8jq/qFC7+pM/ckU=; b=CGm8YAnd3QAoPUfnKEusVSxVOsTjrt6BkCLNBygXMWzZ4nXLlOAMRyr+rDhKzHnL0kOadTtRZ8W5et5e5hwCgQpkknMRH3Ol057qCU6lfuoJFdJXCTltQkaGDZoqZUtzpKYV+roCB0d+1VOL2HJM1ZhJztToph9Sy0wMfk3YOqtEEzgP4cYtvTwjSsAPbWBZ1fXZm7+K3110NN4dIbyWeiXC0oj/+BXfSDjBzF79111ngkRVfAO3+BTIzzB8lRyiGMkHGB1zBlWGCx3TyD7V9/CuMZVUKF3eAMcDW5qSl9RNnzCLJv0HNKyGvNESZvnwJGeP2rpJ79NwjbICO1wNTg== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=oss.nxp.com; Received: from PAXPR04MB8254.eurprd04.prod.outlook.com (2603:10a6:102:1cd::24) by DB8PR04MB7115.eurprd04.prod.outlook.com (2603:10a6:10:128::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8356.14; Fri, 17 Jan 2025 07:57:56 +0000 Received: from PAXPR04MB8254.eurprd04.prod.outlook.com ([fe80::2755:55ac:5d6f:4f87]) by PAXPR04MB8254.eurprd04.prod.outlook.com ([fe80::2755:55ac:5d6f:4f87%6]) with mapi id 15.20.8356.014; Fri, 17 Jan 2025 07:57:56 +0000 From: Ming Qian To: mchehab@kernel.org, hverkuil-cisco@xs4all.nl Cc: nicolas@ndufresne.ca, shawnguo@kernel.org, robh+dt@kernel.org, s.hauer@pengutronix.de, kernel@pengutronix.de, festevam@gmail.com, linux-imx@nxp.com, xiahong.bao@nxp.com, eagle.zhou@nxp.com, tao.jiang_2@nxp.com, ming.qian@oss.nxp.com, imx@lists.linux.dev, linux-media@vger.kernel.org, linux-kernel@vger.kernel.org, linux-arm-kernel@lists.infradead.org Subject: [PATCH v2 1/2] media: amphion: Reduce decoding latency for HEVC decoder Date: Fri, 17 Jan 2025 16:57:19 +0900 Message-ID: <20250117075720.4018076-1-ming.qian@oss.nxp.com> X-Mailer: git-send-email 2.43.0-rc1 X-ClientProxiedBy: SI1PR02CA0016.apcprd02.prod.outlook.com (2603:1096:4:1f4::17) To PAXPR04MB8254.eurprd04.prod.outlook.com (2603:10a6:102:1cd::24) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: PAXPR04MB8254:EE_|DB8PR04MB7115:EE_ X-MS-Office365-Filtering-Correlation-Id: e4b256aa-020a-43cd-a3f9-08dd36cca723 X-MS-Exchange-SharedMailbox-RoutingAgent-Processed: True X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|7416014|376014|52116014|366016|1800799024|38350700014; X-Microsoft-Antispam-Message-Info: HLYdyR+Ha6tZSPDjPkfZMb8tETzWo1kZpIfNqS6f5jBwRgXoQ4fADP3n1D//EpyaZQ/yUhfwlSTGgStWsimhQbe4tWqA72mhgiDXfLnME75yPcafQDK+ShM0rlpCFhAfO8ubfMgzNh6A0uXCfUWsKcndZ5jnKCYuSelX2qCN+OtpKLgMczXCkPBamY9EWy3sX0bMPur947hgtrGm2twRFcmyzLVMuBLmdYZ0/LmR5DOx4qR4zSXIvNa7c0PcyqrctkNOnY9N6Sr7Rbz/puSdhG3DS5TUrbAaOvTK9IwKf44P5A7qs/BNw2WaGAVfAHhmteSlEVidcWs/o2q4L2cUq49j3CKuFf8TUCSRwVkWDtUmJTMfu6L36onsc0VuWPSigqGG6Wh7C2CUL/Kk6anzK4ZpBomcYDpyCmn9pDTCEtn1lToDH3yNS+dkHBPaHdLwAy+rfgFROoP+GHvBbITqxzNbd2DFGui10SrfMvAvtMXXHhCblTNmYUsR/s6Uj8aJEvWqJCV6eJPI6AjPfQYYXUs9VTpYxZNCWQyyJLksK0wvSWcVEPVoD8o/Ckbq3FDcR9bxIDIqSS3B+ddeyZPZ5DtUtKddpzX0Wd8MIUvGHCljgGCM//4/B0DlbK5ffZbDLv9fiLOxGs/ud2B5Ff+IpnBptCbc6d6sXj3EN+Bm1wjfCVgs7y7Wcy97J8rabg2AOd2W/PbkDYZf77V6u9YdhK7pa1n7Pc5PYGlU0H2ODfT6kW85cDoQK6EGX/ZRW+mUOQ79qlNYwCHx+bF/2n3V3yTyUPi3XI1MGzfyYB4v4vbuhowJwV2DYGuxaEXGzWg9wAoMhw+qjWoUfVa5+/nOF/eTzSzr8qsyZtuPlBuAq92mbFcTNWXp9lMqXpiuUwqMhx7TgH+v2xrid6Rm8ftQbwBbhjb54pQZ3XpixhJesDa1yqudcmG7E/ILYoBZll096OB6UoIAzxGvYnRB8eR+c2wkfNdAClUpicl70jPV7EsiTh2uwVFLh6fZev7t5HRY2Eq6vjQYb6eMmN++IflczXZjw9un1kTlkP0WTNO+Srjb1rRz5F/zWsmw8NxdkkXQNKiKUp8Xd9rz/jU/FVUSozuxK17ONy4XYgXWjvOr0Zrxi21aByv6GX67D+dUcySq1m2nAplJTmUsJH0pBTfvuiNdDhg3m89M7yazRce5JSmYrM9PlMNOBtw3U1HDcynQC0HtQlHB5QqKFSpol2NuIbQcQznbDZ3HKs9y/gB5P+7lyBycDjjmZnRBLMgcU2rIkEJQfhi9xDEa2E5i6GucqfcDOFYpUc/NZU6d8DObUbI2hykRTmhVjN9Gn7nhSlZ2t+WRPRsTPs3hiKMhdshCsVWoOvJ5FiW9iLo1mZkYXCikW6ZGWDeJikjbJUU0JJgMZoVw8D9y7RqI6f63QlyfDEP1Joc/yyXRW3bkaCfsERKf951wfeyezMuV9xuvoFgR X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:PAXPR04MB8254.eurprd04.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(7416014)(376014)(52116014)(366016)(1800799024)(38350700014);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: AF+2AsuucvPQffiGpF3sxRG4vFnQgJqCHDT5KVW9H+EG8Nwwn6hmVxcvVcDsDiTrYM53AsKtzAYhNL9jCF/ZTZgpfX41PO/syIpQ2bhJ4FgYIvZI9yKEhkZgC5BAAMrGGZUWTbTJXvaiN5p6H4RXM9YeqAizwmU4qBzcovAZx0s4F8eeDLGBJ5I9GnXDLXP+HAuHdhrXDrT91dYby3+iZB2L2Sw8hBYZN+/jcpbUzt8Rz51DWBNNTpe89EakyL8b5NTvpYjg5PU63K6VuZMBtWRJbJQgGFpzh+cqN1MolikjoDan3JzMr+66K6X3kop6lUQeSX875rz4QZ9vA/cZ+TgsePTx0NMHl15adJn7WXLdP6d6Cg6RQPpwyykSvxWY+xnO40fwfGlC4YaXPR28K0EnMsRWmgLdXA45grHsihPGSsuBzqqM5Aqds2UuGgzVHwM2DkR1KVJ727wUnUhbdd80i48D8ktrF6UvJaITOgF4tBT6Ss/EFHF+PQZr5+/PRTksdNK8wGgM9tB0akPPCliABi9BcHbm5RDRZuYRmM9kh0C+7LadqXR/CDWzNsi7hM0uQzvhdGnCBhHmqtEPjnaxcJ7TWqENknsZgplW5VGh9fKZMoowaG0NrXB5quwL9myO0lK6ogJkDjaelKTEHsGgOZCVWSI/oXbEw8QM8phOHakR2+Q8HzkTU3sLJ+fegrsdhmKcjOZ3NbHPOy/OZyo0yXSaopShxRdpBmGdBwmkDzVhllUDZ/2y6WjvE5QyLEJNtOmlAzw7tz/KWYpvG0Jxs6G8ueRPVHONnF9nLOzl/MJRjLv7p2Uou0YK2tTvYoPMbcuh4BfpyunJQU7xBskPTLemIdPtb46oc6+4CCpGNd1HzszQqy3pQvc1+2LB1P889RZ8Uhf1A5uMTyxEtkdewI3RxwDnRoCNBTK43CkvP9agCmYvNpmQafY6TKDLsWAz0JicXYDvtxd1Yn5T3F14EI+eplULRsvHU075cgMM+0RbTxBWbNCkQlfYVm5RY5lxqHKRu4RuK/PDqhxsCbJk3xRXM7K+XtcTjzklYocHd9S5N7JFdRUeljcXxMM7/2xRt5LKmN+Kt45njm84IiQxBQkt0nM54sJxeTv0d/0TdfdQvsD1w2omzNBNsOPnpK+y60641nhKDSjxUfGUQzIyR8CTXthiYeMlNQMwQPeBSAxwj8ljxQBLUesNQY0oLo2NvXEXGiKxuL5/Z5AiTuNzPxFNA7OiSpxhtbIdY3JFoG0ggn/ORn9hEy4RRnuZH8mP0wTRoBo9G7uvyr8QMxhh5Wor6DL6dTahjFnJNg66HiI++VgZpIYIvuUYgQgwEvfhqwA85ITHOwwCOTvBppYcp4o2fztoLH0r3ZjkBT2Q5govOF9qtfuTjfLNzwzi3p6tnDeKYplWl1OiVbZChYSqs6gB6IzQTFt8P2c40kjly+OGizEUjeWkWLnq2etpk6jgFGf8lCmTDwubIsRfRZ9fIysPn7JmlkHUJYwd/Bnk4X24TETO7HStBkGk/jceCGoIFbCxmyZH9Izk5iKRn80ulgox1GMG0JpHrOGEVsH8uA4In0tOHfqhypOFcr2P X-OriginatorOrg: oss.nxp.com X-MS-Exchange-CrossTenant-Network-Message-Id: e4b256aa-020a-43cd-a3f9-08dd36cca723 X-MS-Exchange-CrossTenant-AuthSource: PAXPR04MB8254.eurprd04.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 17 Jan 2025 07:57:56.3825 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 686ea1d3-bc2b-4c6f-a92c-d99c5c301635 X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: aq4od4BnlaAipV2F+7PR+nyFe2KW5MSaIq9adCXqyANVfMaIMBhPsZF1aZFjdoCaZ0kobMwd8CzkyP+AN+FUdA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB8PR04MB7115 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20250116_235759_670872_1DFD19EB X-CRM114-Status: GOOD ( 15.62 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org The amphion decoder firmware supports low latency flush mode for HEVC format since v1.9.0, it can help reduce the decoding latency by appending some padding data after every frame, then driver can enable this feature when the display delay 0 is enabled. Signed-off-by: Ming Qian --- v2 - Improve commit message - Add firmware version check drivers/media/platform/amphion/vpu_malone.c | 22 ++++++++++++++++++--- 1 file changed, 19 insertions(+), 3 deletions(-) diff --git a/drivers/media/platform/amphion/vpu_malone.c b/drivers/media/platform/amphion/vpu_malone.c index 5c6b2a841b6f..1d9e10d9bec1 100644 --- a/drivers/media/platform/amphion/vpu_malone.c +++ b/drivers/media/platform/amphion/vpu_malone.c @@ -68,6 +68,9 @@ #define MALONE_DEC_FMT_RV_MASK BIT(21) +#define MALONE_VERSION_MASK 0xFFFFF +#define MALONE_MIN_VERSION_HEVC_BUFFLUSH (((1 << 16) | (9 << 8) | 0) & MALONE_VERSION_MASK) + enum vpu_malone_stream_input_mode { INVALID_MODE = 0, FRAME_LVL, @@ -332,6 +335,8 @@ struct vpu_dec_ctrl { u32 buf_addr[VID_API_NUM_STREAMS]; }; +static const struct malone_padding_scode *get_padding_scode(u32 type, u32 fmt); + u32 vpu_malone_get_data_size(void) { return sizeof(struct vpu_dec_ctrl); @@ -654,9 +659,16 @@ static int vpu_malone_set_params(struct vpu_shared_addr *shared, hc->jpg[instance].jpg_mjpeg_interlaced = 0; } - hc->codec_param[instance].disp_imm = params->display_delay_enable ? 1 : 0; - if (malone_format != MALONE_FMT_AVC) + if (params->display_delay_enable && + get_padding_scode(SCODE_PADDING_BUFFLUSH, params->codec_format)) + hc->codec_param[instance].disp_imm = 1; + else hc->codec_param[instance].disp_imm = 0; + + if (params->codec_format == V4L2_PIX_FMT_HEVC && + (iface->fw_version & MALONE_VERSION_MASK) < MALONE_MIN_VERSION_HEVC_BUFFLUSH) + hc->codec_param[instance].disp_imm = 0; + hc->codec_param[instance].dbglog_enable = 0; iface->dbglog_desc.level = 0; @@ -1024,6 +1036,7 @@ static const struct malone_padding_scode padding_scodes[] = { {SCODE_PADDING_EOS, V4L2_PIX_FMT_JPEG, {0x0, 0x0}}, {SCODE_PADDING_BUFFLUSH, V4L2_PIX_FMT_H264, {0x15010000, 0x0}}, {SCODE_PADDING_BUFFLUSH, V4L2_PIX_FMT_H264_MVC, {0x15010000, 0x0}}, + {SCODE_PADDING_BUFFLUSH, V4L2_PIX_FMT_HEVC, {0x3e010000, 0x20}}, }; static const struct malone_padding_scode padding_scode_dft = {0x0, 0x0}; @@ -1058,8 +1071,11 @@ static int vpu_malone_add_padding_scode(struct vpu_buffer *stream_buffer, int ret; ps = get_padding_scode(scode_type, pixelformat); - if (!ps) + if (!ps) { + if (scode_type == SCODE_PADDING_BUFFLUSH) + return 0; return -EINVAL; + } wptr = readl(&str_buf->wptr); if (wptr < stream_buffer->phys || wptr > stream_buffer->phys + stream_buffer->length) From patchwork Fri Jan 17 07:57:20 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ming Qian X-Patchwork-Id: 13942966 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 7A8D9C02183 for ; Fri, 17 Jan 2025 08:01:52 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender:List-Subscribe:List-Help :List-Post:List-Archive:List-Unsubscribe:List-Id:MIME-Version:Content-Type: Content-Transfer-Encoding:References:In-Reply-To:Message-ID:Date:Subject:Cc: To:From:Reply-To:Content-ID:Content-Description:Resent-Date:Resent-From: Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=WGg0pPkgSkpCmF7v6yR2DYkMkIR6Fot5aiOCBKpV/jg=; b=Fmx9l08wDp+Dj/W074si73Vf94 j5rVY2S1WRsZAgXic+TNVzaJ4F5uRuRjzQ/6cneq+Fh/QEtFvUqxx8Mq7rLMxLJ0hBhs4Glv9Rw/T 645ZkK9KCUWdIr6xpGZGbYjksHMm8nWR01bacMthsBQ0tllMwk8PacgCUBTemVm6Z5sg3gZW4+r8T EB/6F0ZX7jC3EvldkbFFaxY02Id0XavsItmjmu3DYEn6XoOxQiqfXNDrvj5pZsLjqJ9rGKFh1Xgb9 LUH+fvIeh2ZiIkvG0JuhQL24an6l0l1uXNHunVORAtvIZv+mhAzjKvhy7qjGaqPnMOTSPZqMuhMBZ XaqmNCKw==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.98 #2 (Red Hat Linux)) id 1tYhIO-0000000HGyo-1fwb; Fri, 17 Jan 2025 08:01:36 +0000 Received: from mail-northeuropeazlp170130004.outbound.protection.outlook.com ([2a01:111:f403:c200::4] helo=DUZPR83CU001.outbound.protection.outlook.com) by bombadil.infradead.org with esmtps (Exim 4.98 #2 (Red Hat Linux)) id 1tYhEy-0000000HGQW-0sy7 for linux-arm-kernel@lists.infradead.org; Fri, 17 Jan 2025 07:58:05 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=WT99t7PPDWZf5Lz1Myg0xc4leAPPKf0O0Ytq+LxSk78A96DLBhzflm3wL7lw/r3tJkeFaxsFPhR7m9rLXxLbocD8JTZxmaI5L/egyFMujY9Zcs3O1fIbtSTnnZrb8upJSIgM+TmZziQnCMzRikiNtBvUIj97IkUaG9zrPPP5yD5XwUKJNlkYSF/8+dMKrejiPLm91eRF7TktjHPSW1lJLmn2QmzUyxfrLDv/fuYS7vmRT1aXtTu+N8/pVlD0h+NZdTBRKfE4nFsCEqeg41WRzt6gB13GoZccy1a0l/nSmQl6X9z8MMs5kjFUvcueo6ZW6E2YErSDVH2lFHHKZLIryw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=WGg0pPkgSkpCmF7v6yR2DYkMkIR6Fot5aiOCBKpV/jg=; b=kF10COgrI/1EvpumBN5GOTgBDEwgJEpNUQ4C5J0dwhezWQus8p1iB1UslBBAakFYLpbNk+ijIWlC0aUoMosa9Jo7gDTUNkdrrq9i0+hU4ZH4p4cFwP+6Sgo/H47rETc0rULTEJ8HylwKc5Izag9z9iZ+LkPn0EvPU4SJlCPDfBQzKVXHTPjeKJPGKEFaHL+pI2sqEmyiMnisji34pgOFPOYpkeztbPkW/HbXun8mbFPSCnnZafVNCHln5rdZStb/hBQgq55eidn9NFhmFa1iDRO3UtwnIcLE4lKKxpecUx43994rLBa0vRVXKlqALL9venYEvUrJW4MLZGbHa5cGKg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=oss.nxp.com; dmarc=pass action=none header.from=oss.nxp.com; dkim=pass header.d=oss.nxp.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=NXP1.onmicrosoft.com; s=selector1-NXP1-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=WGg0pPkgSkpCmF7v6yR2DYkMkIR6Fot5aiOCBKpV/jg=; b=uoCkmc10VbzgA6f6yDISbXxch2CU8XA+ID4mBoPgGzNgS0STkLVlL+WGWQl8St6ppHUvaNOLzaqYjt+ZetQvtzkeepi7c84r5R18xS68F8wYfbPCoKTNIjHS3+JWeFJLE0LxtUb2Ot1ZY1faeWmxMEruPOU/hMbwnlLyzNUXbwAMzz3Tlu8SbVAKQMpmq5fNR20MsMgC+k5SCouECIR+1at1XjC9t7LYFcZojsTNnIcqitfo8Lr8BJfZ0De3QVMHNMS6F2OOIL5leos3SHMAHkYhK9uIbImOmg578m462zRfX8ahNrXjpJjiJIJ7DVL5aTI8dKjJZ08ni4e17fXNqw== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=oss.nxp.com; Received: from PAXPR04MB8254.eurprd04.prod.outlook.com (2603:10a6:102:1cd::24) by DB8PR04MB7115.eurprd04.prod.outlook.com (2603:10a6:10:128::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8356.14; Fri, 17 Jan 2025 07:58:01 +0000 Received: from PAXPR04MB8254.eurprd04.prod.outlook.com ([fe80::2755:55ac:5d6f:4f87]) by PAXPR04MB8254.eurprd04.prod.outlook.com ([fe80::2755:55ac:5d6f:4f87%6]) with mapi id 15.20.8356.014; Fri, 17 Jan 2025 07:58:01 +0000 From: Ming Qian To: mchehab@kernel.org, hverkuil-cisco@xs4all.nl Cc: nicolas@ndufresne.ca, shawnguo@kernel.org, robh+dt@kernel.org, s.hauer@pengutronix.de, kernel@pengutronix.de, festevam@gmail.com, linux-imx@nxp.com, xiahong.bao@nxp.com, eagle.zhou@nxp.com, tao.jiang_2@nxp.com, ming.qian@oss.nxp.com, imx@lists.linux.dev, linux-media@vger.kernel.org, linux-kernel@vger.kernel.org, linux-arm-kernel@lists.infradead.org Subject: [PATCH v2 2/2] media: amphion: Add a frame flush mode for decoder Date: Fri, 17 Jan 2025 16:57:20 +0900 Message-ID: <20250117075720.4018076-2-ming.qian@oss.nxp.com> X-Mailer: git-send-email 2.43.0-rc1 In-Reply-To: <20250117075720.4018076-1-ming.qian@oss.nxp.com> References: <20250117075720.4018076-1-ming.qian@oss.nxp.com> X-ClientProxiedBy: SI1PR02CA0016.apcprd02.prod.outlook.com (2603:1096:4:1f4::17) To PAXPR04MB8254.eurprd04.prod.outlook.com (2603:10a6:102:1cd::24) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: PAXPR04MB8254:EE_|DB8PR04MB7115:EE_ X-MS-Office365-Filtering-Correlation-Id: cc0c9295-3d4c-49d3-c336-08dd36ccaa1e X-MS-Exchange-SharedMailbox-RoutingAgent-Processed: True X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|7416014|376014|52116014|366016|1800799024|38350700014; X-Microsoft-Antispam-Message-Info: Zb5c2IMZ2ljom9zof+Zo2uXuAh7fbI+jFSeiuZmmNoODBwDhNym4g99eFwo8UlJeKsWa4XL0v/JjGoV/r9WitGCkcvLGc4gXVtMI/qufSKt+aEeDV9vdugWnT9pL7ajsdB9bb9a+gjJRCg0DYdm9GNakGAr7ez+rJu6c0Ewl63Rm4hbglwYrt63SkDfhi0D0DyB57oJgJ/ERBpCM7Q/mOlKxo/8rAKwm86IYt5ei8FtfRDMedkrfKMTqwxjeN/aPq79T6tPVem9MY7w1lm5QZ5ADxlbW6vLd5cUFAe8Fv5sM6CDDbkbUpbLVmnCIEI8/fKoB11eKYvxLc16Givu7OQLTouSnaiiJsIJpBG4lWLUla0XXU3I+26C/4ZgEGCWsohsuCbfPdP+66JUfdQPv/w7jidXYu2CJ5vB9NG/Oq8t+OrkWDOnm7T3KA+NETEdFucjX/CMpETe/VT6DFhfGQ2YXefv+Gfc7J2LNuFBy3uyUVz8VOOGLASWKRtgn7hswAv6lMV4hXZxosmZY7oTtDYgToKvpbC1YE+41xP/7o5n9FrTVyvRdXdNU5anf6LZX9HN3ANh+2UkF5goMY9S6Lic+6LFLwLYnTnxsWNNcYXDe7K8bw6lbL3/nKmxrPZLlVv0c+q6WlBfwgP/CycKcEG2g4WG7c4fSFD2oJre48YZrSnG5iA12N5lJ5cjYencJVxtF95nMm3VySfce+pCRVcUo/nSVGU+2AocH44/Zp0721YgMGxuqjQ5kOYBfSWBG5n+/Idc4tmM9rMgsiJxDJZfImUf7526aOfFRGghUxPBH6afmsQRL2kvhd5axGa+V7HLY3Cz1S5tnQjCySRICUHeEOr4gQTvWX8ejZN74EWEcpdZQJaYH6YtG0gw9SaxCFHK39FeTMTq0gBNDpz3/K1tkI29oEqVKESOOUtIed/qpZEt8fmmghaCUTouC5JiEUx0wRHlEwZzjB0ZPZ3xlq29m4hYmT9NE1cNsTs5Q6bRtjbM8q/sMZHEm4Ex5vBOIp66L2U2MV+2hSuyl/zPpmXxfBVB0/1SXpnN6mzF8j79AdWJz6fh1N9VdLzu7/KWl0lvDMwr8ojcPykYolnvPsjOkaLfweKzheJ5u3gi6N2wieZj+0v1QpvEeWOuPyBtcZnl7B+l7kN49f/5niOfHDhwJNLKPBBw27c8m1Bh5bK3dp0XIdbD3wFdefzGDtQIS7iMD2AGolpjihMa3mL1m99RNLG8Ef9frBgyVrWTBqDwHCGO/Qed7kNv2/hT718z9/7NWHarWLMA9+ncQIHII4m5hvtIzDEFlw9B0358rv5qdX7oUvL1mbVasl4yyXGruIFMIvs+uz8hMyeZ2Msn9P3bas77LEBF0AN8PSDG662wjt5JZagESgKstSAy3iE70imlHdPp9dVQhYrBkpM5gAnQXDYX4+MJ7HIjZgW1SeGOvNXkhJkJ2+nXLjHN4fVhG X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:PAXPR04MB8254.eurprd04.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(7416014)(376014)(52116014)(366016)(1800799024)(38350700014);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: 3MsmHpXvRfmWRi65SORsqlVG9sho9fvVEy7VTZYNErQMnqn8j/mzKvslncXbBKzxD2AE+RhSh4MFEZ5Mu5Sma/x5esrsasVoq0Z56app2ExhpyrKLAT9hF16ivbPPlr/e/2s9toQJXDsNKcIXwr98Af4Rv9qY6i0VkhmEZATKWY1sSUBxy606SirmORWrCHZ6qKp8gF8t/2+hxVRFWFW4wfffqMITScvS4i7cQ0iItqvf60KjF6OrpZLBjNZoMjvbAarHwEFtj5+qYisEVIEasat2w32OmX14tkbUrQOLnKM36scUqRsh2YT5MgCSUULJYu23bFBpOKZe737oUPeUwQZ4EvFID8zK0mK2Itc9nWFrmLfD9rJyzT8++hxMoi+hjhfCRpfe+0csbqQOAmsDczGC6bHuA6TEpYeXTxEkBz4uYUYkvN9jKJCAMOMV4duC1Jaq0SzqztG/4c0ztsQIsstzAu7Unf5ZU1b1AP8Rp+m07igCnISUJQ4CMnj7X9aV6XGIh3Pu9hNi+ZqOv8JHc2sbdcsc9PjKSgbEX962whIxBK6IPiTOLQ6lrMf6Mx1yQV8w3WXcFDknVb0e5n8sunXde/uyZNOWCdN8M5VL/FSfb8WYkpr28OKMHWm4tHVGbckMU2YPyODLv3MWcpHeE4ttZIJkH/srZikRTejb3jax6lXTY8ey++g/11dBOcuBnf44QvqHItiYsSumVsCN5o6umbfO/jFCjaHYPexWsra2+6MMFUjKhT3aBqtApUahpffLtb46ySCKVVk/qRgxTiftmFboJRbSVV9trarrssmttZjw6Y/bP16SaHR9f0x5vOldE/Yd1ppW1K9G+PBQyZlVIn3fsssf0krlv+yv+GlWVFeML0xJmAnqjlMHNueSJ/iEzGKBJI6E9U/uXZ5WBjDAtkBqmtDsuYE61pcY9qb5UkyZgyYvKMpiPpKnY+KvbtWOX3RAHjzFtEeZmQ+plfQEYwBjPwiwbXfYypWO6+IVypgyRYqiKdRuXM3QNffflkkE+/xGpART2FEIqr8FcDTfmCbBZEoTZPNjOlJ+r+ltYq/rYVZLk8tqaguGhYR5VkcI7uXZgD5YBFHkCZWrdWGnyz2QGDX05IsyH5dBL2JIU8SufI6OCu32HoTP/5B4b+PR7FguWTkhcm3qP4tBQ7kre8BK6NQr/vOXRbMFPcS+D36opAo4htCaGgYDoaz8LUa8e4Oi+Sz6B4sUn3tdT+X9GJ+McTw+N64vcK5B5PB/LXBgoIsU8Xh7I+37po2n/kuOahkFyA4ALaYW78a/M4mrt0xis9VoaJ7VB4H744ITX5c8X6F7MGOJPMWpPYVaY+VIoa7r5XwJXJPM5C95vR7yQJ0wm0N+rpHApX9b9PXuKeFWX1o1On+c9Sy+OocPcqvS8RSJGbfotPDUQIQ3SigvajDi22TybmFZh8Dck/sxaHqGMwekSwdbb5OhfJUkAASKvFiejmKe3Sb9t7bZvyyIf/8FMq9uH0co+BkL6BkBU+UYaQQngN+W0gkVX5devK9G2s9OeX+v8+cYDBe0HzLAVE2eonJGUkArvrW+R2LvvAu5plJ+BS+aivyTdjP X-OriginatorOrg: oss.nxp.com X-MS-Exchange-CrossTenant-Network-Message-Id: cc0c9295-3d4c-49d3-c336-08dd36ccaa1e X-MS-Exchange-CrossTenant-AuthSource: PAXPR04MB8254.eurprd04.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 17 Jan 2025 07:58:01.3641 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 686ea1d3-bc2b-4c6f-a92c-d99c5c301635 X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: 7C26cgvi1ekFkGlB5G/iZj/hPmwDhUO/p8X1vHwv/vGMSZnlnay410c9OjQKA6P4KluVDfsXfOnZpqTrbKGbUg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB8PR04MB7115 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20250116_235804_248983_C6F5278F X-CRM114-Status: GOOD ( 14.59 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org The amphion decoder will pre-parse 3 frames before decoding the first frame. If we append a flush padding data after frame, the decoder will finish parsing and start to decode when the flush data is parsed. It can reduce the decoding latency. In the past, we only enable this mode when the display delay is set to 0. But we still can enable this mode without changing the display order, so we add a frame_flush_mode parameter to enable it. Signed-off-by: Ming Qian --- drivers/media/platform/amphion/vpu_malone.c | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/drivers/media/platform/amphion/vpu_malone.c b/drivers/media/platform/amphion/vpu_malone.c index 1d9e10d9bec1..f07660dc3b07 100644 --- a/drivers/media/platform/amphion/vpu_malone.c +++ b/drivers/media/platform/amphion/vpu_malone.c @@ -25,6 +25,9 @@ #include "vpu_imx8q.h" #include "vpu_malone.h" +static bool frame_flush_mode; +module_param(frame_flush_mode, bool, 0644); + #define CMD_SIZE 25600 #define MSG_SIZE 25600 #define CODEC_SIZE 0x1000 @@ -1579,7 +1582,7 @@ static int vpu_malone_input_frame_data(struct vpu_malone_str_buffer __iomem *str vpu_malone_update_wptr(str_buf, wptr); - if (disp_imm && !vpu_vb_is_codecconfig(vbuf)) { + if ((disp_imm || frame_flush_mode) && !vpu_vb_is_codecconfig(vbuf)) { ret = vpu_malone_add_scode(inst->core->iface, inst->id, &inst->stream_buffer,