From patchwork Sun Oct 30 17:18:05 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Hsia-Jun Li X-Patchwork-Id: 13025146 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 389E8ECAAA1 for ; Sun, 30 Oct 2022 17:20:06 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:MIME-Version:Message-Id:Date:Subject:Cc :To:From:Reply-To:Content-ID:Content-Description:Resent-Date:Resent-From: Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:In-Reply-To:References: List-Owner; bh=dELxIVTPPrbM6frvaHrFO48Txq55U/tq0eIVORNVJH0=; b=FatPGQL52tTARw o+SuzjmObpRmp2c22HLdxz7VMOpSCEiA6KwYTIJJAQVZdyMKTTM9MxuxWDoUMM+6ysJAbzrITJhGq WIFVP1ZyccEpbIXDn9sXvTTf2OLSgXQZBkyWXatQc5zIiL0Opcdqn2jdEO+lKOKwHAHXO39/4mFkz Q3yCOdWqNW5+pwN7jG3IYnlxbGRhF/w38H4FyQhvJ9olchgWOFhiMTZclstlKuJ08SWr7a6XU67fj lAQ/d7F0vKRd/PZ5tw+MeM7dB6vkaYSa8P012aZEyPEHgHr5SAhWDobHM+r9xrr9DzGAyZg39qQC9 pomFTEG22BC+7mTVXHCA==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.94.2 #2 (Red Hat Linux)) id 1opBxc-0012Gt-Hl; Sun, 30 Oct 2022 17:19:00 +0000 Received: from mail-co1nam11on2076.outbound.protection.outlook.com ([40.107.220.76] helo=NAM11-CO1-obe.outbound.protection.outlook.com) by bombadil.infradead.org with esmtps (Exim 4.94.2 #2 (Red Hat Linux)) id 1opBxZ-0012AQ-3X for linux-arm-kernel@lists.infradead.org; Sun, 30 Oct 2022 17:18:59 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=NXSdS9xq2cZWp6FliUXm3Fw2d7R5AxsJ74NH8T8RgiJ8KQpM62WhrCP4z7k8Nz1QIYW1ygvRGr0lm+jS4dgBJzur3Hk0f+tM8GxMUU6xqg4OU4LnY/XLXuWhHOlvzV9vg8mCyabQZuapFY0HrCyOtWfaXNzKlb0THSsrqd6t3N447S3i9WcHtylwlSqivrBHYpCno9A74oGlETamT+MPwt5xhMNLy/iD4svJD3lQCyvsAvoNAdlHt8E7AmKcivLQdimMXhy5SDCvW4A4rWgjGdsaRiTEyrJ4pHf0d6NJGyaHz49f3/Ie0qkBNSC50I4wxK5Y/SfpDR8Rg/pVVRQeGA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=oBEB+XU1Y3v8CgpdrFfFMlqIo9NuepkdHNtccG1o9XU=; b=XXVPH5Ijf7SGMlKbVzvJgxcfKM+NhS6iMoyNOh9f83DTW5Uw0JEI9O0SFT/3GETD4mBAm+br8PWCUVaeRN1DGa9xwBS6qWLz81Q92KjnnuqkujitYcKezR/3VOOCGcrtYNi0bIakzgbLekPAxAWeVh+W2sN1E3TQUFASqWTDI2wXbOSN67BNpz1CikrF6Pq0eaRRUjhGEHTDFOOVdIjB8r176LJ7kQlw/FgPMgPm8zvdqenkbiwE1twVvnVIR24KvDV7xjBlnHA99ObmxadPcHJzzeoBu1qQq8siRtcla3mBpn+lb3uTcjaIALmizFch0moExJUCQoANCb/HYejivQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=synaptics.com; dmarc=pass action=none header.from=synaptics.com; dkim=pass header.d=synaptics.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Synaptics.onmicrosoft.com; s=selector2-Synaptics-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=oBEB+XU1Y3v8CgpdrFfFMlqIo9NuepkdHNtccG1o9XU=; b=WnJtzsYzTNs6pa+Z2mwfy1qqtUkB79AwZ2YbfMcbZs+L9PXAwf3EUA8YHEJu/b85nGry3HEhBjAalXWrRJMyFWDtv6ZswjjfybPSLs87pVL8k2hcnkmfwWmuDGbucQ5V+5Giqk9Qqwk2bdb1AQN6bpzTfKlEvmyJKgi08vojpUM= Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=synaptics.com; Received: from DM6PR03MB5196.namprd03.prod.outlook.com (2603:10b6:5:24a::19) by DS7PR03MB5637.namprd03.prod.outlook.com (2603:10b6:5:2ca::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5769.16; Sun, 30 Oct 2022 17:18:50 +0000 Received: from DM6PR03MB5196.namprd03.prod.outlook.com ([fe80::a132:66d9:ed0f:e5c1]) by DM6PR03MB5196.namprd03.prod.outlook.com ([fe80::a132:66d9:ed0f:e5c1%6]) with mapi id 15.20.5769.019; Sun, 30 Oct 2022 17:18:50 +0000 From: Hsia-Jun Li To: dri-devel@lists.freedesktop.org Cc: maarten.lankhorst@linux.intel.com, mripard@kernel.org, tzimmermann@suse.de, airlied@linux.ie, daniel@ffwll.ch, mchehab@kernel.org, hverkuil-cisco@xs4all.nl, ezequiel@vanguardiasur.com.ar, sakari.ailus@linux.intel.com, ribalda@chromium.org, linux-media@vger.kernel.org, linux-kernel@vger.kernel.org, tfiga@chromium.org, sebastian.hesselbarth@gmail.com, jszhang@kernel.org, linux-arm-kernel@lists.infradead.org, laurent.pinchart@ideasonboard.com, nicolas@ndufresne.ca, helen.koike@collabora.com, "Hsia-Jun(Randy) Li" Subject: [PATCH v2 0/2] Add pixel formats used in Synatpics SoC Date: Mon, 31 Oct 2022 01:18:05 +0800 Message-Id: <20221030171807.55837-1-randy.li@synaptics.com> X-Mailer: git-send-email 2.37.3 X-ClientProxiedBy: BYAPR05CA0010.namprd05.prod.outlook.com (2603:10b6:a03:c0::23) To DM6PR03MB5196.namprd03.prod.outlook.com (2603:10b6:5:24a::19) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DM6PR03MB5196:EE_|DS7PR03MB5637:EE_ X-MS-Office365-Filtering-Correlation-Id: 05f96525-ab6d-4952-169c-08daba9acfd5 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: jJ6C5v08r24ALfLwK2pOzKq8QYxA2yX1MSo8RRhWert09J2SxvFCKJMV8f+99befMZKs51yy9AI+Ic9oqWHgm3Wsp4mpDa2HbKCaPJd82y719/ViooswnJqW2ftiFYkrLuaMuMJ1GRjobxNLuVYJB62kNtudqYSbU3uGAzkKtyMqR6PcnbuZ5LS5ZL3dIi4oHA7u8Ib8kmQ4DWlorGS2ZdovFQ82Z8ZQfSwx4M9GdjKw50nJDsi/Qyy4vaTlasbqBpD/4o8mMMFQNmt6zL1JPCcbVAtWvOKO8n5yy0mIPqbNhv0EQ7ldgvSKTQUs1HSMUr7UKFV4fCy4cFfHFpz+GcdET7iC5jX0/t08+yiwXWqj0pe5j9En9rLFL+ThhBDBYOP81yYO9uobt0w3EVxOoTGj5/sdZS+3aZjbcgUytRQi09IoQeLWAUzAgRbR3kQXnIgB3aB17DdKYmGPtnEn6vzRK5p8JMJl3ldOiu79ep2xlQyb6Ib7+w3YnjADZVtvoRyP34cf1AQXMvvQik2d9woBkmvSrD85fiPvXLUcbGb09QSnqqLZGctEZmmxm/dZXvd29OYufx5cCYQKJJTcHSZurgAWmWTRxNgNTSy/MVK8K3HmmnnivyKOfqgY7jrcBeKLLlMpy8cbpE8hrTBYoiBu+4NKKvW1iK8bfSK1vvvalDogztjoi1Zl3qX64GKOzzmx3y8BqoM4oSXOBzkAV0KUXom+rmwtYu+NMYKh6k8TATinqV6L70hLxHw9fjw6lDCITRVak9lKj/InwEUvtHuAc88YOP/FUmMkE6uFM8w= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DM6PR03MB5196.namprd03.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230022)(39860400002)(366004)(346002)(136003)(376002)(396003)(451199015)(6486002)(966005)(6506007)(107886003)(6666004)(478600001)(316002)(6916009)(38350700002)(6512007)(2616005)(36756003)(1076003)(26005)(52116002)(38100700002)(83380400001)(186003)(2906002)(86362001)(4326008)(66556008)(8676002)(66476007)(66946007)(41300700001)(8936002)(5660300002)(7416002);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: +hPhZ4PBN2ex7EBpbgPOZ9pJH9xipQDrZDsr5pihugS7l8CmiwM8aDwWyxfTDJFcmi3d1ZygvNQ4Glpv6AWdZeUNRKX13Hy82RAJC6K4GwV7EIL8p3dXVyQqiscJQ/xxYATvZsjZoanMG+D00UmEGdWFM3R0JXYUGWJ4zDS4bkZFRaZIek9M7d8gBaeWA98ofT99+l+NgHm8DfKFvl8LF8ftbYO0S1aG3G/5+oAjSqH9SSMtuZOKe9wX762YFlrjhlyAkd+JBoHHPbNfwN83hCeiU8cLVWO8b7EU+tDopun/N9ykXwMd7Ymgnyp+srCbatlxxnz4xO8ttfS1nfbHIvZwYVlnE+7yUkQZ88Sm6ruNCn996yUuNAIz2nWKgXL9cNAv8uy057hzXAml23fNNW9YTiUzAlrtEgcWxg7s6N9dWAuXKfK1ZhcugSgA3UUF0oXTMbXReJTPq6FhAqsYn4E3aOaSRKjbIKC17G1Y1RGak/xdhvPonxf2XOLxBE7/Tqli6SszJ/TUYy5keSR/SUZ6oDpFErdmO2yEk8zABXcnvoNUgLJXYtXI9vkU+RB8oIQxWNN2i3I3URIyYLXAcbeVi5Uz2h4LK0tC4CYtulqG/x78vxUo8rRMNUB4uScJqK3x56Q+ho/eDeZPwACsGU0/3E8vUfMfJnRBD2MlVnxS0xdM699lxUEoBvDtyyO9wN0Gt638bM9VdI9LE3ophp35iMHqt8nGsvIkw4z326orJAqBk2Hq//BuJQw0gvYuAiivGywiU3GQ+xcQ+5RjHipn6/k9BLXEFU+qUd+VUcXq10FNMY3B1nfIDIBq7VSfaZ13lBG8lqN1/Tdb9ZiOg1B7/cl/mz5PtY6/xliDk9mDOoyim6VcFEAWc1qcdLKoFfnKcYsV0eLvsp+Jjsmsd2m2m1VrPl3RBV5kiSBISVAaORQK9Rvq8NNvROcP/aN0wdRjcXyISjse1gVJ/hJ4hTfcVrWWPaGm5Pb3mKg8R5vLyy1J5JdFC4DSALe2Sfmp615OnAk+ZttCpxeA6VI2T2eY97gSW/ngG0GuLN6ReqJkIZopQSrI7K8mQy96nYGW7I1KP71BIq5ieb0e8cQMabk150/Zzu4+sIUfiVORCx6EMbz5ZwMzQ5nSO3mLepE8U/KCHUq5K9Ic3CPMEHs2ZVzxcKEVESlhw4B6hzaz/vZVyYXZsl1XAc4SveJ4eJqZ15hnWNuiL5Q/Kp36T5ZLJTBJW4gcwxHfDsw+16uxqOD3c9AaOxJZsyubIVAN1XdfwDuXVon7NdgWcN8Mrc2ZXdoLeYRjGLzMIgpjRP8Tb3V9VMQqkFwqZEo8yhOIRJj/QvrQlvogANCRj+WCinEz1jEZDjLXXd7EIM3nqywt349u1gtRnugpYYMqxCtKZnHM1ndAJsuDymq6RxzvW9sR0fqOii4BokDfLsgCzzqE96ZD/yV/hIlYxdiCeSzsU53BK5Jpg/ZZ7jr2/EAALpNkvnIPtDgjVn8+2jQq2ltL4u2yU2ChUN4e5/VnttxXTX9JW93M10n+7LfcShgjRsabNxWdiMIfbE+N3jiqG7+YseBFPdBPc6S16ced0ynPMrWE X-OriginatorOrg: synaptics.com X-MS-Exchange-CrossTenant-Network-Message-Id: 05f96525-ab6d-4952-169c-08daba9acfd5 X-MS-Exchange-CrossTenant-AuthSource: DM6PR03MB5196.namprd03.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 30 Oct 2022 17:18:50.4361 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 335d1fbc-2124-4173-9863-17e7051a2a0e X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: koDeBjE6nd3jjRndjQ//5iVjz7KA1CPtYpTG8fu7Kl6DJna1lndXw5Xp/NdDg/M1CKaWEubHGP9/4e4fB2aw9Q== X-MS-Exchange-Transport-CrossTenantHeadersStamped: DS7PR03MB5637 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20221030_101857_317970_BF181164 X-CRM114-Status: GOOD ( 11.95 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org From: "Hsia-Jun(Randy) Li" Those pixel formats are used in Synaptics's VideoSmart series SoCs, likes VS640, VS680. I just disclose the pixel formats used in the video codecs and display pipeline this time. Actually any device connected to the MTR module could support those tiled and compressed pixel formats. The more detail about MTR module could be found in the first patch of this serial of mail. We may not be able to post any drivers here in a short time, the most of work in this platform is done in the Trusted Execution Environment and we didn't use the optee event its client framework. Please notice that, the memory planes used for video codecs could be one more than display case. That extra planes in the video codecs is for the decoding internally usage, it can't append the luma or chroma buffer as many other drivers do, because this buffer could be only accessed by the video codecs itself, it requests a different memory security attributes. There is not a proper place in v4l2 m2m to allocate a large size buffer, we don't know when the users won't allocate more graphics buffers. Although we could allocate it in a step likes STREAMON, it would lead unusual delaying in starting of video playbacl. https://synaptics.com/products/multimedia-solutions Changlog v2: The DRM modifiers in the first draft is too simple, it can't tell the tiles in group attribute in memory layout. Removing the v4l2 fourcc. Adding a document for the future v4l2 extended fmt. v1: first draft of DRM modifiers Try to put basic tile formats into v4l2 fourcc Hsia-Jun(Randy) Li (1): drm/fourcc: Add Synaptics VideoSmart tiled modifiers Randy Li (1): media: docs: Add Synpatics tile modifiers .../media/v4l/pixfmt-synaptics.rst | 80 +++++++++++++++++++ .../userspace-api/media/v4l/pixfmt.rst | 1 + include/uapi/drm/drm_fourcc.h | 75 +++++++++++++++++ 3 files changed, 156 insertions(+) create mode 100644 Documentation/userspace-api/media/v4l/pixfmt-synaptics.rst