From patchwork Tue Apr 27 12:45:18 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Tomi Valkeinen X-Patchwork-Id: 12226677 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-18.8 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER, INCLUDES_PATCH,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED, USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 9262BC433ED for ; Tue, 27 Apr 2021 12:46:28 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 6FE9F613C3 for ; Tue, 27 Apr 2021 12:46:28 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S236416AbhD0MrK (ORCPT ); Tue, 27 Apr 2021 08:47:10 -0400 Received: from perceval.ideasonboard.com ([213.167.242.64]:45386 "EHLO perceval.ideasonboard.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S237769AbhD0MrF (ORCPT ); Tue, 27 Apr 2021 08:47:05 -0400 Received: from deskari.lan (91-157-208-71.elisa-laajakaista.fi [91.157.208.71]) by perceval.ideasonboard.com (Postfix) with ESMTPSA id 7A5092041; Tue, 27 Apr 2021 14:46:20 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ideasonboard.com; s=mail; t=1619527581; bh=5ngqi+w9DoUkqSpgf+DrbqNc8V6Fl3IfklVOCpsXYSY=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=lVbRxhEYTMtFroLEPIH2/R47Qer2I6/iS7LKGrhUCvJIk0/PcBs6aVEYLRAYxiEVP xE2cFMJmJdFxsTN5BqE0f0Oz8M4uj1X+SamJ95cHgGJUb9NMi5krOuW6vyr4ro/Ekk LgD8LQINzMJ3jq+8+dOLhyRcPnt9Bqq6EA8ireeQ= From: Tomi Valkeinen To: linux-media@vger.kernel.org, sakari.ailus@linux.intel.com, Jacopo Mondi , Laurent Pinchart , niklas.soderlund+renesas@ragnatech.se Cc: Mauro Carvalho Chehab , Hans Verkuil , Tomi Valkeinen Subject: [PATCH v6 19/24] media: Documentation: Add GS_ROUTING documentation Date: Tue, 27 Apr 2021 15:45:18 +0300 Message-Id: <20210427124523.990938-20-tomi.valkeinen@ideasonboard.com> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20210427124523.990938-1-tomi.valkeinen@ideasonboard.com> References: <20210427124523.990938-1-tomi.valkeinen@ideasonboard.com> MIME-Version: 1.0 Precedence: bulk List-ID: X-Mailing-List: linux-media@vger.kernel.org From: Jacopo Mondi Add documentation for VIDIOC_SUBDEV_G/S_ROUTING ioctl and add description of multiplexed media pads and internal routing to the V4L2-subdev documentation section. Signed-off-by: Jacopo Mondi Signed-off-by: Tomi Valkeinen --- .../userspace-api/media/v4l/dev-subdev.rst | 125 ++++++++++++++++ .../userspace-api/media/v4l/user-func.rst | 1 + .../media/v4l/vidioc-subdev-g-routing.rst | 138 ++++++++++++++++++ 3 files changed, 264 insertions(+) create mode 100644 Documentation/userspace-api/media/v4l/vidioc-subdev-g-routing.rst diff --git a/Documentation/userspace-api/media/v4l/dev-subdev.rst b/Documentation/userspace-api/media/v4l/dev-subdev.rst index fd1de0a73a9f..ff922347f099 100644 --- a/Documentation/userspace-api/media/v4l/dev-subdev.rst +++ b/Documentation/userspace-api/media/v4l/dev-subdev.rst @@ -29,6 +29,8 @@ will feature a character device node on which ioctls can be called to - negotiate image formats on individual pads +- inspect and modify internal data routing between pads of the same entity + Sub-device character device nodes, conventionally named ``/dev/v4l-subdev*``, use major number 81. @@ -501,3 +503,126 @@ source pads. :maxdepth: 1 subdev-formats + + +Multiplexed media pads and internal routing +------------------------------------------- + +Routing Table +^^^^^^^^^^^^^ + +Subdevice drivers may expose the internal connections between media pads of an +entity by exposing a routing table that applications can inspect and manipulate. +A routing table is described by a struct :c:type:`v4l2_subdev_routing`, which +contains ``num_routes`` route entries, each one represented by a struct +:c:type:`v4l2_subdev_route`. + +Data routes do not just connect one pad to another in an entity, but they refer +instead to the ``streams`` a media pad provides. Streams are data connection +endpoints in a media pad. Multiplexed media pads expose multiple ``streams`` +which represent, when the underlying hardware technology allows that, logical +data flows transported over a single physical media bus. + +A noteworthy example of logical stream multiplexing techniques is represented +by the data interleaving mechanism implemented by mean of Virtual Channels as +defined by the MIPI CSI-2 media bus specifications. A subdevice that implements +support for Virtual Channel data interleaving might expose up to 4 data +``streams``, one for each available Virtual Channel, on the source media pad +that represents a CSI-2 connection endpoint. + +A route is defined as a connection between a ``(sink_pad, sink_stream)`` pair +and a ``(source_pad, source_stream)`` pair, where ``sink_pad`` and +``source_pad`` are the indexes of two media pads part of the same media entity, +and ``sink_stream`` and ``source_stream`` are the identifiers of the data +streams to be connected in the media pads. The stream identifiers are arbitrary +numbers, i.e. they have no relevance to the hardware, but they must be unique on +a single pad, and the entity on the other side of the link must have a matching +stream identifier. + +The current routes are reported to applications in a routing table which can be +inspected using the :ref:`routing ` ioctl. + +Routes can be added or removed by adding or removing them to/from the routing +table. Also, a route in the routing table can be activated and deactivated by +setting or clearing the ``V4L2_SUBDEV_ROUTE_FL_ACTIVE`` flag in the ``flags`` +field of struct :c:type:`v4l2_subdev_route`. + +A subdev driver may create routes that cannot be modified by applications. Such +routes are identified by the presence of the ``V4L2_SUBDEV_ROUTE_FL_IMMUTABLE`` +flag in the ``flags`` field of struct :c:type:`v4l2_subdev_route`. + +As an example, a subdevice with two sink pads and one output pad has the pads +defined as follows: + +.. flat-table:: + :header-rows: 1 + + * - Pad Index + - Function + * - 0 + - SINK + * - 1 + - SINK + * - 2 + - SOURCE + +A case where the subdevice would receive a single stream via each sink pad, and +combine them to the source pad would result in a routing table as follows: + +.. flat-table:: routing table + :header-rows: 1 + + * - Sink Pad/Sink Stream + - Source Pad/Source Stream + * - 0/0 + - 2/0 + * - 1/0 + - 2/1 + +Whereas if the same subdev would receive two streams via each sink pad, and +output the combined 4 streams would result in a routing table as follows: + +.. flat-table:: routing table + :header-rows: 1 + + * - Sink Pad/Sink Stream + - Source Pad/Source Stream + * - 0/0 + - 2/0 + * - 0/1 + - 2/1 + * - 1/0 + - 2/2 + * - 1/1 + - 2/3 + +Some subdevices may have immutable routes or a known set of routes which can be +activated or deactivated. An example would be a sensor which produces pixel data +and metadata via CSI-2 bus. The sensor would be modelled as two subdevices: a +producer and a mux. The producer would have two source pads providing the pixel +stream in the first pad and the metadata in the second pad. The mux subdevice +would combine these two streams into a single source pad, and provide +multiplexed streams. The mux subdevice would always have two routes. + +A subdevice that does not produce the data is another matter. Consider a device +with two CSI-2 sink pads and two CSI-2 source pads, with the ability to route +streams freely between the sink and source pads based on HW configuration. Each +sink pad could receive streams for all four CSI-2 virtual channel. If we only +consider the virtual channels, we would have maximum number of routes of 8. + +But CSI-2 also defines a datatype for each CSI-2 packet, allowing one to send, +say, pixel data and metadata using the same virtual channel but different +datatype. Now we would have a maximum number of routes of 16. + +Generally speaking, the concept of "stream" is very flexible. As a contrived +example, you might even consider each line of a pixel frame to be a separate +stream, if your hardware would support such a thing. + +Multiplexed Streams +^^^^^^^^^^^^^^^^^^^ + +When a subdevice exposes multiple streams in a single pad (multiplexed streams), +the pad cannot be used to get or set the stream configuration with e.g. +``VIDIOC_SUBDEV_S_FMT``. Such ioctls must return -ENOIOCTLCMD for pads with +multiple streams. There must be a non-multiplexed source pad for each stream, +and this pad must be used to configure the stream. diff --git a/Documentation/userspace-api/media/v4l/user-func.rst b/Documentation/userspace-api/media/v4l/user-func.rst index 53e604bd7d60..228c1521f190 100644 --- a/Documentation/userspace-api/media/v4l/user-func.rst +++ b/Documentation/userspace-api/media/v4l/user-func.rst @@ -70,6 +70,7 @@ Function Reference vidioc-subdev-g-crop vidioc-subdev-g-fmt vidioc-subdev-g-frame-interval + vidioc-subdev-g-routing vidioc-subdev-g-selection vidioc-subdev-querycap vidioc-subscribe-event diff --git a/Documentation/userspace-api/media/v4l/vidioc-subdev-g-routing.rst b/Documentation/userspace-api/media/v4l/vidioc-subdev-g-routing.rst new file mode 100644 index 000000000000..8828f7e49536 --- /dev/null +++ b/Documentation/userspace-api/media/v4l/vidioc-subdev-g-routing.rst @@ -0,0 +1,138 @@ +.. SPDX-License-Identifier: GFDL-1.1-no-invariants-or-later +.. c:namespace:: V4L + +.. _VIDIOC_SUBDEV_G_ROUTING: + +****************************************************** +ioctl VIDIOC_SUBDEV_G_ROUTING, VIDIOC_SUBDEV_S_ROUTING +****************************************************** + +Name +==== + +VIDIOC_SUBDEV_G_ROUTING - VIDIOC_SUBDEV_S_ROUTING - Get or set routing between streams of media pads in a media entity. + + +Synopsis +======== + +.. c:function:: int ioctl( int fd, VIDIOC_SUBDEV_G_ROUTING, struct v4l2_subdev_routing *argp ) + :name: VIDIOC_SUBDEV_G_ROUTING + +.. c:function:: int ioctl( int fd, VIDIOC_SUBDEV_S_ROUTING, struct v4l2_subdev_routing *argp ) + :name: VIDIOC_SUBDEV_S_ROUTING + + +Arguments +========= + +``fd`` + File descriptor returned by :ref:`open() `. + +``argp`` + Pointer to struct :c:type:`v4l2_subdev_routing`. + + +Description +=========== + +These ioctls are used to get and set the routing in a media entity. +The routing configuration determines the flows of data inside an entity. + +Drivers report their current routing tables using the +``VIDIOC_SUBDEV_G_ROUTING`` ioctl and application may enable or disable routes +with the VIDIOC_SUBDEV_S_ROUTING ioctl, by adding or removing routes and setting +or clearing the ``V4L2_SUBDEV_ROUTE_FL_ACTIVE`` flag of the ``flags`` field of +a struct :c:type:`v4l2_subdev_route`. + +When inspecting routes through VIDIOC_SUBDEV_G_ROUTING and the application +provided ``num_routes`` is not big enough to contain all the available routes +the subdevice exposes, drivers return the ENOSPC error code and adjust the +value of the ``num_routes`` field. Application should then reserve enough memory +for all the route entries and call VIDIOC_SUBDEV_G_ROUTING again. + +.. tabularcolumns:: |p{4.4cm}|p{4.4cm}|p{8.7cm}| + +.. c:type:: v4l2_subdev_routing + +.. flat-table:: struct v4l2_subdev_routing + :header-rows: 0 + :stub-columns: 0 + :widths: 1 1 2 + + * - __u32 + - ``which`` + - Format to modified, from enum + :ref:`v4l2_subdev_format_whence `. + * - struct :c:type:`v4l2_subdev_route` + - ``routes[]`` + - Array of struct :c:type:`v4l2_subdev_route` entries + * - __u32 + - ``num_routes`` + - Number of entries of the routes array + * - __u32 + - ``reserved``\ [5] + - Reserved for future extensions. Applications and drivers must set + the array to zero. + +.. tabularcolumns:: |p{4.4cm}|p{4.4cm}|p{8.7cm}| + +.. c:type:: v4l2_subdev_route + +.. flat-table:: struct v4l2_subdev_route + :header-rows: 0 + :stub-columns: 0 + :widths: 1 1 2 + + * - __u32 + - ``sink_pad`` + - Sink pad number. + * - __u32 + - ``sink_stream`` + - Sink pad stream number. + * - __u32 + - ``source_pad`` + - Source pad number. + * - __u32 + - ``source_stream`` + - Source pad stream number. + * - __u32 + - ``flags`` + - Route enable/disable flags + :ref:`v4l2_subdev_routing_flags `. + * - __u32 + - ``reserved``\ [5] + - Reserved for future extensions. Applications and drivers must set + the array to zero. + +.. tabularcolumns:: |p{6.6cm}|p{2.2cm}|p{8.7cm}| + +.. _v4l2-subdev-routing-flags: + +.. flat-table:: enum v4l2_subdev_routing_flags + :header-rows: 0 + :stub-columns: 0 + :widths: 3 1 4 + + * - V4L2_SUBDEV_ROUTE_FL_ACTIVE + - 0 + - The route is enabled. Set by applications. + * - V4L2_SUBDEV_ROUTE_FL_IMMUTABLE + - 1 + - The route is immutable. Set by the driver. + +Return Value +============ + +On success 0 is returned, on error -1 and the ``errno`` variable is set +appropriately. The generic error codes are described at the +:ref:`Generic Error Codes ` chapter. + +ENOSPC + The number of provided route entries is less than the available ones. + +EINVAL + The sink or source pad identifiers reference a non-existing pad, or reference + pads of different types (ie. the sink_pad identifiers refers to a source pad) + or the sink or source stream identifiers reference a non-existing stream on + the sink or source pad.