Commit b1bc554e authored by Linus Torvalds's avatar Linus Torvalds
Browse files

Merge tag 'media/v6.11-1' of git://git.kernel.org/pub/scm/linux/kernel/git/mchehab/linux-media 

Pull media updates from Mauro Carvalho Chehab:

 - New sensor drivers: gc05a2, gc08a3 and imx283

 - New serializer/deserializer drivers: max96714 and max96717

 - New JPEG encoder driver: e5010

 - Support for Raspberry Pi PiSP Backend (BE) ISP driver

 - Old documentation for av7110 driver removed, as a new version was
   added as Documentation/userspace-api/media/dvb/legacy*.rst

 - atompisp: Linux firmwares are now available, so drop firmware-related
   task from TODO and update firmware logic

 - The imx258 driver has gained several improvements

 - wave5 driver has gained support for HEVC decoding

 - em28xx gained support for MyGica UTV3

 - av7110 budget-patch driver removed

 - Lots of other cleanups, improvements and fixes

* tag 'media/v6.11-1' of git://git.kernel.org/pub/scm/linux/kernel/git/mchehab/linux-media: (301 commits)
  media: raspberrypi: Switch to remove_new
  media: uapi: pisp_be_config: Add extra config fields
  media: uapi: pisp_be_config: Re-sort pisp_be_tiles_config
  media: uapi: pisp_common: Capitalize all macros
  media: uapi: pisp_common: Add 32 bpp format test
  media: uapi: pisp_be_config: Drop BIT() from uAPI
  media: stm32: dcmipp: correct error handling in dcmipp_create_subdevs
  media: atomisp: Fix spelling mistakes in sh_css_sp.c
  media: atomisp: Fix spelling mistake in ia_css_debug.c
  media: atomisp: Fix spelling mistake in hmm_bo.c
  media: atomisp: Fix spelling mistake in ia_css_eed1_8.host.c
  media: atomisp: Fix spelling mistake in sh_css_internal.h
  media: atomisp: Fix spelling mistake "pipline" -> "pipeline"
  media: atomisp: Remove unused GPIO related defines and APIs
  media: atomisp: Replace COMPILATION_ERROR_IF() by static_assert()
  media: atomisp: Clean up unused macros from math_support.h
  media: atomisp: csi2-bridge: Add DMI quirk for OV5693 on Xiaomi Mipad2
  media: atomisp: Update TODO
  media: atomisp: Prefix firmware paths with "intel/ipu/"
  media: atomisp: Remove firmware_name module parameter
  ...
parents 0ffb8a4c 68a72104

Documentation/admin-guide/media/em28xx-cardlist.rst

+8 −0
Original line number Diff line number Diff line
@@ -438,3 +438,11 @@ EM28xx cards list 
     - MyGica iGrabber

     - em2860

     - 1f4d:1abe

   * - 106

     - Hauppauge USB QuadHD ATSC

     - em28274

     - 2040:846d

   * - 107

     - MyGica UTV3 Analog USB2.0 TV Box

     - em2860

     - eb1a:2860

Documentation/admin-guide/media/ipu6-isys.rst

+7 −7
Original line number Diff line number Diff line
@@ -135,16 +135,16 @@ sensor ov2740 on Lenovo X1 Yoga laptop. 
.. code-block:: none



    media-ctl -l "\"ov2740 14-0036\":0 -> \"Intel IPU6 CSI2 1\":0[1]"

    media-ctl -l "\"Intel IPU6 CSI2 1\":1 -> \"Intel IPU6 ISYS Capture 0\":0[5]"

    media-ctl -l "\"Intel IPU6 CSI2 1\":2 -> \"Intel IPU6 ISYS Capture 1\":0[5]"

    media-ctl -l "\"Intel IPU6 CSI2 1\":1 -> \"Intel IPU6 ISYS Capture 0\":0[1]"

    media-ctl -l "\"Intel IPU6 CSI2 1\":2 -> \"Intel IPU6 ISYS Capture 1\":0[1]"



    # set routing

    media-ctl -v -R "\"Intel IPU6 CSI2 1\" [0/0->1/0[1],0/1->2/1[1]]"

    media-ctl -R "\"Intel IPU6 CSI2 1\" [0/0->1/0[1],0/1->2/1[1]]"



    media-ctl -v "\"Intel IPU6 CSI2 1\":0/0 [fmt:SGRBG10/1932x1092]"

    media-ctl -v "\"Intel IPU6 CSI2 1\":0/1 [fmt:GENERIC_8/97x1]"

    media-ctl -v "\"Intel IPU6 CSI2 1\":1/0 [fmt:SGRBG10/1932x1092]"

    media-ctl -v "\"Intel IPU6 CSI2 1\":2/1 [fmt:GENERIC_8/97x1]"

    media-ctl -V "\"Intel IPU6 CSI2 1\":0/0 [fmt:SGRBG10/1932x1092]"

    media-ctl -V "\"Intel IPU6 CSI2 1\":0/1 [fmt:GENERIC_8/97x1]"

    media-ctl -V "\"Intel IPU6 CSI2 1\":1/0 [fmt:SGRBG10/1932x1092]"

    media-ctl -V "\"Intel IPU6 CSI2 1\":2/1 [fmt:GENERIC_8/97x1]"



    CAPTURE_DEV=$(media-ctl -e "Intel IPU6 ISYS Capture 0")

    ./yavta --data-prefix -c100 -n5 -I -s1932x1092 --file=/tmp/frame-#.bin \

Documentation/admin-guide/media/raspberrypi-pisp-be.dot

0 → 100644
+20 −0
Original line number Diff line number Diff line 
digraph board {

	rankdir=TB

	n00000001 [label="{{<port0> 0 | <port1> 1 | <port2> 2 | <port7> 7} | pispbe\n | {<port3> 3 | <port4> 4 | <port5> 5 | <port6> 6}}", shape=Mrecord, style=filled, fillcolor=green]

	n00000001:port3 -> n0000001c [style=bold]

	n00000001:port4 -> n00000022 [style=bold]

	n00000001:port5 -> n00000028 [style=bold]

	n00000001:port6 -> n0000002e [style=bold]

	n0000000a [label="pispbe-input\n/dev/video0", shape=box, style=filled, fillcolor=yellow]

	n0000000a -> n00000001:port0 [style=bold]

	n00000010 [label="pispbe-tdn_input\n/dev/video1", shape=box, style=filled, fillcolor=yellow]

	n00000010 -> n00000001:port1 [style=bold]

	n00000016 [label="pispbe-stitch_input\n/dev/video2", shape=box, style=filled, fillcolor=yellow]

	n00000016 -> n00000001:port2 [style=bold]

	n0000001c [label="pispbe-output0\n/dev/video3", shape=box, style=filled, fillcolor=yellow]

	n00000022 [label="pispbe-output1\n/dev/video4", shape=box, style=filled, fillcolor=yellow]

	n00000028 [label="pispbe-tdn_output\n/dev/video5", shape=box, style=filled, fillcolor=yellow]

	n0000002e [label="pispbe-stitch_output\n/dev/video6", shape=box, style=filled, fillcolor=yellow]

	n00000034 [label="pispbe-config\n/dev/video7", shape=box, style=filled, fillcolor=yellow]

	n00000034 -> n00000001:port7 [style=bold]

}

Documentation/admin-guide/media/raspberrypi-pisp-be.rst

0 → 100644
+109 −0
Original line number Diff line number Diff line 
.. SPDX-License-Identifier: GPL-2.0



=========================================================

Raspberry Pi PiSP Back End Memory-to-Memory ISP (pisp-be)

=========================================================



The PiSP Back End

=================



The PiSP Back End is a memory-to-memory Image Signal Processor (ISP) which reads

image data from DRAM memory and performs image processing as specified by the

application through the parameters in a configuration buffer, before writing

pixel data back to memory through two distinct output channels.



The ISP registers and programming model are documented in the `Raspberry Pi

Image Signal Processor (PiSP) Specification document`_



The PiSP Back End ISP processes images in tiles. The handling of image

tessellation and the computation of low-level configuration parameters is

realized by a free software library called `libpisp

<https://github.com/raspberrypi/libpisp>`_.



The full image processing pipeline, which involves capturing RAW Bayer data from

an image sensor through a MIPI CSI-2 compatible capture interface, storing them

in DRAM memory and processing them in the PiSP Back End to obtain images usable

by an application is implemented in `libcamera <https://libcamera.org>`_ as

part of the Raspberry Pi platform support.



The pisp-be driver

==================



The Raspberry Pi PiSP Back End (pisp-be) driver is located under

drivers/media/platform/raspberrypi/pisp-be. It uses the `V4L2 API` to register

a number of video capture and output devices, the `V4L2 subdev API` to register

a subdevice for the ISP that connects the video devices in a single media graph

realized using the `Media Controller (MC) API`.



The media topology registered by the `pisp-be` driver is represented below:



.. _pips-be-topology:



.. kernel-figure:: raspberrypi-pisp-be.dot

    :alt:   Diagram of the default media pipeline topology

    :align: center





The media graph registers the following video device nodes:



- pispbe-input: output device for images to be submitted to the ISP for

  processing.

- pispbe-tdn_input: output device for temporal denoise.

- pispbe-stitch_input: output device for image stitching (HDR).

- pispbe-output0: first capture device for processed images.

- pispbe-output1: second capture device for processed images.

- pispbe-tdn_output: capture device for temporal denoise.

- pispbe-stitch_output: capture device for image stitching (HDR).

- pispbe-config: output device for ISP configuration parameters.



pispbe-input

------------



Images to be processed by the ISP are queued to the `pispbe-input` output device

node. For a list of image formats supported as input to the ISP refer to the

`Raspberry Pi Image Signal Processor (PiSP) Specification document`_.



pispbe-tdn_input, pispbe-tdn_output

-----------------------------------



The `pispbe-tdn_input` output video device receives images to be processed by

the temporal denoise block which are captured from the `pispbe-tdn_output`

capture video device. Userspace is responsible for maintaining queues on both

devices, and ensuring that buffers completed on the output are queued to the

input.



pispbe-stitch_input, pispbe-stitch_output

-----------------------------------------



To realize HDR (high dynamic range) image processing the image stitching and

tonemapping blocks are used. The `pispbe-stitch_output` writes images to memory

and the `pispbe-stitch_input` receives the previously written frame to process

it along with the current input image. Userspace is responsible for maintaining

queues on both devices, and ensuring that buffers completed on the output are

queued to the input.



pispbe-output0, pispbe-output1

------------------------------



The two capture devices write to memory the pixel data as processed by the ISP.



pispbe-config

-------------



The `pispbe-config` output video devices receives a buffer of configuration

parameters that define the desired image processing to be performed by the ISP.



The format of the ISP configuration parameter is defined by

:c:type:`pisp_be_tiles_config` C structure and the meaning of each parameter is

described in the `Raspberry Pi Image Signal Processor (PiSP) Specification

document`_.



ISP configuration

=================



The ISP configuration is described solely by the content of the parameters

buffer. The only parameter that userspace needs to configure using the V4L2 API

is the image format on the output and capture video devices for validation of

the content of the parameters buffer.



.. _Raspberry Pi Image Signal Processor (PiSP) Specification document: https://datasheets.raspberrypi.com/camera/raspberry-pi-image-signal-processor-specification.pdf

Documentation/admin-guide/media/tuner-cardlist.rst

+2 −0
Original line number Diff line number Diff line
@@ -97,4 +97,6 @@ Tuner number Card name 
89           Sony BTF-PG472Z PAL/SECAM

90           Sony BTF-PK467Z NTSC-M-JP

91           Sony BTF-PB463Z NTSC-M

92           Silicon Labs Si2157 tuner

93           Tena TNF931D-DFDR1

============ =====================================================