mbox series

[v4,0/4] Add Synopsys DesignWare HDMI RX Controller

Message ID 20240719124032.26852-1-shreeya.patel@collabora.com
Headers show
Series Add Synopsys DesignWare HDMI RX Controller | expand

Message

Shreeya Patel July 19, 2024, 12:40 p.m. UTC
This series implements support for the Synopsys DesignWare
HDMI RX Controller, being compliant with standard HDMI 1.4b
and HDMI 2.0.

Features that are currently supported by the HDMI RX driver
have been tested on rock5b board using a HDMI to micro-HDMI cable.
It is recommended to use a good quality cable as there were
multiple issues seen during testing the driver.

Please note the below information :-
* While testing the driver on rock5b we noticed that the binary BL31
from Rockchip contains some unknown code to get the HDMI-RX PHY
access working without any errors.
With TF-A BL31, the HDMI-RX PHY also works fine but there were no
interrupts seen for rk_hdmirx-hdmi leading to some errors when
loading the driver [0]. It doesn't affect the functionality of the
driver though.
* We have tested the working of OBS studio with HDMIRX driver and
there were no issues seen.
* We also tested and verified the support for interlaced video.

[0] https://gitlab.collabora.com/hardware-enablement/rockchip-3588/trusted-firmware-a/-/issues/1

To test the HDMI RX Controller driver, following example commands can be used :-

root@debian-rockchip-rock5b-rk3588:~# v4l2-ctl --verbose -d /dev/video0 \
--set-fmt-video=width=1920,height=1080,pixelformat='BGR3' --stream-mmap=4 \
--stream-skip=3 --stream-count=100 --stream-to=/home/hdmiin4k.raw --stream-poll

root@debian-rockchip-rock5b-rk3588:~# ffmpeg -f rawvideo -vcodec rawvideo \
-s 1920x1080 -r 60 -pix_fmt bgr24 -i /home/hdmiin4k.raw output.mkv

CEC compliance test results :-

* https://gitlab.collabora.com/-/snippets/381
* https://gitlab.collabora.com/-/snippets/380

Following is the v4l2-compliance test result :-

root@debian-rockchip-rock5b-rk3588:~# v4l2-compliance -d /dev/video0
v4l2-compliance 1.27.0-5220, 64 bits, 64-bit time_t
v4l2-compliance SHA: 8387e3673837 2024-07-01 11:09:32

Compliance test for snps_hdmirx device /dev/video0:

Driver Info:
	Driver name      : snps_hdmirx
	Card type        : snps_hdmirx
	Bus info         : platform:fdee0000.hdmi-receiver
	Driver version   : 6.10.0
	Capabilities     : 0x84201000
		Video Capture Multiplanar
		Streaming
		Extended Pix Format
		Device Capabilities
	Device Caps      : 0x04201000
		Video Capture Multiplanar
		Streaming
		Extended Pix Format

Required ioctls:
	test VIDIOC_QUERYCAP: OK
	test invalid ioctls: OK

Allow for multiple opens:
	test second /dev/video0 open: OK
	test VIDIOC_QUERYCAP: OK
	test VIDIOC_G/S_PRIORITY: OK
	test for unlimited opens: OK

Debug ioctls:
	test VIDIOC_DBG_G/S_REGISTER: OK (Not Supported)
	test VIDIOC_LOG_STATUS: OK

Input ioctls:
	test VIDIOC_G/S_TUNER/ENUM_FREQ_BANDS: OK (Not Supported)
	test VIDIOC_G/S_FREQUENCY: OK (Not Supported)
	test VIDIOC_S_HW_FREQ_SEEK: OK (Not Supported)
	test VIDIOC_ENUMAUDIO: OK (Not Supported)
	test VIDIOC_G/S/ENUMINPUT: OK
	test VIDIOC_G/S_AUDIO: OK (Not Supported)
	Inputs: 1 Audio Inputs: 0 Tuners: 0

Output ioctls:
	test VIDIOC_G/S_MODULATOR: OK (Not Supported)
	test VIDIOC_G/S_FREQUENCY: OK (Not Supported)
	test VIDIOC_ENUMAUDOUT: OK (Not Supported)
	test VIDIOC_G/S/ENUMOUTPUT: OK (Not Supported)
	test VIDIOC_G/S_AUDOUT: OK (Not Supported)
	Outputs: 0 Audio Outputs: 0 Modulators: 0

Input/Output configuration ioctls:
	test VIDIOC_ENUM/G/S/QUERY_STD: OK (Not Supported)
	test VIDIOC_ENUM/G/S/QUERY_DV_TIMINGS: OK
	test VIDIOC_DV_TIMINGS_CAP: OK
	test VIDIOC_G/S_EDID: OK

Control ioctls (Input 0):
	test VIDIOC_QUERY_EXT_CTRL/QUERYMENU: OK
	test VIDIOC_QUERYCTRL: OK
	test VIDIOC_G/S_CTRL: OK
	test VIDIOC_G/S/TRY_EXT_CTRLS: OK
	test VIDIOC_(UN)SUBSCRIBE_EVENT/DQEVENT: OK
	test VIDIOC_G/S_JPEGCOMP: OK (Not Supported)
	Standard Controls: 3 Private Controls: 0

Format ioctls (Input 0):
	test VIDIOC_ENUM_FMT/FRAMESIZES/FRAMEINTERVALS: OK
	test VIDIOC_G/S_PARM: OK
	test VIDIOC_G_FBUF: OK (Not Supported)
	test VIDIOC_G_FMT: OK
	test VIDIOC_TRY_FMT: OK
	test VIDIOC_S_FMT: OK
	test VIDIOC_G_SLICED_VBI_CAP: OK (Not Supported)
	test Cropping: OK (Not Supported)
	test Composing: OK (Not Supported)
	test Scaling: OK (Not Supported)

Codec ioctls (Input 0):
	test VIDIOC_(TRY_)ENCODER_CMD: OK (Not Supported)
	test VIDIOC_G_ENC_INDEX: OK (Not Supported)
	test VIDIOC_(TRY_)DECODER_CMD: OK (Not Supported)

Buffer ioctls (Input 0):
	test VIDIOC_REQBUFS/CREATE_BUFS/QUERYBUF: OK
	test CREATE_BUFS maximum buffers: OK
	test VIDIOC_REMOVE_BUFS: OK
	test VIDIOC_EXPBUF: OK
	test Requests: OK (Not Supported)

Total for snps_hdmirx device /dev/video0: 47, Succeeded: 47, Failed: 0, Warnings: 0

Changes in v4 :-
  - Remove DTS changes included in the device tree patch
  - Remove the hdmi rx pin info as it's already present
    in the rk3588-base-pinctrl.dtsi
  - Create a separate config option for selecting the EDID
    and enable it by default
  - Improve the comment related to DV timings and move it
    to the side of hdmirx_get_detected_timings
  - Add 100ms delay before pulling the HPD high
  - Do not return the detected timings from VIDIOC_G_DV_TIMINGS
  - Drop the bus info from hdmirx_querycap
  - If *num_planes != 0 then return 0 in hdmirx_queue_setup
  - Set queue->min_queued_buffers to 1
  - Drop q->allow_cache_hints = 0; as it's always 0 by default
  - Add a comment for q->dma_attrs = DMA_ATTR_FORCE_CONTIGUOUS;
  - Drop .read = vb2_fop_read as it's not supported by driver
  - Remove redundant edid_init_data_600M
  - Make HPD low when driver is loaded
  - Add support for reading AVI Infoframe
  - Remove msg_len checks from hdmirx_cec_transmit
  - Add info about the CEC compliance test in the cover letter
  - Add arbitration lost status
  - Validate the physical address inside the EDID

Changes in v3 :-
  - Use v4l2-common helpers in the HDMIRX driver
  - Rename cma node and phandle names
  - Elaborate the comment to explain 160MiB calculation
  - Move &hdmi_receiver_cma to the rock5b dts file
  - Add information about interlaced video testing in the
    cover-letter

Changes in v2 :-
  - Fix checkpatch --strict warnings
  - Move the dt-binding include file changes in a separate patch
  - Add a description for the hardware in the dt-bindings file
  - Rename resets, vo1 grf and HPD properties
  - Add a proper description for grf and vo1-grf phandles in the
    bindings
  - Rename the HDMI RX node name to hdmi-receiver
  - Include gpio header file in binding example to fix the
    dt_binding_check failure
  - Move hdmirx_cma node to the rk3588.dtsi file
  - Add an entry to MAINTAINERS file for the HDMIRX driver

Shreeya Patel (4):
  MAINTAINERS: Add entry for Synopsys DesignWare HDMI RX Driver
  dt-bindings: media: Document bindings for HDMI RX Controller
  arm64: dts: rockchip: Add device tree support for HDMI RX Controller
  media: platform: synopsys: Add support for hdmi input driver

 .../bindings/media/snps,dw-hdmi-rx.yaml       |  132 +
 MAINTAINERS                                   |    8 +
 .../dts/rockchip/rk3588-base-pinctrl.dtsi     |   14 +
 .../arm64/boot/dts/rockchip/rk3588-extra.dtsi |   56 +
 drivers/media/platform/Kconfig                |    1 +
 drivers/media/platform/Makefile               |    1 +
 drivers/media/platform/synopsys/Kconfig       |    3 +
 drivers/media/platform/synopsys/Makefile      |    2 +
 .../media/platform/synopsys/hdmirx/Kconfig    |   27 +
 .../media/platform/synopsys/hdmirx/Makefile   |    4 +
 .../platform/synopsys/hdmirx/snps_hdmirx.c    | 2763 +++++++++++++++++
 .../platform/synopsys/hdmirx/snps_hdmirx.h    |  394 +++
 .../synopsys/hdmirx/snps_hdmirx_cec.c         |  285 ++
 .../synopsys/hdmirx/snps_hdmirx_cec.h         |   44 +
 14 files changed, 3734 insertions(+)
 create mode 100644 Documentation/devicetree/bindings/media/snps,dw-hdmi-rx.yaml
 create mode 100644 drivers/media/platform/synopsys/Kconfig
 create mode 100644 drivers/media/platform/synopsys/Makefile
 create mode 100644 drivers/media/platform/synopsys/hdmirx/Kconfig
 create mode 100644 drivers/media/platform/synopsys/hdmirx/Makefile
 create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx.c
 create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx.h
 create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx_cec.c
 create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx_cec.h

Comments

hoff.benjamin.k@gmail.com July 22, 2024, 7:39 p.m. UTC | #1
> Add initial support for the Synopsys DesignWare HDMI RX
> Controller Driver used by Rockchip RK3588. The driver
> supports:
>  - HDMI 1.4b and 2.0 modes (HDMI 4k@60Hz)
>  - RGB888, YUV422, YUV444 and YCC420 pixel formats
>  - CEC
>  - EDID configuration
>
> The hardware also has Audio and HDCP capabilities, but these are
> not yet supported by the driver.
>
> Reviewed-by: Dmitry Osipenko <dmitry.osipenko@collabora.com>
> Tested-by: Dmitry Osipenko <dmitry.osipenko@collabora.com>
> Co-developed-by: Dingxian Wen <shawn.wen@rock-chips.com>
> Signed-off-by: Dingxian Wen <shawn.wen@rock-chips.com>
> Signed-off-by: Shreeya Patel <shreeya.patel@collabora.com>
> ---
>
> Changes in v4 :-
>   - Create a separate config option for selecting the EDID
>     and enable it by default
>   - Improve the comment related to DV timings and move it
>     to the side of hdmirx_get_detected_timings
>   - Add 100ms delay before pulling the HPD high
>   - Do not return the detected timings from VIDIOC_G_DV_TIMINGS
>   - Drop the bus info from hdmirx_querycap
>   - If *num_planes != 0 then return 0 in hdmirx_queue_setup
>   - Set queue->min_queued_buffers to 1
>   - Drop q->allow_cache_hints = 0; as it's always 0 by default
>   - Add a comment for q->dma_attrs = DMA_ATTR_FORCE_CONTIGUOUS;
>   - Drop .read = vb2_fop_read as it's not supported by driver
>   - Remove redundant edid_init_data_600M
>   - Make HPD low when driver is loaded
>   - Add support for reading AVI Infoframe
>   - Remove msg_len checks from hdmirx_cec_transmit
>   - Add info about the CEC compliance test in the cover letter
>   - Add arbitration lost status
>   - Validate the physical address inside the EDID
>
> Changes in v3 :-
>   - Use v4l2-common helper functions
>
> Changes in v2 :-
>   - Fix checkpatch --strict warnings
>   - Rename resets, vo1-grf and HPD node names as per the DT changes
>
>  drivers/media/platform/Kconfig                |    1 +
>  drivers/media/platform/Makefile               |    1 +
>  drivers/media/platform/synopsys/Kconfig       |    3 +
>  drivers/media/platform/synopsys/Makefile      |    2 +
>  .../media/platform/synopsys/hdmirx/Kconfig    |   27 +
>  .../media/platform/synopsys/hdmirx/Makefile   |    4 +
>  .../platform/synopsys/hdmirx/snps_hdmirx.c    | 2763 +++++++++++++++++
>  .../platform/synopsys/hdmirx/snps_hdmirx.h    |  394 +++
>  .../synopsys/hdmirx/snps_hdmirx_cec.c         |  285 ++
>  .../synopsys/hdmirx/snps_hdmirx_cec.h         |   44 +
>  10 files changed, 3524 insertions(+)
>  create mode 100644 drivers/media/platform/synopsys/Kconfig
>  create mode 100644 drivers/media/platform/synopsys/Makefile
>  create mode 100644 drivers/media/platform/synopsys/hdmirx/Kconfig
>  create mode 100644 drivers/media/platform/synopsys/hdmirx/Makefile
>  create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx.c
>  create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx.h
>  create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx_cec.c
>  create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx_cec.h
>
> diff --git a/drivers/media/platform/Kconfig b/drivers/media/platform/Kconfig
> index 85d2627776b6..9287faafdce5 100644
> --- a/drivers/media/platform/Kconfig
> +++ b/drivers/media/platform/Kconfig
> @@ -85,6 +85,7 @@ source "drivers/media/platform/rockchip/Kconfig"
>  source "drivers/media/platform/samsung/Kconfig"
>  source "drivers/media/platform/st/Kconfig"
>  source "drivers/media/platform/sunxi/Kconfig"
> +source "drivers/media/platform/synopsys/Kconfig"
>  source "drivers/media/platform/ti/Kconfig"
>  source "drivers/media/platform/verisilicon/Kconfig"
>  source "drivers/media/platform/via/Kconfig"
> diff --git a/drivers/media/platform/Makefile b/drivers/media/platform/Makefile
> index ace4e34483dd..6fd7db0541c7 100644
> --- a/drivers/media/platform/Makefile
> +++ b/drivers/media/platform/Makefile
> @@ -28,6 +28,7 @@ obj-y += rockchip/
>  obj-y += samsung/
>  obj-y += st/
>  obj-y += sunxi/
> +obj-y += synopsys/
>  obj-y += ti/
>  obj-y += verisilicon/
>  obj-y += via/
> diff --git a/drivers/media/platform/synopsys/Kconfig b/drivers/media/platform/synopsys/Kconfig
> new file mode 100644
> index 000000000000..4fd521f78425
> --- /dev/null
> +++ b/drivers/media/platform/synopsys/Kconfig
> @@ -0,0 +1,3 @@
> +# SPDX-License-Identifier: GPL-2.0-only
> +
> +source "drivers/media/platform/synopsys/hdmirx/Kconfig"
> diff --git a/drivers/media/platform/synopsys/Makefile b/drivers/media/platform/synopsys/Makefile
> new file mode 100644
> index 000000000000..3b12c574dd67
> --- /dev/null
> +++ b/drivers/media/platform/synopsys/Makefile
> @@ -0,0 +1,2 @@
> +# SPDX-License-Identifier: GPL-2.0-only
> +obj-y += hdmirx/
> diff --git a/drivers/media/platform/synopsys/hdmirx/Kconfig b/drivers/media/platform/synopsys/hdmirx/Kconfig
> new file mode 100644
> index 000000000000..ab569e59300f
> --- /dev/null
> +++ b/drivers/media/platform/synopsys/hdmirx/Kconfig
> @@ -0,0 +1,27 @@
> +# SPDX-License-Identifier: GPL-2.0
> +
> +config VIDEO_SYNOPSYS_HDMIRX
> +	tristate "Synopsys DesignWare HDMI Receiver driver"
> +	depends on VIDEO_DEV
> +	depends on ARCH_ROCKCHIP
> +	select MEDIA_CONTROLLER
> +	select VIDEO_V4L2_SUBDEV_API
> +	select VIDEOBUF2_DMA_CONTIG
> +	select CEC_CORE
> +	select CEC_NOTIFIER
> +	select HDMI
> +	help
> +	  Support for Synopsys HDMI HDMI RX Controller.
> +	  This driver supports HDMI 2.0 version.
> +
> +	  To compile this driver as a module, choose M here. The module
> +	  will be called synopsys_hdmirx.
> +
> +config HDMIRX_LOAD_DEFAULT_EDID
> +	bool "Load default EDID"
> +	depends on VIDEO_SYNOPSYS_HDMIRX
> +	default "y"
> +	help
> +	  Preload the default EDID (Extended Display Identification Data).
> +	  EDID contains information about the capabilities of the display,
> +	  such as supported resolutions, refresh rates, and audio formats.
> diff --git a/drivers/media/platform/synopsys/hdmirx/Makefile b/drivers/media/platform/synopsys/hdmirx/Makefile
> new file mode 100644
> index 000000000000..2fa2d9e25300
> --- /dev/null
> +++ b/drivers/media/platform/synopsys/hdmirx/Makefile
> @@ -0,0 +1,4 @@
> +# SPDX-License-Identifier: GPL-2.0
> +synopsys-hdmirx-objs := snps_hdmirx.o snps_hdmirx_cec.o
> +
> +obj-$(CONFIG_VIDEO_SYNOPSYS_HDMIRX) += synopsys-hdmirx.o
> diff --git a/drivers/media/platform/synopsys/hdmirx/snps_hdmirx.c b/drivers/media/platform/synopsys/hdmirx/snps_hdmirx.c
> new file mode 100644
> index 000000000000..1dfecf256393
> --- /dev/null
> +++ b/drivers/media/platform/synopsys/hdmirx/snps_hdmirx.c
> @@ -0,0 +1,2763 @@
> +// SPDX-License-Identifier: GPL-2.0
> +/*
> + * Copyright (C) 2024 Collabora, Ltd.
> + * Author: Shreeya Patel <shreeya.patel@collabora.com>
> + *
> + * Copyright (c) 2021 Rockchip Electronics Co. Ltd.
> + * Author: Dingxian Wen <shawn.wen@rock-chips.com>
> + */
> +
> +#include <linux/arm-smccc.h>
> +#include <linux/clk.h>
> +#include <linux/completion.h>
> +#include <linux/delay.h>
> +#include <linux/dma-mapping.h>
> +#include <linux/gpio/consumer.h>
> +#include <linux/hdmi.h>
> +#include <linux/interrupt.h>
> +#include <linux/irq.h>
> +#include <linux/mfd/syscon.h>
> +#include <linux/module.h>
> +#include <linux/of.h>
> +#include <linux/of_platform.h>
> +#include <linux/of_reserved_mem.h>
> +#include <linux/pinctrl/consumer.h>
> +#include <linux/platform_device.h>
> +#include <linux/property.h>
> +#include <linux/regmap.h>
> +#include <linux/reset.h>
> +#include <linux/v4l2-dv-timings.h>
> +#include <linux/workqueue.h>
> +
> +#include <media/cec.h>
> +#include <media/cec-notifier.h>
> +#include <media/v4l2-common.h>
> +#include <media/v4l2-ctrls.h>
> +#include <media/v4l2-device.h>
> +#include <media/v4l2-dv-timings.h>
> +#include <media/v4l2-event.h>
> +#include <media/v4l2-fh.h>
> +#include <media/v4l2-ioctl.h>
> +#include <media/videobuf2-dma-contig.h>
> +#include <media/videobuf2-v4l2.h>
> +#include <media/v4l2-common.h>
> +
> +#include <sound/hdmi-codec.h>
> +
> +#include "snps_hdmirx.h"
> +#include "snps_hdmirx_cec.h"
> +
> +static int debug;
> +module_param(debug, int, 0644);
> +MODULE_PARM_DESC(debug, "debug level (0-3)");
> +
> +#define EDID_NUM_BLOCKS_MAX			2
> +#define EDID_BLOCK_SIZE				128
> +#define HDMIRX_STORED_BIT_WIDTH			8
> +#define IREF_CLK_FREQ_HZ			428571429
> +#define MEMORY_ALIGN_ROUND_UP_BYTES		64
> +#define HDMIRX_PLANE_Y				0
> +#define HDMIRX_PLANE_CBCR			1
> +#define RK_IRQ_HDMIRX_HDMI			210
> +#define FILTER_FRAME_CNT			6
> +#define RK_SIP_FIQ_CTRL				0x82000024
> +#define SIP_WDT_CFG				0x82000026
> +#define DETECTION_THRESHOLD			7
> +
> +/* fiq control sub func */
> +enum {
> +	RK_SIP_FIQ_CTRL_FIQ_EN = 1,
> +	RK_SIP_FIQ_CTRL_FIQ_DIS,
> +	RK_SIP_FIQ_CTRL_SET_AFF
> +};
> +
> +/* SIP_WDT_CONFIG call types  */
> +enum {
> +	WDT_START = 0,
> +	WDT_STOP = 1,
> +	WDT_PING = 2,
> +};
> +
> +enum hdmirx_pix_fmt {
> +	HDMIRX_RGB888 = 0,
> +	HDMIRX_YUV422 = 1,
> +	HDMIRX_YUV444 = 2,
> +	HDMIRX_YUV420 = 3,
> +};
> +
> +enum ddr_store_fmt {
> +	STORE_RGB888 = 0,
> +	STORE_RGBA_ARGB,
> +	STORE_YUV420_8BIT,
> +	STORE_YUV420_10BIT,
> +	STORE_YUV422_8BIT,
> +	STORE_YUV422_10BIT,
> +	STORE_YUV444_8BIT,
> +	STORE_YUV420_16BIT = 8,
> +	STORE_YUV422_16BIT = 9,
> +};
> +
> +enum hdmirx_reg_attr {
> +	HDMIRX_ATTR_RW = 0,
> +	HDMIRX_ATTR_RO = 1,
> +	HDMIRX_ATTR_WO = 2,
> +	HDMIRX_ATTR_RE = 3,
> +};
> +
> +enum {
> +	HDMIRX_RST_A,
> +	HDMIRX_RST_P,
> +	HDMIRX_RST_REF,
> +	HDMIRX_RST_BIU,
> +	HDMIRX_NUM_RST,
> +};
> +
> +static const char * const pix_fmt_str[] = {
> +	"RGB888",
> +	"YUV422",
> +	"YUV444",
> +	"YUV420",
> +};
> +
> +struct hdmirx_buffer {
> +	struct vb2_v4l2_buffer vb;
> +	struct list_head queue;
> +	u32 buff_addr[VIDEO_MAX_PLANES];
> +};
> +
> +struct hdmirx_stream {
> +	struct snps_hdmirx_dev *hdmirx_dev;
> +	struct video_device vdev;
> +	struct vb2_queue buf_queue;
> +	struct list_head buf_head;
> +	struct hdmirx_buffer *curr_buf;
> +	struct hdmirx_buffer *next_buf;
> +	struct v4l2_pix_format_mplane pixm;
> +	const struct v4l2_format_info *out_finfo;
> +	struct mutex vlock; /* to lock resources associated with video buffer and video device */
> +	spinlock_t vbq_lock; /* to lock video buffer queue */
> +	bool stopping;
> +	wait_queue_head_t wq_stopped;
> +	u32 frame_idx;
> +	u32 line_flag_int_cnt;
> +	u32 irq_stat;
> +};
> +
> +struct snps_hdmirx_dev {
> +	struct device *dev;
> +	struct device *codec_dev;
> +	struct hdmirx_stream stream;
> +	struct v4l2_device v4l2_dev;
> +	struct v4l2_ctrl_handler hdl;
> +	struct v4l2_ctrl *detect_tx_5v_ctrl;
> +	struct v4l2_ctrl *rgb_range;
> +	struct v4l2_dv_timings timings;
> +	struct gpio_desc *detect_5v_gpio;
> +	struct work_struct work_wdt_config;
> +	struct delayed_work delayed_work_hotplug;
> +	struct delayed_work delayed_work_res_change;
> +	struct delayed_work delayed_work_heartbeat;
> +	struct cec_notifier *cec_notifier;
> +	struct hdmirx_cec *cec;
> +	struct mutex stream_lock; /* to lock video stream capture */
> +	struct mutex work_lock; /* to lock the critical section of hotplug event */
> +	struct reset_control_bulk_data resets[HDMIRX_NUM_RST];
> +	struct clk_bulk_data *clks;
> +	struct regmap *grf;
> +	struct regmap *vo1_grf;
> +	struct completion cr_write_done;
> +	struct completion timer_base_lock;
> +	struct completion avi_pkt_rcv;
> +	enum hdmirx_pix_fmt pix_fmt;
> +	void __iomem *regs;
> +	int hdmi_irq;
> +	int dma_irq;
> +	int det_irq;
> +	bool hpd_trigger_level;
> +	bool tmds_clk_ratio;
> +	bool is_dvi_mode;
> +	bool got_timing;
> +	u32 num_clks;
> +	u32 edid_blocks_written;
> +	u32 cur_vic;
> +	u32 cur_fmt_fourcc;
> +	u32 color_depth;
> +	u8 edid[EDID_BLOCK_SIZE * 2];
> +	hdmi_codec_plugged_cb plugged_cb;
> +	spinlock_t rst_lock; /* to lock register access */
> +};
> +
> +static u8 edid_init_data_340M[] = {
> +	0x00, 0xFF, 0xFF, 0xFF, 0xFF, 0xFF, 0xFF, 0x00,
> +	0x49, 0x70, 0x88, 0x35, 0x01, 0x00, 0x00, 0x00,
> +	0x2D, 0x1F, 0x01, 0x03, 0x80, 0x78, 0x44, 0x78,
> +	0x0A, 0xCF, 0x74, 0xA3, 0x57, 0x4C, 0xB0, 0x23,
> +	0x09, 0x48, 0x4C, 0x21, 0x08, 0x00, 0x61, 0x40,
> +	0x01, 0x01, 0x81, 0x00, 0x95, 0x00, 0xA9, 0xC0,
> +	0x01, 0x01, 0x01, 0x01, 0x01, 0x01, 0x02, 0x3A,
> +	0x80, 0x18, 0x71, 0x38, 0x2D, 0x40, 0x58, 0x2C,
> +	0x45, 0x00, 0x20, 0xC2, 0x31, 0x00, 0x00, 0x1E,
> +	0x01, 0x1D, 0x00, 0x72, 0x51, 0xD0, 0x1E, 0x20,
> +	0x6E, 0x28, 0x55, 0x00, 0x20, 0xC2, 0x31, 0x00,
> +	0x00, 0x1E, 0x00, 0x00, 0x00, 0xFC, 0x00, 0x52,
> +	0x4B, 0x2D, 0x55, 0x48, 0x44, 0x0A, 0x20, 0x20,
> +	0x20, 0x20, 0x20, 0x20, 0x00, 0x00, 0x00, 0xFD,
> +	0x00, 0x3B, 0x46, 0x1F, 0x8C, 0x3C, 0x00, 0x0A,
> +	0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x01, 0xA7,
> +
> +	0x02, 0x03, 0x2F, 0xD1, 0x51, 0x07, 0x16, 0x14,
> +	0x05, 0x01, 0x03, 0x12, 0x13, 0x84, 0x22, 0x1F,
> +	0x90, 0x5D, 0x5E, 0x5F, 0x60, 0x61, 0x23, 0x09,
> +	0x07, 0x07, 0x83, 0x01, 0x00, 0x00, 0x67, 0x03,
> +	0x0C, 0x00, 0x30, 0x00, 0x10, 0x44, 0xE3, 0x05,
> +	0x03, 0x01, 0xE4, 0x0F, 0x00, 0x80, 0x01, 0x02,
> +	0x3A, 0x80, 0x18, 0x71, 0x38, 0x2D, 0x40, 0x58,
> +	0x2C, 0x45, 0x00, 0x20, 0xC2, 0x31, 0x00, 0x00,
> +	0x1E, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00,
> +	0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00,
> +	0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00,
> +	0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00,
> +	0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00,
> +	0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00,
> +	0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00,
> +	0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0x1F,
> +};
> +
> +static const struct v4l2_dv_timings cea640x480 = V4L2_DV_BT_CEA_640X480P59_94;
> +
> +static const struct v4l2_dv_timings_cap hdmirx_timings_cap = {
> +	.type = V4L2_DV_BT_656_1120,
> +	.reserved = { 0 },
> +	V4L2_INIT_BT_TIMINGS(640, 4096,			/* min/max width */
> +			     480, 2160,			/* min/max height */
> +			     20000000, 600000000,	/* min/max pixelclock */
> +			     /* standards */
> +			     V4L2_DV_BT_STD_CEA861,
> +			     /* capabilities */
> +			     V4L2_DV_BT_CAP_PROGRESSIVE |
> +			     V4L2_DV_BT_CAP_INTERLACED)
> +};
> +
> +static void hdmirx_writel(struct snps_hdmirx_dev *hdmirx_dev, int reg, u32 val)
> +{
> +	unsigned long lock_flags = 0;
> +
> +	spin_lock_irqsave(&hdmirx_dev->rst_lock, lock_flags);
> +	writel(val, hdmirx_dev->regs + reg);
> +	spin_unlock_irqrestore(&hdmirx_dev->rst_lock, lock_flags);
> +}
> +
> +static u32 hdmirx_readl(struct snps_hdmirx_dev *hdmirx_dev, int reg)
> +{
> +	unsigned long lock_flags = 0;
> +	u32 val;
> +
> +	spin_lock_irqsave(&hdmirx_dev->rst_lock, lock_flags);
> +	val = readl(hdmirx_dev->regs + reg);
> +	spin_unlock_irqrestore(&hdmirx_dev->rst_lock, lock_flags);
> +	return val;
> +}
> +
> +static void hdmirx_reset_dma(struct snps_hdmirx_dev *hdmirx_dev)
> +{
> +	unsigned long lock_flags = 0;
> +
> +	spin_lock_irqsave(&hdmirx_dev->rst_lock, lock_flags);
> +	reset_control_reset(hdmirx_dev->resets[0].rstc);
> +	spin_unlock_irqrestore(&hdmirx_dev->rst_lock, lock_flags);
> +}
> +
> +static void hdmirx_update_bits(struct snps_hdmirx_dev *hdmirx_dev, int reg,
> +			       u32 mask, u32 data)
> +{
> +	unsigned long lock_flags = 0;
> +	u32 val;
> +
> +	spin_lock_irqsave(&hdmirx_dev->rst_lock, lock_flags);
> +	val = readl(hdmirx_dev->regs + reg) & ~mask;
> +	val |= (data & mask);
> +	writel(val, hdmirx_dev->regs + reg);
> +	spin_unlock_irqrestore(&hdmirx_dev->rst_lock, lock_flags);
> +}
> +
> +static int hdmirx_subscribe_event(struct v4l2_fh *fh,
> +				  const struct v4l2_event_subscription *sub)
> +{
> +	switch (sub->type) {
> +	case V4L2_EVENT_SOURCE_CHANGE:
> +		if (fh->vdev->vfl_dir == VFL_DIR_RX)
> +			return v4l2_src_change_event_subscribe(fh, sub);
> +		break;
> +	case V4L2_EVENT_CTRL:
> +		return v4l2_ctrl_subscribe_event(fh, sub);
> +	default:
> +		break;
> +	}
> +
> +	return -EINVAL;
> +}
> +
> +static bool tx_5v_power_present(struct snps_hdmirx_dev *hdmirx_dev)
> +{
> +	bool ret;
> +	int val, i, cnt;
> +
> +	cnt = 0;
> +	for (i = 0; i < 10; i++) {
> +		usleep_range(1000, 1100);
> +		val = gpiod_get_value(hdmirx_dev->detect_5v_gpio);
> +		if (val > 0)
> +			cnt++;
> +		if (cnt >= DETECTION_THRESHOLD)
> +			break;
> +	}
> +
> +	ret = (cnt >= DETECTION_THRESHOLD) ? true : false;
> +	v4l2_dbg(3, debug, &hdmirx_dev->v4l2_dev, "%s: %d\n", __func__, ret);
> +
> +	return ret;
> +}
> +
> +static bool signal_not_lock(struct snps_hdmirx_dev *hdmirx_dev)
> +{
> +	u32 mu_status, dma_st10, cmu_st;
> +
> +	mu_status = hdmirx_readl(hdmirx_dev, MAINUNIT_STATUS);
> +	dma_st10 = hdmirx_readl(hdmirx_dev, DMA_STATUS10);
> +	cmu_st = hdmirx_readl(hdmirx_dev, CMU_STATUS);
> +
> +	if ((mu_status & TMDSVALID_STABLE_ST) &&
> +	    (dma_st10 & HDMIRX_LOCK) &&
> +	    (cmu_st & TMDSQPCLK_LOCKED_ST))
> +		return false;
> +
> +	return true;
> +}
> +
> +static void hdmirx_get_colordepth(struct snps_hdmirx_dev *hdmirx_dev)
> +{
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +	u32 val, color_depth_reg;
> +
> +	val = hdmirx_readl(hdmirx_dev, DMA_STATUS11);
> +	color_depth_reg = (val & HDMIRX_COLOR_DEPTH_MASK) >> 3;
> +
> +	switch (color_depth_reg) {
> +	case 0x4:
> +		hdmirx_dev->color_depth = 24;
> +		break;
> +	case 0x5:
> +		hdmirx_dev->color_depth = 30;
> +		break;
> +	case 0x6:
> +		hdmirx_dev->color_depth = 36;
> +		break;
> +	case 0x7:
> +		hdmirx_dev->color_depth = 48;
> +		break;
> +	default:
> +		hdmirx_dev->color_depth = 24;
> +		break;
> +	}
> +
> +	v4l2_dbg(1, debug, v4l2_dev, "%s: color_depth: %d, reg_val:%d\n",
> +		 __func__, hdmirx_dev->color_depth, color_depth_reg);
> +}
> +
> +static void hdmirx_get_pix_fmt(struct snps_hdmirx_dev *hdmirx_dev)
> +{
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +	u32 val;
> +
> +	val = hdmirx_readl(hdmirx_dev, DMA_STATUS11);
> +	hdmirx_dev->pix_fmt = val & HDMIRX_FORMAT_MASK;
> +
> +	switch (hdmirx_dev->pix_fmt) {
> +	case HDMIRX_RGB888:
> +		hdmirx_dev->cur_fmt_fourcc = V4L2_PIX_FMT_BGR24;
> +		break;
> +	case HDMIRX_YUV422:
> +		hdmirx_dev->cur_fmt_fourcc = V4L2_PIX_FMT_NV16;
> +		break;
> +	case HDMIRX_YUV444:
> +		hdmirx_dev->cur_fmt_fourcc = V4L2_PIX_FMT_NV24;
> +		break;
> +	case HDMIRX_YUV420:
> +		hdmirx_dev->cur_fmt_fourcc = V4L2_PIX_FMT_NV12;
> +		break;
> +	default:
> +		v4l2_err(v4l2_dev,
> +			 "%s: err pix_fmt: %d, set RGB888 as default\n",
> +			 __func__, hdmirx_dev->pix_fmt);
> +		hdmirx_dev->pix_fmt = HDMIRX_RGB888;
> +		hdmirx_dev->cur_fmt_fourcc = V4L2_PIX_FMT_BGR24;
> +		break;
> +	}
> +
> +	v4l2_dbg(1, debug, v4l2_dev, "%s: pix_fmt: %s\n", __func__,
> +		 pix_fmt_str[hdmirx_dev->pix_fmt]);
> +}
> +
> +static void hdmirx_get_timings(struct snps_hdmirx_dev *hdmirx_dev,
> +			       struct v4l2_bt_timings *bt, bool from_dma)
> +{
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +	u32 hact, vact, htotal, vtotal, fps;
> +	u32 hfp, hs, hbp, vfp, vs, vbp;
> +	u32 val;
> +
> +	if (from_dma) {
> +		val = hdmirx_readl(hdmirx_dev, DMA_STATUS2);
> +		hact = (val >> 16) & 0xffff;
> +		vact = val & 0xffff;
> +		val = hdmirx_readl(hdmirx_dev, DMA_STATUS3);
> +		htotal = (val >> 16) & 0xffff;
> +		vtotal = val & 0xffff;
> +		val = hdmirx_readl(hdmirx_dev, DMA_STATUS4);
> +		hs = (val >> 16) & 0xffff;
> +		vs = val & 0xffff;
> +		val = hdmirx_readl(hdmirx_dev, DMA_STATUS5);
> +		hbp = (val >> 16) & 0xffff;
> +		vbp = val & 0xffff;
> +		hfp = htotal - hact - hs - hbp;
> +		vfp = vtotal - vact - vs - vbp;
> +	} else {
> +		val = hdmirx_readl(hdmirx_dev, VMON_STATUS1);
> +		hs = (val >> 16) & 0xffff;
> +		hfp = val & 0xffff;
> +		val = hdmirx_readl(hdmirx_dev, VMON_STATUS2);
> +		hbp = val & 0xffff;
> +		val = hdmirx_readl(hdmirx_dev, VMON_STATUS3);
> +		htotal = (val >> 16) & 0xffff;
> +		hact = val & 0xffff;
> +		val = hdmirx_readl(hdmirx_dev, VMON_STATUS4);
> +		vs = (val >> 16) & 0xffff;
> +		vfp = val & 0xffff;
> +		val = hdmirx_readl(hdmirx_dev, VMON_STATUS5);
> +		vbp = val & 0xffff;
> +		val = hdmirx_readl(hdmirx_dev, VMON_STATUS6);
> +		vtotal = (val >> 16) & 0xffff;
> +		vact = val & 0xffff;
> +		if (hdmirx_dev->pix_fmt == HDMIRX_YUV420)
> +			hact *= 2;
> +	}
> +	if (hdmirx_dev->pix_fmt == HDMIRX_YUV420)
> +		htotal *= 2;
> +	fps = (bt->pixelclock + (htotal * vtotal) / 2) / (htotal * vtotal);
> +	if (hdmirx_dev->pix_fmt == HDMIRX_YUV420)
> +		fps *= 2;
> +	bt->width = hact;
> +	bt->height = vact;
> +	bt->hfrontporch = hfp;
> +	bt->hsync = hs;
> +	bt->hbackporch = hbp;
> +	bt->vfrontporch = vfp;
> +	bt->vsync = vs;
> +	bt->vbackporch = vbp;
> +
> +	v4l2_dbg(1, debug, v4l2_dev, "get timings from %s\n", from_dma ? "dma" : "ctrl");
> +	v4l2_dbg(1, debug, v4l2_dev, "act:%ux%u, total:%ux%u, fps:%u, pixclk:%llu\n",
> +		 bt->width, bt->height, htotal, vtotal, fps, bt->pixelclock);
> +
> +	v4l2_dbg(2, debug, v4l2_dev, "hfp:%u, hs:%u, hbp:%u, vfp:%u, vs:%u, vbp:%u\n",
> +		 bt->hfrontporch, bt->hsync, bt->hbackporch,
> +		 bt->vfrontporch, bt->vsync, bt->vbackporch);
> +}
> +
> +static bool hdmirx_check_timing_valid(struct v4l2_bt_timings *bt)
> +{
> +	if (bt->width < 100 || bt->width > 5000 ||
> +	    bt->height < 100 || bt->height > 5000)
> +		return false;
> +
> +	if (!bt->hsync || bt->hsync > 200 ||
> +	    !bt->vsync || bt->vsync > 100)
> +		return false;
> +
> +	if (!bt->hbackporch || bt->hbackporch > 2000 ||
> +	    !bt->vbackporch || bt->vbackporch > 2000)
> +		return false;
> +
> +	if (!bt->hfrontporch || bt->hfrontporch > 2000 ||
> +	    !bt->vfrontporch || bt->vfrontporch > 2000)
> +		return false;
> +
> +	return true;
> +}
> +
> +static void hdmirx_get_avi_infoframe(struct snps_hdmirx_dev *hdmirx_dev)
> +{
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +	union hdmi_infoframe frame = {};
> +	int err, i, b, itr = 0;
> +	u8 aviif[3 + 7 * 4];
> +	u32 val;
> +
> +	aviif[itr++] = HDMI_INFOFRAME_TYPE_AVI;
> +	val = hdmirx_readl(hdmirx_dev, PKTDEC_AVIIF_PH2_1);
> +	aviif[itr++] = val & 0xff;
> +	aviif[itr++] = (val >> 8) & 0xff;
> +
> +	for (i = 0; i < 7; i++) {
> +		val = hdmirx_readl(hdmirx_dev, PKTDEC_AVIIF_PB3_0 + 4 * i);
> +
> +		for (b = 0; b < 4; b++)
> +			aviif[itr++] = (val >> (8 * b)) & 0xff;
> +	}
> +
> +	err = hdmi_infoframe_unpack(&frame, aviif, sizeof(aviif));
> +	if (err) {
> +		v4l2_err(v4l2_dev, "failed to unpack AVI infoframe\n");
> +		return;
> +	}
> +
> +	v4l2_ctrl_s_ctrl(hdmirx_dev->rgb_range, frame.avi.quantization_range);
> +}
> +
> +/*
> + * When querying DV timings during preview, if the DMA's timing is stable,
> + * we retrieve the timings directly from the DMA. However, if the current
> + * resolution is negative, obtaining the timing from CTRL may require a
> + * change in the sync polarity, potentially leading to DMA errors.
> + */
> +static int hdmirx_get_detected_timings(struct snps_hdmirx_dev *hdmirx_dev,
> +				       struct v4l2_dv_timings *timings,
> +				       bool from_dma)
> +{
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +	struct v4l2_bt_timings *bt = &timings->bt;
> +	u32 field_type, color_depth, deframer_st;
> +	u32 val, tmdsqpclk_freq, pix_clk;
> +	u64 tmp_data, tmds_clk;
> +
> +	memset(timings, 0, sizeof(struct v4l2_dv_timings));
> +	timings->type = V4L2_DV_BT_656_1120;
> +
> +	val = hdmirx_readl(hdmirx_dev, DMA_STATUS11);
> +	field_type = (val & HDMIRX_TYPE_MASK) >> 7;
> +	hdmirx_get_pix_fmt(hdmirx_dev);
> +	bt->interlaced = field_type & BIT(0) ? V4L2_DV_INTERLACED : V4L2_DV_PROGRESSIVE;
> +	val = hdmirx_readl(hdmirx_dev, PKTDEC_AVIIF_PB7_4);
> +	hdmirx_dev->cur_vic =  val | VIC_VAL_MASK;
> +	hdmirx_get_colordepth(hdmirx_dev);
> +	color_depth = hdmirx_dev->color_depth;
> +	deframer_st = hdmirx_readl(hdmirx_dev, DEFRAMER_STATUS);
> +	hdmirx_dev->is_dvi_mode = deframer_st & OPMODE_STS_MASK ? false : true;
> +	tmdsqpclk_freq = hdmirx_readl(hdmirx_dev, CMU_TMDSQPCLK_FREQ);
> +	tmds_clk = tmdsqpclk_freq * 4 * 1000;
> +	tmp_data = tmds_clk * 24;
> +	do_div(tmp_data, color_depth);
> +	pix_clk = tmp_data;
> +	bt->pixelclock = pix_clk;
> +
> +	hdmirx_get_avi_infoframe(hdmirx_dev);
> +
> +	hdmirx_get_timings(hdmirx_dev, bt, from_dma);
> +	if (bt->interlaced == V4L2_DV_INTERLACED) {
> +		bt->height *= 2;
> +		bt->il_vsync = bt->vsync + 1;
> +	}
> +
> +	v4l2_dbg(2, debug, v4l2_dev, "tmds_clk:%llu\n", tmds_clk);
> +	v4l2_dbg(1, debug, v4l2_dev, "interlace:%d, fmt:%d, vic:%d, color:%d, mode:%s\n",
> +		 bt->interlaced, hdmirx_dev->pix_fmt,
> +		 hdmirx_dev->cur_vic, hdmirx_dev->color_depth,
> +		 hdmirx_dev->is_dvi_mode ? "dvi" : "hdmi");
> +	v4l2_dbg(2, debug, v4l2_dev, "deframer_st:%#x\n", deframer_st);
> +
> +	if (!hdmirx_check_timing_valid(bt))
> +		return -EINVAL;
> +
> +	return 0;
> +}
> +
> +static bool port_no_link(struct snps_hdmirx_dev *hdmirx_dev)
> +{
> +	return !tx_5v_power_present(hdmirx_dev);
> +}
> +
> +static int hdmirx_query_dv_timings(struct file *file, void *_fh,
> +				   struct v4l2_dv_timings *timings)
> +{
> +	struct hdmirx_stream *stream = video_drvdata(file);
> +	struct snps_hdmirx_dev *hdmirx_dev = stream->hdmirx_dev;
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +	int ret;
> +
> +	if (port_no_link(hdmirx_dev)) {
> +		v4l2_err(v4l2_dev, "%s: port has no link\n", __func__);
> +		return -ENOLINK;
> +	}
> +
> +	if (signal_not_lock(hdmirx_dev)) {
> +		v4l2_err(v4l2_dev, "%s: signal is not locked\n", __func__);
> +		return -ENOLCK;
> +	}
> +
> +	ret = hdmirx_get_detected_timings(hdmirx_dev, timings, true);
> +	if (ret)
> +		return ret;
> +
> +	if (debug)
> +		v4l2_print_dv_timings(hdmirx_dev->v4l2_dev.name,
> +				      "query_dv_timings: ", timings, false);
> +
> +	if (!v4l2_valid_dv_timings(timings, &hdmirx_timings_cap, NULL, NULL)) {
> +		v4l2_dbg(1, debug, v4l2_dev, "%s: timings out of range\n", __func__);
> +		return -ERANGE;
> +	}
> +
> +	return 0;
> +}
> +
> +static void hdmirx_hpd_ctrl(struct snps_hdmirx_dev *hdmirx_dev, bool en)
> +{
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +
> +	v4l2_dbg(1, debug, v4l2_dev, "%s: %sable, hpd_trigger_level:%d\n",
> +		 __func__, en ? "en" : "dis",
> +		 hdmirx_dev->hpd_trigger_level);
> +	hdmirx_update_bits(hdmirx_dev, SCDC_CONFIG, HPDLOW, en ? 0 : HPDLOW);
> +	en = hdmirx_dev->hpd_trigger_level ? en : !en;
> +	hdmirx_writel(hdmirx_dev, CORE_CONFIG, en);
> +}
> +
> +static int hdmirx_write_edid(struct snps_hdmirx_dev *hdmirx_dev,
> +			     struct v4l2_edid *edid, bool hpd_up)
> +{
> +	u32 edid_len = edid->blocks * EDID_BLOCK_SIZE;
> +	char data[300];
> +	u32 i;
> +
> +	memset(edid->reserved, 0, sizeof(edid->reserved));
> +	if (edid->pad)
> +		return -EINVAL;
> +
> +	if (edid->start_block)
> +		return -EINVAL;
> +
> +	if (edid->blocks > EDID_NUM_BLOCKS_MAX) {
> +		edid->blocks = EDID_NUM_BLOCKS_MAX;
> +		return -E2BIG;
> +	}
> +
> +	if (!edid->blocks) {
> +		hdmirx_dev->edid_blocks_written = 0;
> +		return 0;
> +	}
> +
> +	cec_s_phys_addr_from_edid(hdmirx_dev->cec->adap,
> +				  (const struct edid *)edid->edid);
> +
> +	memset(&hdmirx_dev->edid, 0, sizeof(hdmirx_dev->edid));
> +	hdmirx_hpd_ctrl(hdmirx_dev, false);
> +	hdmirx_update_bits(hdmirx_dev, DMA_CONFIG11,
> +			   EDID_READ_EN_MASK |
> +			   EDID_WRITE_EN_MASK |
> +			   EDID_SLAVE_ADDR_MASK,
> +			   EDID_READ_EN(0) |
> +			   EDID_WRITE_EN(1) |
> +			   EDID_SLAVE_ADDR(0x50));
> +	for (i = 0; i < edid_len; i++)
> +		hdmirx_writel(hdmirx_dev, DMA_CONFIG10, edid->edid[i]);
> +
> +	/* read out for debug */
> +	if (debug >= 2) {
> +		hdmirx_update_bits(hdmirx_dev, DMA_CONFIG11,
> +				   EDID_READ_EN_MASK |
> +				   EDID_WRITE_EN_MASK,
> +				   EDID_READ_EN(1) |
> +				   EDID_WRITE_EN(0));
> +		edid_len = edid_len > sizeof(data) ? sizeof(data) : edid_len;
> +		memset(data, 0, sizeof(data));
> +		for (i = 0; i < edid_len; i++)
> +			data[i] = hdmirx_readl(hdmirx_dev, DMA_STATUS14);
> +
> +		print_hex_dump(KERN_INFO, "", DUMP_PREFIX_NONE, 16, 1, data,
> +			       edid_len, false);
> +	}
> +
> +	/*
> +	 * You must set EDID_READ_EN & EDID_WRITE_EN bit to 0,
> +	 * when the read/write edid operation is completed.Otherwise, it
> +	 * will affect the reading and writing of other registers
> +	 */
> +	hdmirx_update_bits(hdmirx_dev, DMA_CONFIG11,
> +			   EDID_READ_EN_MASK | EDID_WRITE_EN_MASK,
> +			   EDID_READ_EN(0) | EDID_WRITE_EN(0));
> +
> +	hdmirx_dev->edid_blocks_written = edid->blocks;
> +	memcpy(&hdmirx_dev->edid, edid->edid, edid->blocks * EDID_BLOCK_SIZE);
> +	if (hpd_up) {
> +		if (tx_5v_power_present(hdmirx_dev)) {
> +			/* Add 100ms delay after updating the EDID as per HDMI specs */
> +			msleep(100);
> +			hdmirx_hpd_ctrl(hdmirx_dev, true);
> +		}
> +	}
> +
> +	return 0;
> +}
> +
> +/*
> + * Before clearing interrupt, we need to read the interrupt status.
> + */
> +static inline void hdmirx_clear_interrupt(struct snps_hdmirx_dev *hdmirx_dev,
> +					  u32 reg, u32 val)
> +{
> +	/* (interrupt status register) = (interrupt clear register) - 0x8 */
> +	hdmirx_readl(hdmirx_dev, reg - 0x8);
> +	hdmirx_writel(hdmirx_dev, reg, val);
> +}
> +
> +static void hdmirx_interrupts_setup(struct snps_hdmirx_dev *hdmirx_dev, bool en)
> +{
> +	v4l2_dbg(1, debug, &hdmirx_dev->v4l2_dev, "%s: %sable\n",
> +		 __func__, en ? "en" : "dis");
> +
> +	/* Note: In DVI mode, it needs to be written twice to take effect. */
> +	hdmirx_clear_interrupt(hdmirx_dev, MAINUNIT_0_INT_CLEAR, 0xffffffff);
> +	hdmirx_clear_interrupt(hdmirx_dev, MAINUNIT_2_INT_CLEAR, 0xffffffff);
> +	hdmirx_clear_interrupt(hdmirx_dev, MAINUNIT_0_INT_CLEAR, 0xffffffff);
> +	hdmirx_clear_interrupt(hdmirx_dev, MAINUNIT_2_INT_CLEAR, 0xffffffff);
> +	hdmirx_clear_interrupt(hdmirx_dev, AVPUNIT_0_INT_CLEAR, 0xffffffff);
> +
> +	if (en) {
> +		hdmirx_update_bits(hdmirx_dev, MAINUNIT_0_INT_MASK_N,
> +				   TMDSQPCLK_OFF_CHG | TMDSQPCLK_LOCKED_CHG,
> +				   TMDSQPCLK_OFF_CHG | TMDSQPCLK_LOCKED_CHG);
> +		hdmirx_update_bits(hdmirx_dev, MAINUNIT_2_INT_MASK_N,
> +				   TMDSVALID_STABLE_CHG, TMDSVALID_STABLE_CHG);
> +		hdmirx_update_bits(hdmirx_dev, AVPUNIT_0_INT_MASK_N,
> +				   CED_DYN_CNT_CH2_IRQ |
> +				   CED_DYN_CNT_CH1_IRQ |
> +				   CED_DYN_CNT_CH0_IRQ,
> +				   CED_DYN_CNT_CH2_IRQ |
> +				   CED_DYN_CNT_CH1_IRQ |
> +				   CED_DYN_CNT_CH0_IRQ);
> +	} else {
> +		hdmirx_writel(hdmirx_dev, MAINUNIT_0_INT_MASK_N, 0);
> +		hdmirx_writel(hdmirx_dev, MAINUNIT_2_INT_MASK_N, 0);
> +		hdmirx_writel(hdmirx_dev, AVPUNIT_0_INT_MASK_N, 0);
> +	}
> +}
> +
> +static void hdmirx_plugout(struct snps_hdmirx_dev *hdmirx_dev)
> +{
> +	struct arm_smccc_res res;
> +
> +	hdmirx_update_bits(hdmirx_dev, SCDC_CONFIG, POWERPROVIDED, 0);
> +	hdmirx_interrupts_setup(hdmirx_dev, false);
> +	hdmirx_hpd_ctrl(hdmirx_dev, false);
> +	hdmirx_update_bits(hdmirx_dev, DMA_CONFIG6, HDMIRX_DMA_EN, 0);
> +	hdmirx_update_bits(hdmirx_dev, DMA_CONFIG4,
> +			   LINE_FLAG_INT_EN |
> +			   HDMIRX_DMA_IDLE_INT |
> +			   HDMIRX_LOCK_DISABLE_INT |
> +			   LAST_FRAME_AXI_UNFINISH_INT_EN |
> +			   FIFO_OVERFLOW_INT_EN |
> +			   FIFO_UNDERFLOW_INT_EN |
> +			   HDMIRX_AXI_ERROR_INT_EN, 0);
> +	hdmirx_reset_dma(hdmirx_dev);
> +	hdmirx_update_bits(hdmirx_dev, PHY_CONFIG, HDMI_DISABLE | PHY_RESET |
> +			   PHY_PDDQ, HDMI_DISABLE);
> +	hdmirx_writel(hdmirx_dev, PHYCREG_CONFIG0, 0x0);
> +	cancel_delayed_work(&hdmirx_dev->delayed_work_res_change);
> +	cancel_delayed_work_sync(&hdmirx_dev->delayed_work_heartbeat);
> +	flush_work(&hdmirx_dev->work_wdt_config);
> +	arm_smccc_smc(SIP_WDT_CFG, WDT_STOP, 0, 0, 0, 0, 0, 0, &res);
> +}
> +
> +static int hdmirx_set_edid(struct file *file, void *fh, struct v4l2_edid *edid)
> +{
> +	struct hdmirx_stream *stream = video_drvdata(file);
> +	struct snps_hdmirx_dev *hdmirx_dev = stream->hdmirx_dev;
> +	struct arm_smccc_res res;
> +	int ret;
> +
> +	disable_irq(hdmirx_dev->hdmi_irq);
> +	disable_irq(hdmirx_dev->dma_irq);
> +	arm_smccc_smc(RK_SIP_FIQ_CTRL, RK_SIP_FIQ_CTRL_FIQ_DIS,
> +		      RK_IRQ_HDMIRX_HDMI, 0, 0, 0, 0, 0, &res);
> +
> +	if (tx_5v_power_present(hdmirx_dev))
> +		hdmirx_plugout(hdmirx_dev);
> +	ret = hdmirx_write_edid(hdmirx_dev, edid, false);
> +	if (ret)
> +		return ret;
> +
> +	enable_irq(hdmirx_dev->hdmi_irq);
> +	enable_irq(hdmirx_dev->dma_irq);
> +	arm_smccc_smc(RK_SIP_FIQ_CTRL, RK_SIP_FIQ_CTRL_FIQ_EN,
> +		      RK_IRQ_HDMIRX_HDMI, 0, 0, 0, 0, 0, &res);
> +	queue_delayed_work(system_unbound_wq,
> +			   &hdmirx_dev->delayed_work_hotplug,
> +			   msecs_to_jiffies(500));
> +	return 0;
> +}
> +
> +static int hdmirx_get_edid(struct file *file, void *fh, struct v4l2_edid *edid)
> +{
> +	struct hdmirx_stream *stream = video_drvdata(file);
> +	struct snps_hdmirx_dev *hdmirx_dev = stream->hdmirx_dev;
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +
> +	memset(edid->reserved, 0, sizeof(edid->reserved));
> +
> +	if (edid->pad)
> +		return -EINVAL;
> +
> +	if (!edid->start_block && !edid->blocks) {
> +		edid->blocks = hdmirx_dev->edid_blocks_written;
> +		return 0;
> +	}
> +
> +	if (!hdmirx_dev->edid_blocks_written)
> +		return -ENODATA;
> +
> +	if (edid->start_block >= hdmirx_dev->edid_blocks_written || !edid->blocks)
> +		return -EINVAL;
> +
> +	if (edid->start_block + edid->blocks > hdmirx_dev->edid_blocks_written)
> +		edid->blocks = hdmirx_dev->edid_blocks_written - edid->start_block;
> +
> +	memcpy(edid->edid, &hdmirx_dev->edid, edid->blocks * EDID_BLOCK_SIZE);
> +
> +	v4l2_dbg(1, debug, v4l2_dev, "%s: read EDID:\n", __func__);
> +	if (debug > 0)
> +		print_hex_dump(KERN_INFO, "", DUMP_PREFIX_NONE, 16, 1,
> +			       edid->edid, edid->blocks * EDID_BLOCK_SIZE, false);
> +
> +	return 0;
> +}
> +
> +static int hdmirx_g_parm(struct file *file, void *priv,
> +			 struct v4l2_streamparm *parm)
> +{
> +	struct hdmirx_stream *stream = video_drvdata(file);
> +	struct snps_hdmirx_dev *hdmirx_dev = stream->hdmirx_dev;
> +	struct v4l2_fract fps;
> +
> +	if (parm->type != V4L2_BUF_TYPE_VIDEO_CAPTURE_MPLANE)
> +		return -EINVAL;
> +
> +	fps = v4l2_calc_timeperframe(&hdmirx_dev->timings);
> +	parm->parm.capture.timeperframe.numerator = fps.numerator;
> +	parm->parm.capture.timeperframe.denominator = fps.denominator;
> +
> +	return 0;
> +}
> +
> +static int hdmirx_dv_timings_cap(struct file *file, void *fh,
> +				 struct v4l2_dv_timings_cap *cap)
> +{
> +	*cap = hdmirx_timings_cap;
> +	return 0;
> +}
> +
> +static int hdmirx_enum_dv_timings(struct file *file, void *_fh,
> +				  struct v4l2_enum_dv_timings *timings)
> +{
> +	return v4l2_enum_dv_timings_cap(timings, &hdmirx_timings_cap, NULL, NULL);
> +}
> +
> +static void hdmirx_scdc_init(struct snps_hdmirx_dev *hdmirx_dev)
> +{
> +	hdmirx_update_bits(hdmirx_dev, I2C_SLAVE_CONFIG1,
> +			   I2C_SDA_OUT_HOLD_VALUE_QST_MASK |
> +			   I2C_SDA_IN_HOLD_VALUE_QST_MASK,
> +			   I2C_SDA_OUT_HOLD_VALUE_QST(0x80) |
> +			   I2C_SDA_IN_HOLD_VALUE_QST(0x15));
> +	hdmirx_update_bits(hdmirx_dev, SCDC_REGBANK_CONFIG0,
> +			   SCDC_SINKVERSION_QST_MASK,
> +			   SCDC_SINKVERSION_QST(1));
> +}
> +
> +static int wait_reg_bit_status(struct snps_hdmirx_dev *hdmirx_dev, u32 reg,
> +			       u32 bit_mask, u32 expect_val, bool is_grf,
> +			       u32 ms)
> +{
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +	u32 i, val;
> +
> +	for (i = 0; i < ms; i++) {
> +		if (is_grf)
> +			regmap_read(hdmirx_dev->grf, reg, &val);
> +		else
> +			val = hdmirx_readl(hdmirx_dev, reg);
> +
> +		if ((val & bit_mask) == expect_val) {
> +			v4l2_dbg(2, debug, v4l2_dev,
> +				 "%s:  i:%d, time: %dms\n", __func__, i, ms);
> +			break;
> +		}
> +		usleep_range(1000, 1010);
> +	}
> +
> +	if (i == ms)
> +		return -1;
> +
> +	return 0;
> +}
> +
> +static int hdmirx_phy_register_write(struct snps_hdmirx_dev *hdmirx_dev,
> +				     u32 phy_reg, u32 val)
> +{
> +	struct device *dev = hdmirx_dev->dev;
> +
> +	reinit_completion(&hdmirx_dev->cr_write_done);
> +	/* clear irq status */
> +	hdmirx_clear_interrupt(hdmirx_dev, MAINUNIT_2_INT_CLEAR, 0xffffffff);
> +	/* en irq */
> +	hdmirx_update_bits(hdmirx_dev, MAINUNIT_2_INT_MASK_N,
> +			   PHYCREG_CR_WRITE_DONE, PHYCREG_CR_WRITE_DONE);
> +	/* write phy reg addr */
> +	hdmirx_writel(hdmirx_dev, PHYCREG_CONFIG1, phy_reg);
> +	/* write phy reg val */
> +	hdmirx_writel(hdmirx_dev, PHYCREG_CONFIG2, val);
> +	/* config write enable */
> +	hdmirx_writel(hdmirx_dev, PHYCREG_CONTROL, PHYCREG_CR_PARA_WRITE_P);
> +
> +	if (!wait_for_completion_timeout(&hdmirx_dev->cr_write_done,
> +					 msecs_to_jiffies(20))) {
> +		dev_err(dev, "%s wait cr write done failed\n", __func__);
> +		return -1;
> +	}
> +
> +	return 0;
> +}
> +
> +static void hdmirx_tmds_clk_ratio_config(struct snps_hdmirx_dev *hdmirx_dev)
> +{
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +	u32 val;
> +
> +	val = hdmirx_readl(hdmirx_dev, SCDC_REGBANK_STATUS1);
> +	v4l2_dbg(3, debug, v4l2_dev, "%s: scdc_regbank_st:%#x\n", __func__, val);
> +	hdmirx_dev->tmds_clk_ratio = (val & SCDC_TMDSBITCLKRATIO) > 0;
> +
> +	if (hdmirx_dev->tmds_clk_ratio) {
> +		v4l2_dbg(3, debug, v4l2_dev, "%s: HDMITX greater than 3.4Gbps\n", __func__);
> +		hdmirx_update_bits(hdmirx_dev, PHY_CONFIG,
> +				   TMDS_CLOCK_RATIO, TMDS_CLOCK_RATIO);
> +	} else {
> +		v4l2_dbg(3, debug, v4l2_dev, "%s: HDMITX less than 3.4Gbps\n", __func__);
> +		hdmirx_update_bits(hdmirx_dev, PHY_CONFIG,
> +				   TMDS_CLOCK_RATIO, 0);
> +	}
> +}
> +
> +static void hdmirx_phy_config(struct snps_hdmirx_dev *hdmirx_dev)
> +{
> +	struct device *dev = hdmirx_dev->dev;
> +
> +	hdmirx_clear_interrupt(hdmirx_dev, SCDC_INT_CLEAR, 0xffffffff);
> +	hdmirx_update_bits(hdmirx_dev, SCDC_INT_MASK_N, SCDCTMDSCCFG_CHG,
> +			   SCDCTMDSCCFG_CHG);
> +	/* cr_para_clk 24M */
> +	hdmirx_update_bits(hdmirx_dev, PHY_CONFIG, REFFREQ_SEL_MASK, REFFREQ_SEL(0));
> +	/* rx data width 40bit valid */
> +	hdmirx_update_bits(hdmirx_dev, PHY_CONFIG, RXDATA_WIDTH, RXDATA_WIDTH);
> +	hdmirx_update_bits(hdmirx_dev, PHY_CONFIG, PHY_RESET, PHY_RESET);
> +	usleep_range(100, 110);
> +	hdmirx_update_bits(hdmirx_dev, PHY_CONFIG, PHY_RESET, 0);
> +	usleep_range(100, 110);
> +	/* select cr para interface */
> +	hdmirx_writel(hdmirx_dev, PHYCREG_CONFIG0, 0x3);
> +
> +	if (wait_reg_bit_status(hdmirx_dev, SYS_GRF_SOC_STATUS1,
> +				HDMIRXPHY_SRAM_INIT_DONE,
> +				HDMIRXPHY_SRAM_INIT_DONE, true, 10))
> +		dev_err(dev, "%s: phy SRAM init failed\n", __func__);
> +
> +	regmap_write(hdmirx_dev->grf, SYS_GRF_SOC_CON1,
> +		     (HDMIRXPHY_SRAM_EXT_LD_DONE << 16) |
> +		     HDMIRXPHY_SRAM_EXT_LD_DONE);
> +	hdmirx_phy_register_write(hdmirx_dev, SUP_DIG_ANA_CREGS_SUP_ANA_NC, 2);
> +	hdmirx_phy_register_write(hdmirx_dev, SUP_DIG_ANA_CREGS_SUP_ANA_NC, 3);
> +	hdmirx_phy_register_write(hdmirx_dev, SUP_DIG_ANA_CREGS_SUP_ANA_NC, 2);
> +	hdmirx_phy_register_write(hdmirx_dev, SUP_DIG_ANA_CREGS_SUP_ANA_NC, 2);
> +	hdmirx_phy_register_write(hdmirx_dev, SUP_DIG_ANA_CREGS_SUP_ANA_NC, 3);
> +	hdmirx_phy_register_write(hdmirx_dev, SUP_DIG_ANA_CREGS_SUP_ANA_NC, 2);
> +	hdmirx_phy_register_write(hdmirx_dev, SUP_DIG_ANA_CREGS_SUP_ANA_NC, 0);
> +	hdmirx_phy_register_write(hdmirx_dev, SUP_DIG_ANA_CREGS_SUP_ANA_NC, 1);
> +	hdmirx_phy_register_write(hdmirx_dev, SUP_DIG_ANA_CREGS_SUP_ANA_NC, 0);
> +	hdmirx_phy_register_write(hdmirx_dev, SUP_DIG_ANA_CREGS_SUP_ANA_NC, 0);
> +
> +	hdmirx_phy_register_write(hdmirx_dev,
> +				  HDMIPCS_DIG_CTRL_PATH_MAIN_FSM_RATE_CALC_HDMI14_CDR_SETTING_3_REG,
> +				  CDR_SETTING_BOUNDARY_3_DEFAULT);
> +	hdmirx_phy_register_write(hdmirx_dev,
> +				  HDMIPCS_DIG_CTRL_PATH_MAIN_FSM_RATE_CALC_HDMI14_CDR_SETTING_4_REG,
> +				  CDR_SETTING_BOUNDARY_4_DEFAULT);
> +	hdmirx_phy_register_write(hdmirx_dev,
> +				  HDMIPCS_DIG_CTRL_PATH_MAIN_FSM_RATE_CALC_HDMI14_CDR_SETTING_5_REG,
> +				  CDR_SETTING_BOUNDARY_5_DEFAULT);
> +	hdmirx_phy_register_write(hdmirx_dev,
> +				  HDMIPCS_DIG_CTRL_PATH_MAIN_FSM_RATE_CALC_HDMI14_CDR_SETTING_6_REG,
> +				  CDR_SETTING_BOUNDARY_6_DEFAULT);
> +	hdmirx_phy_register_write(hdmirx_dev,
> +				  HDMIPCS_DIG_CTRL_PATH_MAIN_FSM_RATE_CALC_HDMI14_CDR_SETTING_7_REG,
> +				  CDR_SETTING_BOUNDARY_7_DEFAULT);
> +
> +	hdmirx_update_bits(hdmirx_dev, PHY_CONFIG, PHY_PDDQ, 0);
> +	if (wait_reg_bit_status(hdmirx_dev, PHY_STATUS, PDDQ_ACK, 0, false, 10))
> +		dev_err(dev, "%s: wait pddq ack failed\n", __func__);
> +
> +	hdmirx_update_bits(hdmirx_dev, PHY_CONFIG, HDMI_DISABLE, 0);
> +	if (wait_reg_bit_status(hdmirx_dev, PHY_STATUS, HDMI_DISABLE_ACK, 0,
> +				false, 50))
> +		dev_err(dev, "%s: wait hdmi disable ack failed\n", __func__);
> +
> +	hdmirx_tmds_clk_ratio_config(hdmirx_dev);
> +}
> +
> +static void hdmirx_controller_init(struct snps_hdmirx_dev *hdmirx_dev)
> +{
> +	struct device *dev = hdmirx_dev->dev;
> +
> +	reinit_completion(&hdmirx_dev->timer_base_lock);
> +	hdmirx_clear_interrupt(hdmirx_dev, MAINUNIT_0_INT_CLEAR, 0xffffffff);
> +	/* en irq */
> +	hdmirx_update_bits(hdmirx_dev, MAINUNIT_0_INT_MASK_N,
> +			   TIMER_BASE_LOCKED_IRQ, TIMER_BASE_LOCKED_IRQ);
> +	/* write irefclk freq */
> +	hdmirx_writel(hdmirx_dev, GLOBAL_TIMER_REF_BASE, IREF_CLK_FREQ_HZ);
> +
> +	if (!wait_for_completion_timeout(&hdmirx_dev->timer_base_lock,
> +					 msecs_to_jiffies(20)))
> +		dev_err(dev, "%s wait timer base lock failed\n", __func__);
> +
> +	hdmirx_update_bits(hdmirx_dev, CMU_CONFIG0,
> +			   TMDSQPCLK_STABLE_FREQ_MARGIN_MASK |
> +			   AUDCLK_STABLE_FREQ_MARGIN_MASK,
> +			   TMDSQPCLK_STABLE_FREQ_MARGIN(2) |
> +			   AUDCLK_STABLE_FREQ_MARGIN(1));
> +	hdmirx_update_bits(hdmirx_dev, DESCRAND_EN_CONTROL,
> +			   SCRAMB_EN_SEL_QST_MASK, SCRAMB_EN_SEL_QST(1));
> +	hdmirx_update_bits(hdmirx_dev, CED_CONFIG,
> +			   CED_VIDDATACHECKEN_QST |
> +			   CED_DATAISCHECKEN_QST |
> +			   CED_GBCHECKEN_QST |
> +			   CED_CTRLCHECKEN_QST |
> +			   CED_CHLOCKMAXER_QST_MASK,
> +			   CED_VIDDATACHECKEN_QST |
> +			   CED_GBCHECKEN_QST |
> +			   CED_CTRLCHECKEN_QST |
> +			   CED_CHLOCKMAXER_QST(0x10));
> +	hdmirx_update_bits(hdmirx_dev, DEFRAMER_CONFIG0,
> +			   VS_REMAPFILTER_EN_QST | VS_FILTER_ORDER_QST_MASK,
> +			   VS_REMAPFILTER_EN_QST | VS_FILTER_ORDER_QST(0x3));
> +}
> +
> +static void hdmirx_set_negative_pol(struct snps_hdmirx_dev *hdmirx_dev, bool en)
> +{
> +	if (en) {
> +		hdmirx_update_bits(hdmirx_dev, DMA_CONFIG6,
> +				   VSYNC_TOGGLE_EN | HSYNC_TOGGLE_EN,
> +				   VSYNC_TOGGLE_EN | HSYNC_TOGGLE_EN);
> +		hdmirx_update_bits(hdmirx_dev, VIDEO_CONFIG2,
> +				   VPROC_VSYNC_POL_OVR_VALUE |
> +				   VPROC_VSYNC_POL_OVR_EN |
> +				   VPROC_HSYNC_POL_OVR_VALUE |
> +				   VPROC_HSYNC_POL_OVR_EN,
> +				   VPROC_VSYNC_POL_OVR_EN |
> +				   VPROC_HSYNC_POL_OVR_EN);
> +		return;
> +	}
> +
> +	hdmirx_update_bits(hdmirx_dev, DMA_CONFIG6,
> +			   VSYNC_TOGGLE_EN | HSYNC_TOGGLE_EN, 0);
> +
> +	hdmirx_update_bits(hdmirx_dev, VIDEO_CONFIG2,
> +			   VPROC_VSYNC_POL_OVR_VALUE |
> +			   VPROC_VSYNC_POL_OVR_EN |
> +			   VPROC_HSYNC_POL_OVR_VALUE |
> +			   VPROC_HSYNC_POL_OVR_EN, 0);
> +}
> +
> +static int hdmirx_try_to_get_timings(struct snps_hdmirx_dev *hdmirx_dev,
> +				     struct v4l2_dv_timings *timings,
> +				     int try_cnt)
> +{
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +	int i, cnt = 0, fail_cnt = 0, ret = 0;
> +	bool from_dma = false;
> +
> +	hdmirx_set_negative_pol(hdmirx_dev, false);
> +	for (i = 0; i < try_cnt; i++) {
> +		ret = hdmirx_get_detected_timings(hdmirx_dev, timings, from_dma);
> +		if (ret) {
> +			cnt = 0;
> +			fail_cnt++;
> +			if (fail_cnt > 3) {
> +				hdmirx_set_negative_pol(hdmirx_dev, true);
> +				from_dma = true;
> +			}
> +		} else {
> +			cnt++;
> +		}
> +		if (cnt >= 5)
> +			break;
> +
> +		usleep_range(10 * 1000, 10 * 1100);
> +	}
> +
> +	if (try_cnt > 8 && cnt < 5)
> +		v4l2_dbg(1, debug, v4l2_dev, "%s: res not stable\n", __func__);
> +
> +	return ret;
> +}
> +
> +static void hdmirx_format_change(struct snps_hdmirx_dev *hdmirx_dev)
> +{
> +	struct v4l2_dv_timings timings;
> +	struct hdmirx_stream *stream = &hdmirx_dev->stream;
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +	const struct v4l2_event ev_src_chg = {
> +		.type = V4L2_EVENT_SOURCE_CHANGE,
> +		.u.src_change.changes = V4L2_EVENT_SRC_CH_RESOLUTION,
> +	};
> +
> +	if (hdmirx_try_to_get_timings(hdmirx_dev, &timings, 20)) {
> +		queue_delayed_work(system_unbound_wq,
> +				   &hdmirx_dev->delayed_work_hotplug,
> +				   msecs_to_jiffies(20));
> +		return;
> +	}
> +
> +	hdmirx_dev->got_timing = true;
> +	v4l2_dbg(1, debug, v4l2_dev, "%s: queue res_chg_event\n", __func__);
> +	v4l2_event_queue(&stream->vdev, &ev_src_chg);
> +}
> +
> +static void hdmirx_set_ddr_store_fmt(struct snps_hdmirx_dev *hdmirx_dev)
> +{
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +	enum ddr_store_fmt store_fmt;
> +	u32 dma_cfg1;
> +
> +	switch (hdmirx_dev->pix_fmt) {
> +	case HDMIRX_RGB888:
> +		store_fmt = STORE_RGB888;
> +		break;
> +	case HDMIRX_YUV444:
> +		store_fmt = STORE_YUV444_8BIT;
> +		break;
> +	case HDMIRX_YUV422:
> +		store_fmt = STORE_YUV422_8BIT;
> +		break;
> +	case HDMIRX_YUV420:
> +		store_fmt = STORE_YUV420_8BIT;
> +		break;
> +	default:
> +		store_fmt = STORE_RGB888;
> +		break;
> +	}
> +
> +	hdmirx_update_bits(hdmirx_dev, DMA_CONFIG1,
> +			   DDR_STORE_FORMAT_MASK, DDR_STORE_FORMAT(store_fmt));
> +	dma_cfg1 = hdmirx_readl(hdmirx_dev, DMA_CONFIG1);
> +	v4l2_dbg(1, debug, v4l2_dev, "%s: pix_fmt: %s, DMA_CONFIG1:%#x\n",
> +		 __func__, pix_fmt_str[hdmirx_dev->pix_fmt], dma_cfg1);
> +}
> +
> +static int hdmirx_wait_lock_and_get_timing(struct snps_hdmirx_dev *hdmirx_dev)
> +{
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +	u32 mu_status, scdc_status, dma_st10, cmu_st;
> +	u32 i;
> +
> +	for (i = 0; i < 300; i++) {
> +		mu_status = hdmirx_readl(hdmirx_dev, MAINUNIT_STATUS);
> +		scdc_status = hdmirx_readl(hdmirx_dev, SCDC_REGBANK_STATUS3);
> +		dma_st10 = hdmirx_readl(hdmirx_dev, DMA_STATUS10);
> +		cmu_st = hdmirx_readl(hdmirx_dev, CMU_STATUS);
> +
> +		if ((mu_status & TMDSVALID_STABLE_ST) &&
> +		    (dma_st10 & HDMIRX_LOCK) &&
> +		    (cmu_st & TMDSQPCLK_LOCKED_ST))
> +			break;
> +
> +		if (!tx_5v_power_present(hdmirx_dev)) {
> +			v4l2_err(v4l2_dev, "%s: HDMI pull out, return\n", __func__);
> +			return -1;
> +		}
> +
> +		hdmirx_tmds_clk_ratio_config(hdmirx_dev);
> +	}
> +
> +	if (i == 300) {
> +		v4l2_err(v4l2_dev, "%s: signal not lock, tmds_clk_ratio:%d\n",
> +			 __func__, hdmirx_dev->tmds_clk_ratio);
> +		v4l2_err(v4l2_dev, "%s: mu_st:%#x, scdc_st:%#x, dma_st10:%#x\n",
> +			 __func__, mu_status, scdc_status, dma_st10);
> +		return -1;
> +	}
> +
> +	v4l2_info(v4l2_dev, "%s: signal lock ok, i:%d\n", __func__, i);
> +	hdmirx_writel(hdmirx_dev, GLOBAL_SWRESET_REQUEST, DATAPATH_SWRESETREQ);
> +
> +	reinit_completion(&hdmirx_dev->avi_pkt_rcv);
> +	hdmirx_clear_interrupt(hdmirx_dev, PKT_2_INT_CLEAR, 0xffffffff);
> +	hdmirx_update_bits(hdmirx_dev, PKT_2_INT_MASK_N,
> +			   PKTDEC_AVIIF_RCV_IRQ, PKTDEC_AVIIF_RCV_IRQ);
> +
> +	if (!wait_for_completion_timeout(&hdmirx_dev->avi_pkt_rcv,
> +					 msecs_to_jiffies(300))) {
> +		v4l2_err(v4l2_dev, "%s wait avi_pkt_rcv failed\n", __func__);
> +		hdmirx_update_bits(hdmirx_dev, PKT_2_INT_MASK_N,
> +				   PKTDEC_AVIIF_RCV_IRQ, 0);
> +	}
> +
> +	usleep_range(50 * 1000, 50 * 1010);
> +	hdmirx_format_change(hdmirx_dev);
> +
> +	return 0;
> +}
> +
> +static void hdmirx_dma_config(struct snps_hdmirx_dev *hdmirx_dev)
> +{
> +	hdmirx_set_ddr_store_fmt(hdmirx_dev);
> +
> +	/* Note: uv_swap, rb can not swap, doc err*/
> +	if (hdmirx_dev->cur_fmt_fourcc != V4L2_PIX_FMT_NV16)
> +		hdmirx_update_bits(hdmirx_dev, DMA_CONFIG6, RB_SWAP_EN, RB_SWAP_EN);
> +	else
> +		hdmirx_update_bits(hdmirx_dev, DMA_CONFIG6, RB_SWAP_EN, 0);
> +
> +	hdmirx_update_bits(hdmirx_dev, DMA_CONFIG7,
> +			   LOCK_FRAME_NUM_MASK,
> +			   LOCK_FRAME_NUM(2));
> +	hdmirx_update_bits(hdmirx_dev, DMA_CONFIG1,
> +			   UV_WID_MASK | Y_WID_MASK | ABANDON_EN,
> +			   UV_WID(1) | Y_WID(2) | ABANDON_EN);
> +}
> +
> +static void hdmirx_submodule_init(struct snps_hdmirx_dev *hdmirx_dev)
> +{
> +	/* Note: if not config HDCP2_CONFIG, there will be some errors; */
> +	hdmirx_update_bits(hdmirx_dev, HDCP2_CONFIG,
> +			   HDCP2_SWITCH_OVR_VALUE |
> +			   HDCP2_SWITCH_OVR_EN,
> +			   HDCP2_SWITCH_OVR_EN);
> +	hdmirx_scdc_init(hdmirx_dev);
> +	hdmirx_controller_init(hdmirx_dev);
> +}
> +
> +static int hdmirx_enum_input(struct file *file, void *priv,
> +			     struct v4l2_input *input)
> +{
> +	if (input->index > 0)
> +		return -EINVAL;
> +
> +	input->type = V4L2_INPUT_TYPE_CAMERA;
> +	input->std = 0;
> +	strscpy(input->name, "HDMI IN", sizeof(input->name));
> +	input->capabilities = V4L2_IN_CAP_DV_TIMINGS;
> +
> +	return 0;
> +}
> +
> +static int hdmirx_get_input(struct file *file, void *priv, unsigned int *i)
> +{
> +	*i = 0;
> +	return 0;
> +}
> +
> +static int hdmirx_set_input(struct file *file, void *priv, unsigned int i)
> +{
> +	if (i)
> +		return -EINVAL;
> +	return 0;
> +}
> +
> +static void hdmirx_set_fmt(struct hdmirx_stream *stream,
> +			   struct v4l2_pix_format_mplane *pixm, bool try)
> +{
> +	struct snps_hdmirx_dev *hdmirx_dev = stream->hdmirx_dev;
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +	struct v4l2_bt_timings *bt = &hdmirx_dev->timings.bt;
> +	const struct v4l2_format_info *finfo;
> +	unsigned int imagesize = 0;
> +	int i;
> +
> +	memset(&pixm->plane_fmt[0], 0, sizeof(struct v4l2_plane_pix_format));
> +	finfo = v4l2_format_info(pixm->pixelformat);
> +	if (!finfo) {
> +		finfo = v4l2_format_info(V4L2_PIX_FMT_BGR24);
> +		v4l2_dbg(1, debug, v4l2_dev,
> +			 "%s: set_fmt:%#x not supported, use def_fmt:%x\n",
> +			 __func__, pixm->pixelformat, finfo->format);
> +	}
> +
> +	if (!bt->width || !bt->height)
> +		v4l2_dbg(1, debug, v4l2_dev, "%s: invalid resolution:%#xx%#x\n",
> +			 __func__, bt->width, bt->height);
> +
> +	pixm->pixelformat = finfo->format;
> +	pixm->width = bt->width;
> +	pixm->height = bt->height;
> +	pixm->num_planes = finfo->mem_planes;
> +	pixm->quantization = V4L2_QUANTIZATION_DEFAULT;
> +	pixm->colorspace = V4L2_COLORSPACE_SRGB;
> +	pixm->ycbcr_enc = V4L2_YCBCR_ENC_DEFAULT;
> +
> +	if (bt->interlaced == V4L2_DV_INTERLACED)
> +		pixm->field = V4L2_FIELD_INTERLACED_TB;
> +	else
> +		pixm->field = V4L2_FIELD_NONE;
> +
> +	memset(pixm->reserved, 0, sizeof(pixm->reserved));
> +
> +	v4l2_fill_pixfmt_mp(pixm, finfo->format, pixm->width, pixm->height);
> +
> +	for (i = 0; i < pixm->num_planes; i++) {
> +		struct v4l2_plane_pix_format *plane_fmt;
> +		int width, height, bpl, size, bpp = 0;
> +
> +		if (!i) {
> +			width = pixm->width;
> +			height = pixm->height;
> +		} else {
> +			width = pixm->width / finfo->hdiv;
> +			height = pixm->height / finfo->vdiv;
> +		}
> +
> +		switch (finfo->format) {
> +		case V4L2_PIX_FMT_NV24:
> +		case V4L2_PIX_FMT_NV16:
> +		case V4L2_PIX_FMT_NV12:
> +		case V4L2_PIX_FMT_BGR24:
> +			bpp = finfo->bpp[i];
> +			break;
> +		default:
> +			v4l2_dbg(1, debug, v4l2_dev,
> +				 "fourcc: %#x is not supported\n",
> +				 finfo->format);
> +			break;
> +		}
> +
> +		bpl = ALIGN(width * bpp, MEMORY_ALIGN_ROUND_UP_BYTES);
> +		size = bpl * height;
> +		imagesize += size;
> +
> +		if (finfo->mem_planes > i) {
> +			/* Set bpl and size for each mplane */
> +			plane_fmt = pixm->plane_fmt + i;
> +			plane_fmt->bytesperline = bpl;
> +			plane_fmt->sizeimage = size;
> +		}
> +
> +		v4l2_dbg(1, debug, v4l2_dev,
> +			 "C-Plane %i size: %d, Total imagesize: %d\n",
> +			 i, size, imagesize);
> +	}
> +
> +	/* Convert to non-MPLANE format as we want to unify non-MPLANE and MPLANE */
> +	if (finfo->mem_planes == 1)
> +		pixm->plane_fmt[0].sizeimage = imagesize;
> +
> +	if (!try) {
> +		stream->out_finfo = finfo;
> +		stream->pixm = *pixm;
> +		v4l2_dbg(1, debug, v4l2_dev,
> +			 "%s: req(%d, %d), out(%d, %d), fmt:%#x\n", __func__,
> +			 pixm->width, pixm->height, stream->pixm.width,
> +			 stream->pixm.height, finfo->format);
> +	}
> +}
> +
> +static int hdmirx_enum_fmt_vid_cap_mplane(struct file *file, void *priv,
> +					  struct v4l2_fmtdesc *f)
> +{
> +	struct hdmirx_stream *stream = video_drvdata(file);
> +	struct snps_hdmirx_dev *hdmirx_dev = stream->hdmirx_dev;
> +
> +	if (f->index >= 1)
> +		return -EINVAL;
> +
> +	f->pixelformat = hdmirx_dev->cur_fmt_fourcc;
> +
> +	return 0;
> +}
> +
> +static int hdmirx_s_fmt_vid_cap_mplane(struct file *file,
> +				       void *priv, struct v4l2_format *f)
> +{
> +	struct hdmirx_stream *stream = video_drvdata(file);
> +	struct snps_hdmirx_dev *hdmirx_dev = stream->hdmirx_dev;
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +
> +	if (vb2_is_busy(&stream->buf_queue)) {
> +		v4l2_err(v4l2_dev, "%s: queue busy\n", __func__);
> +		return -EBUSY;
> +	}
> +
> +	hdmirx_set_fmt(stream, &f->fmt.pix_mp, false);
> +
> +	return 0;
> +}
> +
> +static int hdmirx_g_fmt_vid_cap_mplane(struct file *file, void *fh,
> +				       struct v4l2_format *f)
> +{
> +	struct hdmirx_stream *stream = video_drvdata(file);
> +	struct snps_hdmirx_dev *hdmirx_dev = stream->hdmirx_dev;
> +	struct v4l2_pix_format_mplane pixm = {};
> +
> +	pixm.pixelformat = hdmirx_dev->cur_fmt_fourcc;
> +	hdmirx_set_fmt(stream, &pixm, true);
> +	f->fmt.pix_mp = pixm;
> +
> +	return 0;
> +}
> +
> +static int hdmirx_g_dv_timings(struct file *file, void *_fh,
> +			       struct v4l2_dv_timings *timings)
> +{
> +	struct hdmirx_stream *stream = video_drvdata(file);
> +	struct snps_hdmirx_dev *hdmirx_dev = stream->hdmirx_dev;
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +	u32 dma_cfg1;
> +
> +	*timings = hdmirx_dev->timings;
> +	dma_cfg1 = hdmirx_readl(hdmirx_dev, DMA_CONFIG1);
> +	v4l2_dbg(1, debug, v4l2_dev, "%s: pix_fmt: %s, DMA_CONFIG1:%#x\n",
> +		 __func__, pix_fmt_str[hdmirx_dev->pix_fmt], dma_cfg1);
> +
> +	return 0;
> +}
> +
> +static int hdmirx_s_dv_timings(struct file *file, void *_fh,
> +			       struct v4l2_dv_timings *timings)
> +{
> +	struct hdmirx_stream *stream = video_drvdata(file);
> +	struct snps_hdmirx_dev *hdmirx_dev = stream->hdmirx_dev;
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +
> +	if (!timings)
> +		return -EINVAL;
> +
> +	if (debug)
> +		v4l2_print_dv_timings(hdmirx_dev->v4l2_dev.name,
> +				      "s_dv_timings: ", timings, false);
> +
> +	if (!v4l2_valid_dv_timings(timings, &hdmirx_timings_cap, NULL, NULL)) {
> +		v4l2_dbg(1, debug, v4l2_dev,
> +			 "%s: timings out of range\n", __func__);
> +		return -ERANGE;
> +	}
> +
> +	/* Check if the timings are part of the CEA-861 timings. */
> +	v4l2_find_dv_timings_cap(timings, &hdmirx_timings_cap, 0, NULL, NULL);
> +
> +	if (v4l2_match_dv_timings(&hdmirx_dev->timings, timings, 0, false)) {
> +		v4l2_dbg(1, debug, v4l2_dev, "%s: no change\n", __func__);
> +		return 0;
> +	}
> +
> +	/*
> +	 * Changing the timings implies a format change, which is not allowed
> +	 * while buffers for use with streaming have already been allocated.
> +	 */
> +	if (vb2_is_busy(&stream->buf_queue))
> +		return -EBUSY;
> +
> +	hdmirx_dev->timings = *timings;
> +	/* Update the internal format */
> +	hdmirx_set_fmt(stream, &stream->pixm, false);
> +
> +	return 0;
> +}
> +
> +static int hdmirx_querycap(struct file *file, void *priv,
> +			   struct v4l2_capability *cap)
> +{
> +	struct hdmirx_stream *stream = video_drvdata(file);
> +	struct device *dev = stream->hdmirx_dev->dev;
> +
> +	strscpy(cap->driver, dev->driver->name, sizeof(cap->driver));
> +	strscpy(cap->card, dev->driver->name, sizeof(cap->card));
> +
> +	return 0;
> +}
> +
> +static int hdmirx_queue_setup(struct vb2_queue *queue,
> +			      unsigned int *num_buffers,
> +			      unsigned int *num_planes,
> +			      unsigned int sizes[],
> +			      struct device *alloc_ctxs[])
> +{
> +	struct hdmirx_stream *stream = vb2_get_drv_priv(queue);
> +	struct snps_hdmirx_dev *hdmirx_dev = stream->hdmirx_dev;
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +	const struct v4l2_pix_format_mplane *pixm = NULL;
> +	const struct v4l2_format_info *out_finfo;
> +	u32 i, height;
> +
> +	pixm = &stream->pixm;
> +	out_finfo = stream->out_finfo;
> +
> +	if (!num_planes || !out_finfo) {
> +		v4l2_err(v4l2_dev, "%s: out_fmt not set\n", __func__);
> +		return -EINVAL;
> +	}
> +
> +	if (*num_planes) {
> +		if (*num_planes != pixm->num_planes)
> +			return -EINVAL;
> +
> +		for (i = 0; i < *num_planes; i++)
> +			if (sizes[i] < pixm->plane_fmt[i].sizeimage)
> +				return -EINVAL;
> +		return 0;
> +	}
> +
> +	*num_planes = out_finfo->mem_planes;
> +	height = pixm->height;
> +
> +	for (i = 0; i < out_finfo->mem_planes; i++)
> +		sizes[i] = pixm->plane_fmt[i].sizeimage;
> +
> +	v4l2_dbg(1, debug, v4l2_dev, "%s: count %d, size %d\n",
> +		 v4l2_type_names[queue->type], *num_buffers, sizes[0]);
> +
> +	return 0;
> +}
> +
> +/*
> + * The vb2_buffer are stored in hdmirx_buffer, in order to unify
> + * mplane buffer and none-mplane buffer.
> + */
> +static void hdmirx_buf_queue(struct vb2_buffer *vb)
> +{
> +	const struct v4l2_format_info *out_finfo;
> +	struct vb2_v4l2_buffer *vbuf;
> +	struct hdmirx_buffer *hdmirx_buf;
> +	struct vb2_queue *queue;
> +	struct hdmirx_stream *stream;
> +	const struct v4l2_pix_format_mplane *pixm;
> +	unsigned long lock_flags = 0;
> +	int i;
> +
> +	vbuf = to_vb2_v4l2_buffer(vb);
> +	hdmirx_buf = container_of(vbuf, struct hdmirx_buffer, vb);
> +	queue = vb->vb2_queue;
> +	stream = vb2_get_drv_priv(queue);
> +	pixm = &stream->pixm;
> +	out_finfo = stream->out_finfo;
> +
> +	memset(hdmirx_buf->buff_addr, 0, sizeof(hdmirx_buf->buff_addr));
> +
> +	/*
> +	 * If mplanes > 1, every c-plane has its own m-plane,
> +	 * otherwise, multiple c-planes are in the same m-plane
> +	 */
> +	for (i = 0; i < out_finfo->mem_planes; i++)
> +		hdmirx_buf->buff_addr[i] = vb2_dma_contig_plane_dma_addr(vb, i);
> +
> +	if (out_finfo->mem_planes == 1) {
> +		if (out_finfo->comp_planes == 1) {
> +			hdmirx_buf->buff_addr[HDMIRX_PLANE_CBCR] =
> +				hdmirx_buf->buff_addr[HDMIRX_PLANE_Y];
> +		} else {
> +			for (i = 0; i < out_finfo->comp_planes - 1; i++)
> +				hdmirx_buf->buff_addr[i + 1] =
> +					hdmirx_buf->buff_addr[i] +
> +					pixm->plane_fmt[i].bytesperline *
> +					pixm->height;
> +		}
> +	}
> +
> +	spin_lock_irqsave(&stream->vbq_lock, lock_flags);
> +	list_add_tail(&hdmirx_buf->queue, &stream->buf_head);
> +	spin_unlock_irqrestore(&stream->vbq_lock, lock_flags);
> +}
> +
> +static void return_all_buffers(struct hdmirx_stream *stream,
> +			       enum vb2_buffer_state state)
> +{
> +	struct hdmirx_buffer *buf;
> +	unsigned long flags;
> +
> +	spin_lock_irqsave(&stream->vbq_lock, flags);
> +	if (stream->curr_buf)
> +		list_add_tail(&stream->curr_buf->queue, &stream->buf_head);
> +	if (stream->next_buf && stream->next_buf != stream->curr_buf)
> +		list_add_tail(&stream->next_buf->queue, &stream->buf_head);
> +	stream->curr_buf = NULL;
> +	stream->next_buf = NULL;
> +
> +	while (!list_empty(&stream->buf_head)) {
> +		buf = list_first_entry(&stream->buf_head,
> +				       struct hdmirx_buffer, queue);
> +		list_del(&buf->queue);
> +		spin_unlock_irqrestore(&stream->vbq_lock, flags);
> +		vb2_buffer_done(&buf->vb.vb2_buf, state);
> +		spin_lock_irqsave(&stream->vbq_lock, flags);
> +	}
> +	spin_unlock_irqrestore(&stream->vbq_lock, flags);
> +}
> +
> +static void hdmirx_stop_streaming(struct vb2_queue *queue)
> +{
> +	struct hdmirx_stream *stream = vb2_get_drv_priv(queue);
> +	struct snps_hdmirx_dev *hdmirx_dev = stream->hdmirx_dev;
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +	int ret;
> +
> +	v4l2_info(v4l2_dev, "stream start stopping\n");
> +	mutex_lock(&hdmirx_dev->stream_lock);
> +	WRITE_ONCE(stream->stopping, true);
> +
> +	/* wait last irq to return the buffer */
> +	ret = wait_event_timeout(stream->wq_stopped, !stream->stopping,
> +				 msecs_to_jiffies(500));
> +	if (!ret) {
> +		v4l2_err(v4l2_dev, "%s: timeout waiting last irq\n",
> +			 __func__);
> +		WRITE_ONCE(stream->stopping, false);
> +	}
> +
> +	hdmirx_update_bits(hdmirx_dev, DMA_CONFIG6, HDMIRX_DMA_EN, 0);
> +	return_all_buffers(stream, VB2_BUF_STATE_ERROR);
> +	mutex_unlock(&hdmirx_dev->stream_lock);
> +	v4l2_info(v4l2_dev, "stream stopping finished\n");
> +}
> +
> +static int hdmirx_start_streaming(struct vb2_queue *queue, unsigned int count)
> +{
> +	struct hdmirx_stream *stream = vb2_get_drv_priv(queue);
> +	struct snps_hdmirx_dev *hdmirx_dev = stream->hdmirx_dev;
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +	struct v4l2_dv_timings timings = hdmirx_dev->timings;
> +	struct v4l2_bt_timings *bt = &timings.bt;
> +	unsigned long lock_flags = 0;
> +	int line_flag;
> +
> +	if (!hdmirx_dev->got_timing) {
> +		v4l2_dbg(1, debug, v4l2_dev, "timing is invalid\n");
> +		return 0;
> +	}
> +
> +	mutex_lock(&hdmirx_dev->stream_lock);
> +	stream->frame_idx = 0;
> +	stream->line_flag_int_cnt = 0;
> +	stream->curr_buf = NULL;
> +	stream->next_buf = NULL;
> +	stream->irq_stat = 0;
> +	queue->min_queued_buffers = 1;
> +
> +	WRITE_ONCE(stream->stopping, false);
> +
> +	spin_lock_irqsave(&stream->vbq_lock, lock_flags);
> +	if (!stream->curr_buf) {
> +		if (!list_empty(&stream->buf_head)) {
> +			stream->curr_buf = list_first_entry(&stream->buf_head,
> +							    struct hdmirx_buffer,
> +							    queue);
> +			list_del(&stream->curr_buf->queue);
> +		} else {
> +			stream->curr_buf = NULL;
> +		}
> +	}
> +	spin_unlock_irqrestore(&stream->vbq_lock, lock_flags);
> +
> +	v4l2_dbg(2, debug, v4l2_dev,
> +		 "%s: start_stream cur_buf y_addr:%#x, uv_addr:%#x\n",
> +		 __func__, stream->curr_buf->buff_addr[HDMIRX_PLANE_Y],
> +		 stream->curr_buf->buff_addr[HDMIRX_PLANE_CBCR]);
> +	hdmirx_writel(hdmirx_dev, DMA_CONFIG2,
> +		      stream->curr_buf->buff_addr[HDMIRX_PLANE_Y]);
> +	hdmirx_writel(hdmirx_dev, DMA_CONFIG3,
> +		      stream->curr_buf->buff_addr[HDMIRX_PLANE_CBCR]);
> +
> +	if (bt->height) {
> +		if (bt->interlaced == V4L2_DV_INTERLACED)
> +			line_flag = bt->height / 4;
> +		else
> +			line_flag = bt->height / 2;
> +		hdmirx_update_bits(hdmirx_dev, DMA_CONFIG7,
> +				   LINE_FLAG_NUM_MASK,
> +				   LINE_FLAG_NUM(line_flag));
> +	} else {
> +		v4l2_err(v4l2_dev, "height err: %d\n", bt->height);
> +	}
> +
> +	hdmirx_writel(hdmirx_dev, DMA_CONFIG5, 0xffffffff);
> +	hdmirx_writel(hdmirx_dev, CED_DYN_CONTROL, 0x1);
> +	hdmirx_update_bits(hdmirx_dev, DMA_CONFIG4,
> +			   LINE_FLAG_INT_EN |
> +			   HDMIRX_DMA_IDLE_INT |
> +			   HDMIRX_LOCK_DISABLE_INT |
> +			   LAST_FRAME_AXI_UNFINISH_INT_EN |
> +			   FIFO_OVERFLOW_INT_EN |
> +			   FIFO_UNDERFLOW_INT_EN |
> +			   HDMIRX_AXI_ERROR_INT_EN,
> +			   LINE_FLAG_INT_EN |
> +			   HDMIRX_DMA_IDLE_INT |
> +			   HDMIRX_LOCK_DISABLE_INT |
> +			   LAST_FRAME_AXI_UNFINISH_INT_EN |
> +			   FIFO_OVERFLOW_INT_EN |
> +			   FIFO_UNDERFLOW_INT_EN |
> +			   HDMIRX_AXI_ERROR_INT_EN);
> +	hdmirx_update_bits(hdmirx_dev, DMA_CONFIG6, HDMIRX_DMA_EN, HDMIRX_DMA_EN);
> +	v4l2_dbg(1, debug, v4l2_dev, "%s: enable dma", __func__);
> +	mutex_unlock(&hdmirx_dev->stream_lock);
> +
> +	return 0;
> +}
> +
> +/* vb2 queue */
> +static const struct vb2_ops hdmirx_vb2_ops = {
> +	.queue_setup = hdmirx_queue_setup,
> +	.buf_queue = hdmirx_buf_queue,
> +	.wait_prepare = vb2_ops_wait_prepare,
> +	.wait_finish = vb2_ops_wait_finish,
> +	.stop_streaming = hdmirx_stop_streaming,
> +	.start_streaming = hdmirx_start_streaming,
> +};
> +
> +static int hdmirx_init_vb2_queue(struct vb2_queue *q,
> +				 struct hdmirx_stream *stream,
> +				 enum v4l2_buf_type buf_type)
> +{
> +	struct snps_hdmirx_dev *hdmirx_dev = stream->hdmirx_dev;
> +
> +	q->type = buf_type;
> +	q->io_modes = VB2_MMAP | VB2_DMABUF;
> +	q->drv_priv = stream;
> +	q->ops = &hdmirx_vb2_ops;
> +	q->mem_ops = &vb2_dma_contig_memops;
> +	q->buf_struct_size = sizeof(struct hdmirx_buffer);
> +	q->timestamp_flags = V4L2_BUF_FLAG_TIMESTAMP_MONOTONIC;
> +	q->lock = &stream->vlock;
> +	q->dev = hdmirx_dev->dev;
> +	/*
> +	 * rk3588 doesn't use iommu and works only with dma buffers
> +	 * that are physically contiguous in memory.
> +	 */
> +	q->dma_attrs = DMA_ATTR_FORCE_CONTIGUOUS;
> +	return vb2_queue_init(q);
> +}
> +
> +/* video device */
> +static const struct v4l2_ioctl_ops hdmirx_v4l2_ioctl_ops = {
> +	.vidioc_querycap = hdmirx_querycap,
> +	.vidioc_try_fmt_vid_cap_mplane = hdmirx_g_fmt_vid_cap_mplane,
> +	.vidioc_s_fmt_vid_cap_mplane = hdmirx_s_fmt_vid_cap_mplane,
> +	.vidioc_g_fmt_vid_cap_mplane = hdmirx_g_fmt_vid_cap_mplane,
> +	.vidioc_enum_fmt_vid_cap = hdmirx_enum_fmt_vid_cap_mplane,
> +
> +	.vidioc_s_dv_timings = hdmirx_s_dv_timings,
> +	.vidioc_g_dv_timings = hdmirx_g_dv_timings,
> +	.vidioc_enum_dv_timings = hdmirx_enum_dv_timings,
> +	.vidioc_query_dv_timings = hdmirx_query_dv_timings,
> +	.vidioc_dv_timings_cap = hdmirx_dv_timings_cap,
> +	.vidioc_enum_input = hdmirx_enum_input,
> +	.vidioc_g_input = hdmirx_get_input,
> +	.vidioc_s_input = hdmirx_set_input,
> +	.vidioc_g_edid = hdmirx_get_edid,
> +	.vidioc_s_edid = hdmirx_set_edid,
> +	.vidioc_g_parm = hdmirx_g_parm,
> +
> +	.vidioc_reqbufs = vb2_ioctl_reqbufs,
> +	.vidioc_querybuf = vb2_ioctl_querybuf,
> +	.vidioc_create_bufs = vb2_ioctl_create_bufs,
> +	.vidioc_qbuf = vb2_ioctl_qbuf,
> +	.vidioc_expbuf = vb2_ioctl_expbuf,
> +	.vidioc_dqbuf = vb2_ioctl_dqbuf,
> +	.vidioc_prepare_buf = vb2_ioctl_prepare_buf,
> +	.vidioc_streamon = vb2_ioctl_streamon,
> +	.vidioc_streamoff = vb2_ioctl_streamoff,
> +
> +	.vidioc_log_status = v4l2_ctrl_log_status,
> +	.vidioc_subscribe_event = hdmirx_subscribe_event,
> +	.vidioc_unsubscribe_event = v4l2_event_unsubscribe,
> +};
> +
> +static const struct v4l2_file_operations hdmirx_fops = {
> +	.owner = THIS_MODULE,
> +	.open = v4l2_fh_open,
> +	.release = vb2_fop_release,
> +	.unlocked_ioctl = video_ioctl2,
> +	.poll = vb2_fop_poll,
> +	.mmap = vb2_fop_mmap,
> +};
> +
> +static int hdmirx_register_stream_vdev(struct hdmirx_stream *stream)
> +{
> +	struct snps_hdmirx_dev *hdmirx_dev = stream->hdmirx_dev;
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +	struct video_device *vdev = &stream->vdev;
> +	int ret = 0;
> +
> +	strscpy(vdev->name, "stream_hdmirx", sizeof(vdev->name));
> +	INIT_LIST_HEAD(&stream->buf_head);
> +	spin_lock_init(&stream->vbq_lock);
> +	mutex_init(&stream->vlock);
> +	init_waitqueue_head(&stream->wq_stopped);
> +	stream->curr_buf = NULL;
> +	stream->next_buf = NULL;
> +
> +	vdev->ioctl_ops = &hdmirx_v4l2_ioctl_ops;
> +	vdev->release = video_device_release_empty;
> +	vdev->fops = &hdmirx_fops;
> +	vdev->minor = -1;
> +	vdev->v4l2_dev = v4l2_dev;
> +	vdev->lock = &stream->vlock;
> +	vdev->device_caps = V4L2_CAP_VIDEO_CAPTURE_MPLANE |
> +			    V4L2_CAP_STREAMING;
> +	video_set_drvdata(vdev, stream);
> +	vdev->vfl_dir = VFL_DIR_RX;
> +
> +	hdmirx_init_vb2_queue(&stream->buf_queue, stream,
> +			      V4L2_BUF_TYPE_VIDEO_CAPTURE_MPLANE);
> +	vdev->queue = &stream->buf_queue;
> +
> +	ret = video_register_device(vdev, VFL_TYPE_VIDEO, -1);
> +	if (ret < 0) {
> +		v4l2_err(v4l2_dev, "video_register_device failed: %d\n", ret);
> +		return ret;
> +	}
> +
> +	return 0;
> +}
> +
> +static void process_signal_change(struct snps_hdmirx_dev *hdmirx_dev)
> +{
> +	hdmirx_update_bits(hdmirx_dev, DMA_CONFIG6, HDMIRX_DMA_EN, 0);
> +	hdmirx_update_bits(hdmirx_dev, DMA_CONFIG4,
> +			   LINE_FLAG_INT_EN |
> +			   HDMIRX_DMA_IDLE_INT |
> +			   HDMIRX_LOCK_DISABLE_INT |
> +			   LAST_FRAME_AXI_UNFINISH_INT_EN |
> +			   FIFO_OVERFLOW_INT_EN |
> +			   FIFO_UNDERFLOW_INT_EN |
> +			   HDMIRX_AXI_ERROR_INT_EN, 0);
> +	hdmirx_reset_dma(hdmirx_dev);
> +	hdmirx_dev->got_timing = false;
> +	queue_delayed_work(system_unbound_wq,
> +			   &hdmirx_dev->delayed_work_res_change,
> +			   msecs_to_jiffies(50));
> +}
> +
> +static void avpunit_0_int_handler(struct snps_hdmirx_dev *hdmirx_dev,
> +				  int status, bool *handled)
> +{
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +
> +	if (status & (CED_DYN_CNT_CH2_IRQ |
> +		      CED_DYN_CNT_CH1_IRQ |
> +		      CED_DYN_CNT_CH0_IRQ)) {
> +		process_signal_change(hdmirx_dev);
> +		v4l2_dbg(2, debug, v4l2_dev, "%s: avp0_st:%#x\n",
> +			 __func__, status);
> +		*handled = true;
> +	}
> +
> +	hdmirx_clear_interrupt(hdmirx_dev, AVPUNIT_0_INT_CLEAR, 0xffffffff);
> +	hdmirx_writel(hdmirx_dev, AVPUNIT_0_INT_FORCE, 0x0);
> +}
> +
> +static void avpunit_1_int_handler(struct snps_hdmirx_dev *hdmirx_dev,
> +				  int status, bool *handled)
> +{
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +
> +	if (status & DEFRAMER_VSYNC_THR_REACHED_IRQ) {
> +		v4l2_info(v4l2_dev, "Vertical Sync threshold reached interrupt %#x", status);
> +		hdmirx_update_bits(hdmirx_dev, AVPUNIT_1_INT_MASK_N,
> +				   DEFRAMER_VSYNC_THR_REACHED_MASK_N, 0);
> +		*handled = true;
> +	}
> +}
> +
> +static void mainunit_0_int_handler(struct snps_hdmirx_dev *hdmirx_dev,
> +				   int status, bool *handled)
> +{
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +
> +	v4l2_dbg(2, debug, v4l2_dev, "mu0_st:%#x\n", status);
> +	if (status & TIMER_BASE_LOCKED_IRQ) {
> +		hdmirx_update_bits(hdmirx_dev, MAINUNIT_0_INT_MASK_N,
> +				   TIMER_BASE_LOCKED_IRQ, 0);
> +		complete(&hdmirx_dev->timer_base_lock);
> +		*handled = true;
> +	}
> +
> +	if (status & TMDSQPCLK_OFF_CHG) {
> +		process_signal_change(hdmirx_dev);
> +		v4l2_dbg(2, debug, v4l2_dev, "%s: TMDSQPCLK_OFF_CHG\n", __func__);
> +		*handled = true;
> +	}
> +
> +	if (status & TMDSQPCLK_LOCKED_CHG) {
> +		process_signal_change(hdmirx_dev);
> +		v4l2_dbg(2, debug, v4l2_dev, "%s: TMDSQPCLK_LOCKED_CHG\n", __func__);
> +		*handled = true;
> +	}
> +
> +	hdmirx_clear_interrupt(hdmirx_dev, MAINUNIT_0_INT_CLEAR, 0xffffffff);
> +	hdmirx_writel(hdmirx_dev, MAINUNIT_0_INT_FORCE, 0x0);
> +}
> +
> +static void mainunit_2_int_handler(struct snps_hdmirx_dev *hdmirx_dev,
> +				   int status, bool *handled)
> +{
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +
> +	v4l2_dbg(2, debug, v4l2_dev, "mu2_st:%#x\n", status);
> +	if (status & PHYCREG_CR_WRITE_DONE) {
> +		hdmirx_update_bits(hdmirx_dev, MAINUNIT_2_INT_MASK_N,
> +				   PHYCREG_CR_WRITE_DONE, 0);
> +		complete(&hdmirx_dev->cr_write_done);
> +		*handled = true;
> +	}
> +
> +	if (status & TMDSVALID_STABLE_CHG) {
> +		process_signal_change(hdmirx_dev);
> +		v4l2_dbg(2, debug, v4l2_dev, "%s: TMDSVALID_STABLE_CHG\n", __func__);
> +		*handled = true;
> +	}
> +
> +	hdmirx_clear_interrupt(hdmirx_dev, MAINUNIT_2_INT_CLEAR, 0xffffffff);
> +	hdmirx_writel(hdmirx_dev, MAINUNIT_2_INT_FORCE, 0x0);
> +}
> +
> +static void pkt_2_int_handler(struct snps_hdmirx_dev *hdmirx_dev,
> +			      int status, bool *handled)
> +{
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +
> +	v4l2_dbg(2, debug, v4l2_dev, "%s: pk2_st:%#x\n", __func__, status);
> +	if (status & PKTDEC_AVIIF_RCV_IRQ) {
> +		hdmirx_update_bits(hdmirx_dev, PKT_2_INT_MASK_N,
> +				   PKTDEC_AVIIF_RCV_IRQ, 0);
> +		complete(&hdmirx_dev->avi_pkt_rcv);
> +		v4l2_dbg(2, debug, v4l2_dev, "%s: AVIIF_RCV_IRQ\n", __func__);
> +		*handled = true;
> +	}
> +
> +	hdmirx_clear_interrupt(hdmirx_dev, PKT_2_INT_CLEAR, 0xffffffff);
> +}
> +
> +static void scdc_int_handler(struct snps_hdmirx_dev *hdmirx_dev,
> +			     int status, bool *handled)
> +{
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +
> +	v4l2_dbg(2, debug, v4l2_dev, "%s: scdc_st:%#x\n", __func__, status);
> +	if (status & SCDCTMDSCCFG_CHG) {
> +		hdmirx_tmds_clk_ratio_config(hdmirx_dev);
> +		*handled = true;
> +	}
> +
> +	hdmirx_clear_interrupt(hdmirx_dev, SCDC_INT_CLEAR, 0xffffffff);
> +}
> +
> +static irqreturn_t hdmirx_hdmi_irq_handler(int irq, void *dev_id)
> +{
> +	struct snps_hdmirx_dev *hdmirx_dev = dev_id;
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +	struct arm_smccc_res res;
> +	u32 mu0_st, mu2_st, pk2_st, scdc_st, avp1_st, avp0_st;
> +	u32 mu0_mask, mu2_mask, pk2_mask, scdc_mask, avp1_msk, avp0_msk;
> +	bool handled = false;
> +
> +	mu0_mask = hdmirx_readl(hdmirx_dev, MAINUNIT_0_INT_MASK_N);
> +	mu2_mask = hdmirx_readl(hdmirx_dev, MAINUNIT_2_INT_MASK_N);
> +	pk2_mask = hdmirx_readl(hdmirx_dev, PKT_2_INT_MASK_N);
> +	scdc_mask = hdmirx_readl(hdmirx_dev, SCDC_INT_MASK_N);
> +	mu0_st = hdmirx_readl(hdmirx_dev, MAINUNIT_0_INT_STATUS);
> +	mu2_st = hdmirx_readl(hdmirx_dev, MAINUNIT_2_INT_STATUS);
> +	pk2_st = hdmirx_readl(hdmirx_dev, PKT_2_INT_STATUS);
> +	scdc_st = hdmirx_readl(hdmirx_dev, SCDC_INT_STATUS);
> +	avp0_st = hdmirx_readl(hdmirx_dev, AVPUNIT_0_INT_STATUS);
> +	avp1_st = hdmirx_readl(hdmirx_dev, AVPUNIT_1_INT_STATUS);
> +	avp0_msk = hdmirx_readl(hdmirx_dev, AVPUNIT_0_INT_MASK_N);
> +	avp1_msk = hdmirx_readl(hdmirx_dev, AVPUNIT_1_INT_MASK_N);
> +	mu0_st &= mu0_mask;
> +	mu2_st &= mu2_mask;
> +	pk2_st &= pk2_mask;
> +	avp1_st &= avp1_msk;
> +	avp0_st &= avp0_msk;
> +	scdc_st &= scdc_mask;
> +
> +	if (avp0_st)
> +		avpunit_0_int_handler(hdmirx_dev, avp0_st, &handled);
> +	if (avp1_st)
> +		avpunit_1_int_handler(hdmirx_dev, avp1_st, &handled);
> +	if (mu0_st)
> +		mainunit_0_int_handler(hdmirx_dev, mu0_st, &handled);
> +	if (mu2_st)
> +		mainunit_2_int_handler(hdmirx_dev, mu2_st, &handled);
> +	if (pk2_st)
> +		pkt_2_int_handler(hdmirx_dev, pk2_st, &handled);
> +	if (scdc_st)
> +		scdc_int_handler(hdmirx_dev, scdc_st, &handled);
> +
> +	if (!handled) {
> +		v4l2_dbg(2, debug, v4l2_dev, "%s: hdmi irq not handled", __func__);
> +		v4l2_dbg(2, debug, v4l2_dev,
> +			 "avp0:%#x, avp1:%#x, mu0:%#x, mu2:%#x, pk2:%#x, scdc:%#x\n",
> +			 avp0_st, avp1_st, mu0_st, mu2_st, pk2_st, scdc_st);
> +	}
> +
> +	v4l2_dbg(2, debug, v4l2_dev, "%s: en_fiq", __func__);
> +	arm_smccc_smc(RK_SIP_FIQ_CTRL, RK_SIP_FIQ_CTRL_FIQ_EN,
> +		      RK_IRQ_HDMIRX_HDMI, 0, 0, 0, 0, 0, &res);
> +
> +	return handled ? IRQ_HANDLED : IRQ_NONE;
> +}
> +
> +static void hdmirx_vb_done(struct hdmirx_stream *stream,
> +			   struct vb2_v4l2_buffer *vb_done)
> +{
> +	const struct v4l2_format_info *finfo = stream->out_finfo;
> +	u32 i;
> +
> +	/* Dequeue a filled buffer */
> +	for (i = 0; i < finfo->mem_planes; i++) {
> +		vb2_set_plane_payload(&vb_done->vb2_buf, i,
> +				      stream->pixm.plane_fmt[i].sizeimage);
> +	}
> +
> +	vb_done->vb2_buf.timestamp = ktime_get_ns();
> +	vb2_buffer_done(&vb_done->vb2_buf, VB2_BUF_STATE_DONE);
> +}
> +
> +static void dma_idle_int_handler(struct snps_hdmirx_dev *hdmirx_dev,
> +				 bool *handled)
> +{
> +	struct hdmirx_stream *stream = &hdmirx_dev->stream;
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +	struct v4l2_dv_timings timings = hdmirx_dev->timings;
> +	struct v4l2_bt_timings *bt = &timings.bt;
> +	struct vb2_v4l2_buffer *vb_done = NULL;
> +
> +	if (!(stream->irq_stat) && !(stream->irq_stat & LINE_FLAG_INT_EN))
> +		v4l2_dbg(1, debug, v4l2_dev,
> +			 "%s: last time have no line_flag_irq\n", __func__);
> +
> +	if (stream->line_flag_int_cnt <= FILTER_FRAME_CNT)
> +		goto DMA_IDLE_OUT;
> +
> +	if (bt->interlaced != V4L2_DV_INTERLACED ||
> +	    !(stream->line_flag_int_cnt % 2)) {
> +		if (stream->next_buf) {
> +			if (stream->curr_buf)
> +				vb_done = &stream->curr_buf->vb;
> +
> +			if (vb_done) {
> +				vb_done->vb2_buf.timestamp = ktime_get_ns();
> +				vb_done->sequence = stream->frame_idx;
> +				hdmirx_vb_done(stream, vb_done);
> +				stream->frame_idx++;
> +				if (stream->frame_idx == 30)
> +					v4l2_info(v4l2_dev, "rcv frames\n");
> +			}
> +
> +			stream->curr_buf = NULL;
> +			if (stream->next_buf) {
> +				stream->curr_buf = stream->next_buf;
> +				stream->next_buf = NULL;
> +			}
> +		} else {
> +			v4l2_dbg(3, debug, v4l2_dev,
> +				 "%s: next_buf NULL, skip vb_done\n", __func__);
> +		}
> +	}
> +
> +DMA_IDLE_OUT:
> +	*handled = true;
> +}
> +
> +static void line_flag_int_handler(struct snps_hdmirx_dev *hdmirx_dev,
> +				  bool *handled)
> +{
> +	struct hdmirx_stream *stream = &hdmirx_dev->stream;
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +	struct v4l2_dv_timings timings = hdmirx_dev->timings;
> +	struct v4l2_bt_timings *bt = &timings.bt;
> +	u32 dma_cfg6;
> +
> +	stream->line_flag_int_cnt++;
> +	if (!(stream->irq_stat) && !(stream->irq_stat & HDMIRX_DMA_IDLE_INT))
> +		v4l2_dbg(1, debug, v4l2_dev,
> +			 "%s: last have no dma_idle_irq\n", __func__);
> +	dma_cfg6 = hdmirx_readl(hdmirx_dev, DMA_CONFIG6);
> +	if (!(dma_cfg6 & HDMIRX_DMA_EN)) {
> +		v4l2_dbg(2, debug, v4l2_dev, "%s: dma not on\n", __func__);
> +		goto LINE_FLAG_OUT;
> +	}
> +
> +	if (stream->line_flag_int_cnt <= FILTER_FRAME_CNT)
> +		goto LINE_FLAG_OUT;
> +
> +	if (bt->interlaced != V4L2_DV_INTERLACED ||
> +	    !(stream->line_flag_int_cnt % 2)) {
> +		if (!stream->next_buf) {
> +			spin_lock(&stream->vbq_lock);
> +			if (!list_empty(&stream->buf_head)) {
> +				stream->next_buf = list_first_entry(&stream->buf_head,
> +								    struct hdmirx_buffer,
> +								    queue);
> +				list_del(&stream->next_buf->queue);
> +			} else {
> +				stream->next_buf = NULL;
> +			}
> +			spin_unlock(&stream->vbq_lock);
> +
> +			if (stream->next_buf) {
> +				hdmirx_writel(hdmirx_dev, DMA_CONFIG2,
> +					      stream->next_buf->buff_addr[HDMIRX_PLANE_Y]);
> +				hdmirx_writel(hdmirx_dev, DMA_CONFIG3,
> +					      stream->next_buf->buff_addr[HDMIRX_PLANE_CBCR]);
> +			} else {
> +				v4l2_dbg(3, debug, v4l2_dev,
> +					 "%s: no buffer is available\n", __func__);
> +			}
> +		}
> +	} else {
> +		v4l2_dbg(3, debug, v4l2_dev, "%s: interlace:%d, line_flag_int_cnt:%d\n",
> +			 __func__, bt->interlaced, stream->line_flag_int_cnt);
> +	}
> +
> +LINE_FLAG_OUT:
> +	*handled = true;
> +}
> +
> +static irqreturn_t hdmirx_dma_irq_handler(int irq, void *dev_id)
> +{
> +	struct snps_hdmirx_dev *hdmirx_dev = dev_id;
> +	struct hdmirx_stream *stream = &hdmirx_dev->stream;
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +	u32 dma_stat1, dma_stat13;
> +	bool handled = false;
> +
> +	dma_stat1 = hdmirx_readl(hdmirx_dev, DMA_STATUS1);
> +	dma_stat13 = hdmirx_readl(hdmirx_dev, DMA_STATUS13);
> +	v4l2_dbg(3, debug, v4l2_dev, "dma_irq st1:%#x, st13:%d\n",
> +		 dma_stat1, dma_stat13);
> +
> +	if (READ_ONCE(stream->stopping)) {
> +		v4l2_dbg(1, debug, v4l2_dev, "%s: stop stream\n", __func__);
> +		hdmirx_writel(hdmirx_dev, DMA_CONFIG5, 0xffffffff);
> +		hdmirx_update_bits(hdmirx_dev, DMA_CONFIG4,
> +				   LINE_FLAG_INT_EN |
> +				   HDMIRX_DMA_IDLE_INT |
> +				   HDMIRX_LOCK_DISABLE_INT |
> +				   LAST_FRAME_AXI_UNFINISH_INT_EN |
> +				   FIFO_OVERFLOW_INT_EN |
> +				   FIFO_UNDERFLOW_INT_EN |
> +				   HDMIRX_AXI_ERROR_INT_EN, 0);
> +		WRITE_ONCE(stream->stopping, false);
> +		wake_up(&stream->wq_stopped);
> +		return IRQ_HANDLED;
> +	}
> +
> +	if (dma_stat1 & HDMIRX_DMA_IDLE_INT)
> +		dma_idle_int_handler(hdmirx_dev, &handled);
> +
> +	if (dma_stat1 & LINE_FLAG_INT_EN)
> +		line_flag_int_handler(hdmirx_dev, &handled);
> +
> +	if (!handled)
> +		v4l2_dbg(3, debug, v4l2_dev,
> +			 "%s: dma irq not handled, dma_stat1:%#x\n",
> +			 __func__, dma_stat1);
> +
> +	stream->irq_stat = dma_stat1;
> +	hdmirx_writel(hdmirx_dev, DMA_CONFIG5, 0xffffffff);
> +
> +	return IRQ_HANDLED;
> +}
> +
> +static void hdmirx_plugin(struct snps_hdmirx_dev *hdmirx_dev)
> +{
> +	struct arm_smccc_res res;
> +	int ret;
> +
> +	queue_delayed_work(system_unbound_wq,
> +			   &hdmirx_dev->delayed_work_heartbeat,
> +			   msecs_to_jiffies(10));
> +	arm_smccc_smc(SIP_WDT_CFG, WDT_START, 0, 0, 0, 0, 0, 0, &res);
> +	hdmirx_submodule_init(hdmirx_dev);
> +	hdmirx_update_bits(hdmirx_dev, SCDC_CONFIG, POWERPROVIDED,
> +			   POWERPROVIDED);
> +	hdmirx_hpd_ctrl(hdmirx_dev, true);
> +	hdmirx_phy_config(hdmirx_dev);
> +	ret = hdmirx_wait_lock_and_get_timing(hdmirx_dev);
> +	if (ret) {
> +		hdmirx_plugout(hdmirx_dev);
> +		queue_delayed_work(system_unbound_wq,
> +				   &hdmirx_dev->delayed_work_hotplug,
> +				   msecs_to_jiffies(200));
> +		return;
> +	}
> +	hdmirx_dma_config(hdmirx_dev);
> +	hdmirx_interrupts_setup(hdmirx_dev, true);
> +}
> +
> +static void hdmirx_delayed_work_hotplug(struct work_struct *work)
> +{
> +	struct snps_hdmirx_dev *hdmirx_dev;
> +	bool plugin;
> +
> +	hdmirx_dev = container_of(work, struct snps_hdmirx_dev,
> +				  delayed_work_hotplug.work);
> +
> +	mutex_lock(&hdmirx_dev->work_lock);
> +	hdmirx_dev->got_timing = false;
> +	plugin = tx_5v_power_present(hdmirx_dev);
> +	v4l2_ctrl_s_ctrl(hdmirx_dev->detect_tx_5v_ctrl, plugin);
> +	v4l2_dbg(1, debug, &hdmirx_dev->v4l2_dev, "%s: plugin:%d\n",
> +		 __func__, plugin);
> +
> +	if (plugin)
> +		hdmirx_plugin(hdmirx_dev);
> +	else
> +		hdmirx_plugout(hdmirx_dev);
> +
> +	mutex_unlock(&hdmirx_dev->work_lock);
> +}
> +
> +static void hdmirx_delayed_work_res_change(struct work_struct *work)
> +{
> +	struct snps_hdmirx_dev *hdmirx_dev;
> +	bool plugin;
> +
> +	hdmirx_dev = container_of(work, struct snps_hdmirx_dev,
> +				  delayed_work_res_change.work);
> +
> +	mutex_lock(&hdmirx_dev->work_lock);
> +	plugin = tx_5v_power_present(hdmirx_dev);
> +	v4l2_dbg(1, debug, &hdmirx_dev->v4l2_dev, "%s: plugin:%d\n",
> +		 __func__, plugin);
> +	if (plugin) {
> +		hdmirx_interrupts_setup(hdmirx_dev, false);
> +		hdmirx_submodule_init(hdmirx_dev);
> +		hdmirx_update_bits(hdmirx_dev, SCDC_CONFIG, POWERPROVIDED,
> +				   POWERPROVIDED);
> +		hdmirx_hpd_ctrl(hdmirx_dev, true);
> +		hdmirx_phy_config(hdmirx_dev);
> +
> +		if (hdmirx_wait_lock_and_get_timing(hdmirx_dev)) {
> +			hdmirx_plugout(hdmirx_dev);
> +			queue_delayed_work(system_unbound_wq,
> +					   &hdmirx_dev->delayed_work_hotplug,
> +					   msecs_to_jiffies(200));
> +		} else {
> +			hdmirx_dma_config(hdmirx_dev);
> +			hdmirx_interrupts_setup(hdmirx_dev, true);
> +		}
> +	}
> +	mutex_unlock(&hdmirx_dev->work_lock);
> +}
> +
> +static void hdmirx_delayed_work_heartbeat(struct work_struct *work)
> +{
> +	struct delayed_work *dwork = to_delayed_work(work);
> +	struct snps_hdmirx_dev *hdmirx_dev = container_of(dwork,
> +							struct snps_hdmirx_dev,
> +							delayed_work_heartbeat);
> +
> +	queue_work(system_highpri_wq, &hdmirx_dev->work_wdt_config);
> +	queue_delayed_work(system_unbound_wq,
> +			   &hdmirx_dev->delayed_work_heartbeat, HZ);
> +}
> +
> +static void hdmirx_work_wdt_config(struct work_struct *work)
> +{
> +	struct arm_smccc_res res;
> +	struct snps_hdmirx_dev *hdmirx_dev = container_of(work,
> +							struct snps_hdmirx_dev,
> +							work_wdt_config);
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +
> +	arm_smccc_smc(SIP_WDT_CFG, WDT_PING, 0, 0, 0, 0, 0, 0, &res);
> +	v4l2_dbg(3, debug, v4l2_dev, "hb\n");
> +}
> +
> +static irqreturn_t hdmirx_5v_det_irq_handler(int irq, void *dev_id)
> +{
> +	struct snps_hdmirx_dev *hdmirx_dev = dev_id;
> +	u32 val;
> +
> +	val = gpiod_get_value(hdmirx_dev->detect_5v_gpio);
> +	v4l2_dbg(3, debug, &hdmirx_dev->v4l2_dev, "%s: 5v:%d\n", __func__, val);
> +
> +	queue_delayed_work(system_unbound_wq,
> +			   &hdmirx_dev->delayed_work_hotplug,
> +			   msecs_to_jiffies(10));
> +
> +	return IRQ_HANDLED;
> +}
> +
> +static const struct hdmirx_cec_ops hdmirx_cec_ops = {
> +	.write = hdmirx_writel,
> +	.read = hdmirx_readl,
> +};
> +
> +static int hdmirx_parse_dt(struct snps_hdmirx_dev *hdmirx_dev)
> +{
> +	struct device *dev = hdmirx_dev->dev;
> +	int ret;
> +
> +	hdmirx_dev->num_clks = devm_clk_bulk_get_all(dev, &hdmirx_dev->clks);
> +	if (hdmirx_dev->num_clks < 1)
> +		return -ENODEV;
> +
> +	hdmirx_dev->resets[HDMIRX_RST_A].id = "axi";
> +	hdmirx_dev->resets[HDMIRX_RST_P].id = "apb";
> +	hdmirx_dev->resets[HDMIRX_RST_REF].id = "ref";
> +	hdmirx_dev->resets[HDMIRX_RST_BIU].id = "biu";
> +
> +	ret = devm_reset_control_bulk_get_exclusive(dev, HDMIRX_NUM_RST,
> +						    hdmirx_dev->resets);
> +	if (ret < 0) {
> +		dev_err(dev, "failed to get reset controls\n");
> +		return ret;
> +	}
> +
> +	hdmirx_dev->detect_5v_gpio =
> +		devm_gpiod_get_optional(dev, "hpd", GPIOD_IN);
> +
> +	if (IS_ERR(hdmirx_dev->detect_5v_gpio)) {
> +		dev_err(dev, "failed to get hdmirx hot plug detection gpio\n");
> +		return PTR_ERR(hdmirx_dev->detect_5v_gpio);
> +	}
> +
> +	hdmirx_dev->grf = syscon_regmap_lookup_by_phandle(dev->of_node,
> +							  "rockchip,grf");
> +	if (IS_ERR(hdmirx_dev->grf)) {
> +		dev_err(dev, "failed to get rockchip,grf\n");
> +		return PTR_ERR(hdmirx_dev->grf);
> +	}
> +
> +	hdmirx_dev->vo1_grf = syscon_regmap_lookup_by_phandle(dev->of_node,
> +							      "rockchip,vo1-grf");
> +	if (IS_ERR(hdmirx_dev->vo1_grf)) {
> +		dev_err(dev, "failed to get rockchip,vo1-grf\n");
> +		return PTR_ERR(hdmirx_dev->vo1_grf);
> +	}
> +
> +	hdmirx_dev->hpd_trigger_level = !device_property_read_bool(dev, "hpd-is-active-low");
> +
> +	ret = of_reserved_mem_device_init(dev);
> +	if (ret)
> +		dev_warn(dev, "No reserved memory for HDMIRX, use default CMA\n");
> +
> +	return 0;
> +}
> +
> +static void hdmirx_disable_all_interrupts(struct snps_hdmirx_dev *hdmirx_dev)
> +{
> +	hdmirx_writel(hdmirx_dev, MAINUNIT_0_INT_MASK_N, 0);
> +	hdmirx_writel(hdmirx_dev, MAINUNIT_1_INT_MASK_N, 0);
> +	hdmirx_writel(hdmirx_dev, MAINUNIT_2_INT_MASK_N, 0);
> +	hdmirx_writel(hdmirx_dev, AVPUNIT_0_INT_MASK_N, 0);
> +	hdmirx_writel(hdmirx_dev, AVPUNIT_1_INT_MASK_N, 0);
> +	hdmirx_writel(hdmirx_dev, PKT_0_INT_MASK_N, 0);
> +	hdmirx_writel(hdmirx_dev, PKT_1_INT_MASK_N, 0);
> +	hdmirx_writel(hdmirx_dev, PKT_2_INT_MASK_N, 0);
> +	hdmirx_writel(hdmirx_dev, SCDC_INT_MASK_N, 0);
> +	hdmirx_writel(hdmirx_dev, CEC_INT_MASK_N, 0);
> +
> +	hdmirx_clear_interrupt(hdmirx_dev, MAINUNIT_0_INT_CLEAR, 0xffffffff);
> +	hdmirx_clear_interrupt(hdmirx_dev, MAINUNIT_1_INT_CLEAR, 0xffffffff);
> +	hdmirx_clear_interrupt(hdmirx_dev, MAINUNIT_2_INT_CLEAR, 0xffffffff);
> +	hdmirx_clear_interrupt(hdmirx_dev, AVPUNIT_0_INT_CLEAR, 0xffffffff);
> +	hdmirx_clear_interrupt(hdmirx_dev, AVPUNIT_1_INT_CLEAR, 0xffffffff);
> +	hdmirx_clear_interrupt(hdmirx_dev, PKT_0_INT_CLEAR, 0xffffffff);
> +	hdmirx_clear_interrupt(hdmirx_dev, PKT_1_INT_CLEAR, 0xffffffff);
> +	hdmirx_clear_interrupt(hdmirx_dev, PKT_2_INT_CLEAR, 0xffffffff);
> +	hdmirx_clear_interrupt(hdmirx_dev, SCDC_INT_CLEAR, 0xffffffff);
> +	hdmirx_clear_interrupt(hdmirx_dev, HDCP_INT_CLEAR, 0xffffffff);
> +	hdmirx_clear_interrupt(hdmirx_dev, HDCP_1_INT_CLEAR, 0xffffffff);
> +	hdmirx_clear_interrupt(hdmirx_dev, CEC_INT_CLEAR, 0xffffffff);
> +}
> +
> +static int hdmirx_init(struct snps_hdmirx_dev *hdmirx_dev)
> +{
> +	hdmirx_update_bits(hdmirx_dev, PHY_CONFIG, PHY_RESET | PHY_PDDQ, 0);
> +
> +	regmap_write(hdmirx_dev->vo1_grf, VO1_GRF_VO1_CON2,
> +		     (HDMIRX_SDAIN_MSK | HDMIRX_SCLIN_MSK) |
> +		     ((HDMIRX_SDAIN_MSK | HDMIRX_SCLIN_MSK) << 16));
> +	/*
> +	 * Some interrupts are enabled by default, so we disable
> +	 * all interrupts and clear interrupts status first.
> +	 */
> +	hdmirx_disable_all_interrupts(hdmirx_dev);
> +
> +	return 0;
> +}
> +
> +static void hdmirx_load_default_edid(struct snps_hdmirx_dev *hdmirx_dev)
> +{
> +	int ret;
> +	struct v4l2_edid def_edid;
> +
> +	hdmirx_hpd_ctrl(hdmirx_dev, false);
> +
> +	/* disable hpd and write edid */
> +	def_edid.pad = 0;
> +	def_edid.start_block = 0;
> +	def_edid.blocks = EDID_NUM_BLOCKS_MAX;
> +
> +	if (IS_ENABLED(CONFIG_HDMIRX_LOAD_DEFAULT_EDID))
> +		def_edid.edid = edid_init_data_340M;
> +	else
> +		def_edid.edid = hdmirx_dev->edid;
> +
> +	ret = hdmirx_write_edid(hdmirx_dev, &def_edid, true);
> +	if (ret)
> +		dev_err(hdmirx_dev->dev, "%s: write edid failed\n", __func__);
> +}
> +
> +static void hdmirx_disable_irq(struct device *dev)
> +{
> +	struct snps_hdmirx_dev *hdmirx_dev = dev_get_drvdata(dev);
> +	struct arm_smccc_res res;
> +
> +	disable_irq(hdmirx_dev->hdmi_irq);
> +	disable_irq(hdmirx_dev->dma_irq);
> +	disable_irq(hdmirx_dev->det_irq);
> +
> +	arm_smccc_smc(RK_SIP_FIQ_CTRL, RK_SIP_FIQ_CTRL_FIQ_DIS,
> +		      RK_IRQ_HDMIRX_HDMI, 0, 0, 0, 0, 0, &res);
> +
> +	cancel_delayed_work_sync(&hdmirx_dev->delayed_work_hotplug);
> +	cancel_delayed_work_sync(&hdmirx_dev->delayed_work_res_change);
> +	cancel_delayed_work_sync(&hdmirx_dev->delayed_work_heartbeat);
> +	flush_work(&hdmirx_dev->work_wdt_config);
> +
> +	arm_smccc_smc(SIP_WDT_CFG, WDT_STOP, 0, 0, 0, 0, 0, 0, &res);
> +}
> +
> +static int hdmirx_disable(struct device *dev)
> +{
> +	struct snps_hdmirx_dev *hdmirx_dev = dev_get_drvdata(dev);
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +
> +	clk_bulk_disable_unprepare(hdmirx_dev->num_clks, hdmirx_dev->clks);
> +
> +	v4l2_dbg(2, debug, v4l2_dev, "%s: suspend\n", __func__);
> +
> +	return pinctrl_pm_select_sleep_state(dev);
> +}
> +
> +static void hdmirx_enable_irq(struct device *dev)
> +{
> +	struct snps_hdmirx_dev *hdmirx_dev = dev_get_drvdata(dev);
> +	struct arm_smccc_res res;
> +
> +	enable_irq(hdmirx_dev->hdmi_irq);
> +	enable_irq(hdmirx_dev->dma_irq);
> +	enable_irq(hdmirx_dev->det_irq);
> +
> +	arm_smccc_smc(RK_SIP_FIQ_CTRL, RK_SIP_FIQ_CTRL_FIQ_EN,
> +		      RK_IRQ_HDMIRX_HDMI, 0, 0, 0, 0, 0, &res);
> +
> +	queue_delayed_work(system_unbound_wq, &hdmirx_dev->delayed_work_hotplug,
> +			   msecs_to_jiffies(20));
> +}
> +
> +static int hdmirx_enable(struct device *dev)
> +{
> +	struct snps_hdmirx_dev *hdmirx_dev = dev_get_drvdata(dev);
> +	struct v4l2_device *v4l2_dev = &hdmirx_dev->v4l2_dev;
> +	int ret;
> +
> +	v4l2_dbg(2, debug, v4l2_dev, "%s: resume\n", __func__);
> +	ret = pinctrl_pm_select_default_state(dev);
> +	if (ret < 0)
> +		return ret;
> +
> +	ret = clk_bulk_prepare_enable(hdmirx_dev->num_clks, hdmirx_dev->clks);
> +	if (ret) {
> +		dev_err(dev, "failed to enable hdmirx bulk clks: %d\n", ret);
> +		return ret;
> +	}
> +
> +	reset_control_bulk_assert(HDMIRX_NUM_RST, hdmirx_dev->resets);
> +	usleep_range(150, 160);
> +	reset_control_bulk_deassert(HDMIRX_NUM_RST, hdmirx_dev->resets);
> +	usleep_range(150, 160);
> +
> +	return 0;
> +}
> +
> +static int hdmirx_suspend(struct device *dev)
> +{
> +	hdmirx_disable_irq(dev);
> +
> +	return hdmirx_disable(dev);
> +}
> +
> +static int hdmirx_resume(struct device *dev)
> +{
> +	int ret = hdmirx_enable(dev);
> +
> +	if (ret)
> +		return ret;
> +
> +	hdmirx_enable_irq(dev);
> +
> +	return 0;
> +}
> +
> +static const struct dev_pm_ops snps_hdmirx_pm_ops = {
> +	SET_SYSTEM_SLEEP_PM_OPS(hdmirx_suspend, hdmirx_resume)
> +};
> +
> +static int hdmirx_setup_irq(struct snps_hdmirx_dev *hdmirx_dev,
> +			    struct platform_device *pdev)
> +{
> +	struct device *dev = hdmirx_dev->dev;
> +	int ret, irq;
> +
> +	irq = platform_get_irq_byname(pdev, "hdmi");
> +	if (irq < 0) {
> +		dev_err_probe(dev, irq, "failed to get hdmi irq\n");
> +		return irq;
> +	}
> +
> +	irq_set_status_flags(irq, IRQ_NOAUTOEN);
> +
> +	hdmirx_dev->hdmi_irq = irq;
> +	ret = devm_request_irq(dev, irq, hdmirx_hdmi_irq_handler, 0,
> +			       "rk_hdmirx-hdmi", hdmirx_dev);
> +	if (ret) {
> +		dev_err_probe(dev, ret, "failed to request hdmi irq\n");
> +		return ret;
> +	}
> +
> +	irq = platform_get_irq_byname(pdev, "dma");
> +	if (irq < 0) {
> +		dev_err_probe(dev, irq, "failed to get dma irq\n");
> +		return irq;
> +	}
> +
> +	irq_set_status_flags(irq, IRQ_NOAUTOEN);
> +
> +	hdmirx_dev->dma_irq = irq;
> +	ret = devm_request_threaded_irq(dev, irq, NULL, hdmirx_dma_irq_handler,
> +					IRQF_ONESHOT, "rk_hdmirx-dma",
> +					hdmirx_dev);
> +	if (ret) {
> +		dev_err_probe(dev, ret, "failed to request dma irq\n");
> +		return ret;
> +	}
> +
> +	irq = gpiod_to_irq(hdmirx_dev->detect_5v_gpio);
> +	if (irq < 0) {
> +		dev_err_probe(dev, irq, "failed to get hdmirx-5v irq\n");
> +		return irq;
> +	}
> +
> +	irq_set_status_flags(irq, IRQ_NOAUTOEN);
> +
> +	hdmirx_dev->det_irq = irq;
> +	ret = devm_request_irq(dev, irq, hdmirx_5v_det_irq_handler,
> +			       IRQF_TRIGGER_FALLING | IRQF_TRIGGER_RISING,
> +			       "rk_hdmirx-5v", hdmirx_dev);
> +	if (ret) {
> +		dev_err_probe(dev, ret, "failed to request hdmirx-5v irq\n");
> +		return ret;
> +	}
> +
> +	return 0;
> +}
> +
> +static int hdmirx_register_cec(struct snps_hdmirx_dev *hdmirx_dev,
> +			       struct platform_device *pdev)
> +{
> +	struct device *dev = hdmirx_dev->dev;
> +	struct hdmirx_cec_data cec_data;
> +	int irq;
> +
> +	irq = platform_get_irq_byname(pdev, "cec");
> +	if (irq < 0) {
> +		dev_err_probe(dev, irq, "failed to get cec irq\n");
> +		return irq;
> +	}
> +
> +	hdmirx_dev->cec_notifier = cec_notifier_conn_register(dev, NULL, NULL);
> +	if (!hdmirx_dev->cec_notifier)
> +		return -EINVAL;
> +
> +	cec_data.hdmirx = hdmirx_dev;
> +	cec_data.dev = hdmirx_dev->dev;
> +	cec_data.ops = &hdmirx_cec_ops;
> +	cec_data.irq = irq;
> +
> +	hdmirx_dev->cec = snps_hdmirx_cec_register(&cec_data);
> +	if (!hdmirx_dev->cec) {
> +		cec_notifier_conn_unregister(hdmirx_dev->cec_notifier);
> +		return -EINVAL;
> +	}
> +
> +	return 0;
> +}
> +
> +static int hdmirx_probe(struct platform_device *pdev)
> +{
> +	struct snps_hdmirx_dev *hdmirx_dev;
> +	struct device *dev = &pdev->dev;
> +	struct v4l2_ctrl_handler *hdl;
> +	struct hdmirx_stream *stream;
> +	struct v4l2_device *v4l2_dev;
> +	int ret;
> +
> +	hdmirx_dev = devm_kzalloc(dev, sizeof(*hdmirx_dev), GFP_KERNEL);
> +	if (!hdmirx_dev)
> +		return -ENOMEM;
> +
> +	ret = dma_coerce_mask_and_coherent(dev, DMA_BIT_MASK(32));
> +	if (ret)
> +		return ret;
> +
> +	hdmirx_dev->dev = dev;
> +	dev_set_drvdata(dev, hdmirx_dev);
> +
> +	ret = hdmirx_parse_dt(hdmirx_dev);
> +	if (ret)
> +		return ret;
> +
> +	ret = hdmirx_setup_irq(hdmirx_dev, pdev);
> +	if (ret)
> +		return ret;
> +
> +	hdmirx_dev->regs = devm_platform_ioremap_resource(pdev, 0);
> +	if (IS_ERR(hdmirx_dev->regs))
> +		return dev_err_probe(dev, PTR_ERR(hdmirx_dev->regs),
> +				     "failed to remap regs resource\n");
> +
> +	mutex_init(&hdmirx_dev->stream_lock);
> +	mutex_init(&hdmirx_dev->work_lock);
> +	spin_lock_init(&hdmirx_dev->rst_lock);
> +
> +	init_completion(&hdmirx_dev->cr_write_done);
> +	init_completion(&hdmirx_dev->timer_base_lock);
> +	init_completion(&hdmirx_dev->avi_pkt_rcv);
> +
> +	INIT_WORK(&hdmirx_dev->work_wdt_config, hdmirx_work_wdt_config);
> +	INIT_DELAYED_WORK(&hdmirx_dev->delayed_work_hotplug,
> +			  hdmirx_delayed_work_hotplug);
> +	INIT_DELAYED_WORK(&hdmirx_dev->delayed_work_res_change,
> +			  hdmirx_delayed_work_res_change);
> +	INIT_DELAYED_WORK(&hdmirx_dev->delayed_work_heartbeat,
> +			  hdmirx_delayed_work_heartbeat);
> +
> +	hdmirx_dev->cur_fmt_fourcc = V4L2_PIX_FMT_BGR24;
> +	hdmirx_dev->timings = cea640x480;
> +
> +	hdmirx_enable(dev);
> +	hdmirx_init(hdmirx_dev);
> +
> +	v4l2_dev = &hdmirx_dev->v4l2_dev;
> +	strscpy(v4l2_dev->name, dev_name(dev), sizeof(v4l2_dev->name));
> +
> +	hdl = &hdmirx_dev->hdl;
> +	v4l2_ctrl_handler_init(hdl, 1);
> +
> +	hdmirx_dev->detect_tx_5v_ctrl = v4l2_ctrl_new_std(hdl, NULL,
> +							  V4L2_CID_DV_RX_POWER_PRESENT,
> +							  0, 1, 0, 0);
> +
> +	hdmirx_dev->rgb_range = v4l2_ctrl_new_std_menu(hdl, 0,
> +						       V4L2_CID_DV_RX_RGB_RANGE,
> +						       V4L2_DV_RGB_RANGE_FULL, 0,
> +						       V4L2_DV_RGB_RANGE_AUTO);
> +
> +	hdmirx_dev->rgb_range->flags |= V4L2_CTRL_FLAG_READ_ONLY;
> +
> +	if (hdl->error) {
> +		dev_err(dev, "v4l2 ctrl handler init failed\n");
> +		ret = hdl->error;
> +		goto err_pm;
> +	}
> +	hdmirx_dev->v4l2_dev.ctrl_handler = hdl;
> +
> +	ret = v4l2_device_register(dev, &hdmirx_dev->v4l2_dev);
> +	if (ret < 0) {
> +		dev_err(dev, "register v4l2 device failed\n");
> +		goto err_hdl;
> +	}
> +
> +	stream = &hdmirx_dev->stream;
> +	stream->hdmirx_dev = hdmirx_dev;
> +	ret = hdmirx_register_stream_vdev(stream);
> +	if (ret < 0) {
> +		dev_err(dev, "register video device failed\n");
> +		goto err_unreg_v4l2_dev;
> +	}
> +
> +	ret = hdmirx_register_cec(hdmirx_dev, pdev);
> +	if (ret)
> +		goto err_unreg_video_dev;
> +
> +	hdmirx_load_default_edid(hdmirx_dev);
> +
> +	hdmirx_enable_irq(dev);
> +
> +	return 0;
> +
> +err_unreg_video_dev:
> +	video_unregister_device(&hdmirx_dev->stream.vdev);
> +err_unreg_v4l2_dev:
> +	v4l2_device_unregister(&hdmirx_dev->v4l2_dev);
> +err_hdl:
> +	v4l2_ctrl_handler_free(&hdmirx_dev->hdl);
> +err_pm:
> +	hdmirx_disable(dev);
> +
> +	return ret;
> +}
> +
> +static void hdmirx_remove(struct platform_device *pdev)
> +{
> +	struct device *dev = &pdev->dev;
> +	struct snps_hdmirx_dev *hdmirx_dev = dev_get_drvdata(dev);
> +
> +	snps_hdmirx_cec_unregister(hdmirx_dev->cec);
> +	cec_notifier_conn_unregister(hdmirx_dev->cec_notifier);
> +
> +	hdmirx_disable_irq(dev);
> +
> +	video_unregister_device(&hdmirx_dev->stream.vdev);
> +	v4l2_ctrl_handler_free(&hdmirx_dev->hdl);
> +	v4l2_device_unregister(&hdmirx_dev->v4l2_dev);
> +
> +	hdmirx_disable(dev);
> +
> +	reset_control_bulk_assert(HDMIRX_NUM_RST, hdmirx_dev->resets);
> +
> +	of_reserved_mem_device_release(dev);
> +}
> +
> +static const struct of_device_id hdmirx_id[] = {
> +	{ .compatible = "rockchip,rk3588-hdmirx-ctrler" },
> +	{ },
> +};
> +MODULE_DEVICE_TABLE(of, hdmirx_id);
>
>
According to the platform_driver struct, they like the `remove_new` over remove. 
When I was compiling for Armbian, I was getting a type mismatch that prevented compililng

See here: https://github.com/torvalds/linux/blob/933069701c1b507825b514317d4edd5d3fd9d417/include/linux/platform_device.h#L236

>
> +
> +static struct platform_driver hdmirx_driver = {
> +	.probe = hdmirx_probe,
> +	.remove = hdmirx_remove,
> +	.driver = {
> +		.name = "snps_hdmirx",
> +		.of_match_table = hdmirx_id,
> +		.pm = &snps_hdmirx_pm_ops,
> +	}
> +};
> +module_platform_driver(hdmirx_driver);
> +
> +MODULE_DESCRIPTION("Rockchip HDMI Receiver Driver");
> +MODULE_AUTHOR("Dingxian Wen <shawn.wen@rock-chips.com>");
> +MODULE_AUTHOR("Shreeya Patel <shreeya.patel@collabora.com>");
> +MODULE_LICENSE("GPL");
> diff --git a/drivers/media/platform/synopsys/hdmirx/snps_hdmirx.h b/drivers/media/platform/synopsys/hdmirx/snps_hdmirx.h
> new file mode 100644
> index 000000000000..220ab99ca611
> --- /dev/null
> +++ b/drivers/media/platform/synopsys/hdmirx/snps_hdmirx.h
> @@ -0,0 +1,394 @@
> +/* SPDX-License-Identifier: GPL-2.0 */
> +/*
> + * Copyright (c) 2021 Rockchip Electronics Co. Ltd.
> + *
> + * Author: Dingxian Wen <shawn.wen@rock-chips.com>
> + */
> +
> +#ifndef DW_HDMIRX_H
> +#define DW_HDMIRX_H
> +
> +#include <linux/bitops.h>
> +
> +#define UPDATE(x, h, l)		(((x) << (l)) & GENMASK((h), (l)))
> +#define HIWORD_UPDATE(v, h, l)	(((v) << (l)) | (GENMASK((h), (l)) << 16))
> +
> +/* SYS_GRF */
> +#define SYS_GRF_SOC_CON1			0x0304
> +#define HDMIRXPHY_SRAM_EXT_LD_DONE		BIT(1)
> +#define HDMIRXPHY_SRAM_BYPASS			BIT(0)
> +#define SYS_GRF_SOC_STATUS1			0x0384
> +#define HDMIRXPHY_SRAM_INIT_DONE		BIT(10)
> +#define SYS_GRF_CHIP_ID				0x0600
> +
> +/* VO1_GRF */
> +#define VO1_GRF_VO1_CON2			0x0008
> +#define HDMIRX_SDAIN_MSK			BIT(2)
> +#define HDMIRX_SCLIN_MSK			BIT(1)
> +
> +/* HDMIRX PHY */
> +#define SUP_DIG_ANA_CREGS_SUP_ANA_NC			0x004f
> +
> +#define	LANE0_DIG_ASIC_RX_OVRD_OUT_0			0x100f
> +#define	LANE1_DIG_ASIC_RX_OVRD_OUT_0			0x110f
> +#define	LANE2_DIG_ASIC_RX_OVRD_OUT_0			0x120f
> +#define	LANE3_DIG_ASIC_RX_OVRD_OUT_0			0x130f
> +#define ASIC_ACK_OVRD_EN				BIT(1)
> +#define ASIC_ACK					BIT(0)
> +
> +#define	LANE0_DIG_RX_VCOCAL_RX_VCO_CAL_CTRL_2		0x104a
> +#define	LANE1_DIG_RX_VCOCAL_RX_VCO_CAL_CTRL_2		0x114a
> +#define	LANE2_DIG_RX_VCOCAL_RX_VCO_CAL_CTRL_2		0x124a
> +#define	LANE3_DIG_RX_VCOCAL_RX_VCO_CAL_CTRL_2		0x134a
> +#define FREQ_TUNE_START_VAL_MASK			GENMASK(9, 0)
> +#define FREQ_TUNE_START_VAL(x)				UPDATE(x, 9, 0)
> +
> +#define	HDMIPCS_DIG_CTRL_PATH_MAIN_FSM_FSM_CONFIG	0x20c4
> +#define	HDMIPCS_DIG_CTRL_PATH_MAIN_FSM_ADAPT_REF_FOM	0x20c7
> +#define HDMIPCS_DIG_CTRL_PATH_MAIN_FSM_RATE_CALC_HDMI14_CDR_SETTING_3_REG	0x20e9
> +#define CDR_SETTING_BOUNDARY_3_DEFAULT			0x52da
> +#define HDMIPCS_DIG_CTRL_PATH_MAIN_FSM_RATE_CALC_HDMI14_CDR_SETTING_4_REG	0x20ea
> +#define CDR_SETTING_BOUNDARY_4_DEFAULT			0x43cd
> +#define HDMIPCS_DIG_CTRL_PATH_MAIN_FSM_RATE_CALC_HDMI14_CDR_SETTING_5_REG	0x20eb
> +#define CDR_SETTING_BOUNDARY_5_DEFAULT			0x35b3
> +#define HDMIPCS_DIG_CTRL_PATH_MAIN_FSM_RATE_CALC_HDMI14_CDR_SETTING_6_REG	0x20fb
> +#define	CDR_SETTING_BOUNDARY_6_DEFAULT			0x2799
> +#define HDMIPCS_DIG_CTRL_PATH_MAIN_FSM_RATE_CALC_HDMI14_CDR_SETTING_7_REG	0x20fc
> +#define CDR_SETTING_BOUNDARY_7_DEFAULT			0x1b65
> +
> +#define	RAWLANE0_DIG_PCS_XF_RX_OVRD_OUT			0x300e
> +#define	RAWLANE1_DIG_PCS_XF_RX_OVRD_OUT			0x310e
> +#define	RAWLANE2_DIG_PCS_XF_RX_OVRD_OUT			0x320e
> +#define	RAWLANE3_DIG_PCS_XF_RX_OVRD_OUT			0x330e
> +#define PCS_ACK_WRITE_SELECT				BIT(14)
> +#define PCS_EN_CTL					BIT(1)
> +#define PCS_ACK						BIT(0)
> +
> +#define	RAWLANE0_DIG_AON_FAST_FLAGS			0x305c
> +#define	RAWLANE1_DIG_AON_FAST_FLAGS			0x315c
> +#define	RAWLANE2_DIG_AON_FAST_FLAGS			0x325c
> +#define	RAWLANE3_DIG_AON_FAST_FLAGS			0x335c
> +
> +/* HDMIRX Ctrler */
> +#define GLOBAL_SWRESET_REQUEST			0x0020
> +#define DATAPATH_SWRESETREQ			BIT(12)
> +#define GLOBAL_SWENABLE				0x0024
> +#define PHYCTRL_ENABLE				BIT(21)
> +#define CEC_ENABLE				BIT(16)
> +#define TMDS_ENABLE				BIT(13)
> +#define DATAPATH_ENABLE				BIT(12)
> +#define PKTFIFO_ENABLE				BIT(11)
> +#define AVPUNIT_ENABLE				BIT(8)
> +#define MAIN_ENABLE				BIT(0)
> +#define GLOBAL_TIMER_REF_BASE			0x0028
> +#define CORE_CONFIG				0x0050
> +#define CMU_CONFIG0				0x0060
> +#define TMDSQPCLK_STABLE_FREQ_MARGIN_MASK	GENMASK(30, 16)
> +#define TMDSQPCLK_STABLE_FREQ_MARGIN(x)		UPDATE(x, 30, 16)
> +#define AUDCLK_STABLE_FREQ_MARGIN_MASK		GENMASK(11, 9)
> +#define AUDCLK_STABLE_FREQ_MARGIN(x)		UPDATE(x, 11, 9)
> +#define CMU_STATUS				0x007c
> +#define TMDSQPCLK_LOCKED_ST			BIT(4)
> +#define CMU_TMDSQPCLK_FREQ			0x0084
> +#define PHY_CONFIG				0x00c0
> +#define LDO_AFE_PROG_MASK			GENMASK(24, 23)
> +#define LDO_AFE_PROG(x)				UPDATE(x, 24, 23)
> +#define LDO_PWRDN				BIT(21)
> +#define TMDS_CLOCK_RATIO			BIT(16)
> +#define RXDATA_WIDTH				BIT(15)
> +#define REFFREQ_SEL_MASK			GENMASK(11, 9)
> +#define REFFREQ_SEL(x)				UPDATE(x, 11, 9)
> +#define HDMI_DISABLE				BIT(8)
> +#define PHY_PDDQ				BIT(1)
> +#define PHY_RESET				BIT(0)
> +#define PHY_STATUS				0x00c8
> +#define HDMI_DISABLE_ACK			BIT(1)
> +#define PDDQ_ACK				BIT(0)
> +#define PHYCREG_CONFIG0				0x00e0
> +#define PHYCREG_CR_PARA_SELECTION_MODE_MASK	GENMASK(1, 0)
> +#define PHYCREG_CR_PARA_SELECTION_MODE(x)	UPDATE(x, 1, 0)
> +#define PHYCREG_CONFIG1				0x00e4
> +#define PHYCREG_CONFIG2				0x00e8
> +#define PHYCREG_CONFIG3				0x00ec
> +#define PHYCREG_CONTROL				0x00f0
> +#define PHYCREG_CR_PARA_WRITE_P			BIT(1)
> +#define PHYCREG_CR_PARA_READ_P			BIT(0)
> +#define PHYCREG_STATUS				0x00f4
> +
> +#define MAINUNIT_STATUS				0x0150
> +#define TMDSVALID_STABLE_ST			BIT(1)
> +#define DESCRAND_EN_CONTROL			0x0210
> +#define SCRAMB_EN_SEL_QST_MASK			GENMASK(1, 0)
> +#define SCRAMB_EN_SEL_QST(x)			UPDATE(x, 1, 0)
> +#define DESCRAND_SYNC_CONTROL			0x0214
> +#define RECOVER_UNSYNC_STREAM_QST		BIT(0)
> +#define DESCRAND_SYNC_SEQ_CONFIG		0x022c
> +#define DESCRAND_SYNC_SEQ_ERR_CNT_EN		BIT(0)
> +#define DESCRAND_SYNC_SEQ_STATUS		0x0234
> +#define DEFRAMER_CONFIG0			0x0270
> +#define VS_CNT_THR_QST_MASK			GENMASK(27, 20)
> +#define VS_CNT_THR_QST(x)			UPDATE(x, 27, 20)
> +#define HS_POL_QST_MASK				GENMASK(19, 18)
> +#define HS_POL_QST(x)				UPDATE(x, 19, 18)
> +#define VS_POL_QST_MASK				GENMASK(17, 16)
> +#define VS_POL_QST(x)				UPDATE(x, 17, 16)
> +#define VS_REMAPFILTER_EN_QST			BIT(8)
> +#define VS_FILTER_ORDER_QST_MASK		GENMASK(1, 0)
> +#define VS_FILTER_ORDER_QST(x)			UPDATE(x, 1, 0)
> +#define DEFRAMER_VSYNC_CNT_CLEAR		0x0278
> +#define VSYNC_CNT_CLR_P				BIT(0)
> +#define DEFRAMER_STATUS				0x027c
> +#define OPMODE_STS_MASK				GENMASK(6, 4)
> +#define I2C_SLAVE_CONFIG1			0x0164
> +#define I2C_SDA_OUT_HOLD_VALUE_QST_MASK		GENMASK(15, 8)
> +#define I2C_SDA_OUT_HOLD_VALUE_QST(x)		UPDATE(x, 15, 8)
> +#define I2C_SDA_IN_HOLD_VALUE_QST_MASK		GENMASK(7, 0)
> +#define I2C_SDA_IN_HOLD_VALUE_QST(x)		UPDATE(x, 7, 0)
> +#define OPMODE_STS_MASK				GENMASK(6, 4)
> +#define REPEATER_QST				BIT(28)
> +#define FASTREAUTH_QST				BIT(27)
> +#define FEATURES_1DOT1_QST			BIT(26)
> +#define FASTI2C_QST				BIT(25)
> +#define EESS_CTL_THR_QST_MASK			GENMASK(19, 16)
> +#define EESS_CTL_THR_QST(x)			UPDATE(x, 19, 16)
> +#define OESS_CTL3_THR_QST_MASK			GENMASK(11, 8)
> +#define OESS_CTL3_THR_QST(x)			UPDATE(x, 11, 8)
> +#define EESS_OESS_SEL_QST_MASK			GENMASK(5, 4)
> +#define EESS_OESS_SEL_QST(x)			UPDATE(x, 5, 4)
> +#define KEY_DECRYPT_EN_QST			BIT(0)
> +#define KEY_DECRYPT_SEED_QST_MASK		GENMASK(15, 0)
> +#define KEY_DECRYPT_SEED_QST(x)			UPDATE(x, 15, 0)
> +#define HDCP_INT_CLEAR				0x50d8
> +#define HDCP_1_INT_CLEAR			0x50e8
> +#define HDCP2_CONFIG				0x02f0
> +#define HDCP2_SWITCH_OVR_VALUE			BIT(2)
> +#define HDCP2_SWITCH_OVR_EN			BIT(1)
> +
> +#define VIDEO_CONFIG2				0x042c
> +#define VPROC_VSYNC_POL_OVR_VALUE		BIT(19)
> +#define VPROC_VSYNC_POL_OVR_EN			BIT(18)
> +#define VPROC_HSYNC_POL_OVR_VALUE		BIT(17)
> +#define VPROC_HSYNC_POL_OVR_EN			BIT(16)
> +#define VPROC_FMT_OVR_VALUE_MASK		GENMASK(6, 4)
> +#define VPROC_FMT_OVR_VALUE(x)			UPDATE(x, 6, 4)
> +#define VPROC_FMT_OVR_EN			BIT(0)
> +
> +#define AFIFO_FILL_RESTART			BIT(0)
> +#define AFIFO_INIT_P				BIT(0)
> +#define AFIFO_THR_LOW_QST_MASK			GENMASK(25, 16)
> +#define AFIFO_THR_LOW_QST(x)			UPDATE(x, 25, 16)
> +#define AFIFO_THR_HIGH_QST_MASK			GENMASK(9, 0)
> +#define AFIFO_THR_HIGH_QST(x)			UPDATE(x, 9, 0)
> +#define AFIFO_THR_MUTE_LOW_QST_MASK		GENMASK(25, 16)
> +#define AFIFO_THR_MUTE_LOW_QST(x)		UPDATE(x, 25, 16)
> +#define AFIFO_THR_MUTE_HIGH_QST_MASK		GENMASK(9, 0)
> +#define AFIFO_THR_MUTE_HIGH_QST(x)		UPDATE(x, 9, 0)
> +
> +#define AFIFO_UNDERFLOW_ST			BIT(25)
> +#define AFIFO_OVERFLOW_ST			BIT(24)
> +
> +#define SPEAKER_ALLOC_OVR_EN			BIT(16)
> +#define I2S_BPCUV_EN				BIT(4)
> +#define SPDIF_EN				BIT(2)
> +#define I2S_EN					BIT(1)
> +#define AFIFO_THR_PASS_DEMUTEMASK_N		BIT(24)
> +#define AVMUTE_DEMUTEMASK_N			BIT(16)
> +#define AFIFO_THR_MUTE_LOW_MUTEMASK_N		BIT(9)
> +#define AFIFO_THR_MUTE_HIGH_MUTEMASK_N		BIT(8)
> +#define AVMUTE_MUTEMASK_N			BIT(0)
> +#define SCDC_CONFIG				0x0580
> +#define HPDLOW					BIT(1)
> +#define POWERPROVIDED				BIT(0)
> +#define SCDC_REGBANK_STATUS1			0x058c
> +#define SCDC_TMDSBITCLKRATIO			BIT(1)
> +#define SCDC_REGBANK_STATUS3			0x0594
> +#define SCDC_REGBANK_CONFIG0			0x05c0
> +#define SCDC_SINKVERSION_QST_MASK		GENMASK(7, 0)
> +#define SCDC_SINKVERSION_QST(x)			UPDATE(x, 7, 0)
> +#define AGEN_LAYOUT				BIT(4)
> +#define AGEN_SPEAKER_ALLOC			GENMASK(15, 8)
> +
> +#define CED_CONFIG				0x0760
> +#define CED_VIDDATACHECKEN_QST			BIT(27)
> +#define CED_DATAISCHECKEN_QST			BIT(26)
> +#define CED_GBCHECKEN_QST			BIT(25)
> +#define CED_CTRLCHECKEN_QST			BIT(24)
> +#define CED_CHLOCKMAXER_QST_MASK		GENMASK(14, 0)
> +#define CED_CHLOCKMAXER_QST(x)			UPDATE(x, 14, 0)
> +#define CED_DYN_CONFIG				0x0768
> +#define CED_DYN_CONTROL				0x076c
> +#define PKTEX_BCH_ERRFILT_CONFIG		0x07c4
> +#define PKTEX_CHKSUM_ERRFILT_CONFIG		0x07c8
> +
> +#define PKTDEC_ACR_PH2_1			0x1100
> +#define PKTDEC_ACR_PB3_0			0x1104
> +#define PKTDEC_ACR_PB7_4			0x1108
> +#define PKTDEC_AVIIF_PH2_1			0x1200
> +#define PKTDEC_AVIIF_PB3_0			0x1204
> +#define PKTDEC_AVIIF_PB7_4			0x1208
> +#define VIC_VAL_MASK				GENMASK(6, 0)
> +#define PKTDEC_AVIIF_PB11_8			0x120c
> +#define PKTDEC_AVIIF_PB15_12			0x1210
> +#define PKTDEC_AVIIF_PB19_16			0x1214
> +#define PKTDEC_AVIIF_PB23_20			0x1218
> +#define PKTDEC_AVIIF_PB27_24			0x121c
> +
> +#define PKTFIFO_CONFIG				0x1500
> +#define PKTFIFO_STORE_FILT_CONFIG		0x1504
> +#define PKTFIFO_THR_CONFIG0			0x1508
> +#define PKTFIFO_THR_CONFIG1			0x150c
> +#define PKTFIFO_CONTROL				0x1510
> +
> +#define VMON_STATUS1				0x1580
> +#define VMON_STATUS2				0x1584
> +#define VMON_STATUS3				0x1588
> +#define VMON_STATUS4				0x158c
> +#define VMON_STATUS5				0x1590
> +#define VMON_STATUS6				0x1594
> +#define VMON_STATUS7				0x1598
> +#define VMON_ILACE_DETECT			BIT(4)
> +
> +#define CEC_TX_CONTROL				0x2000
> +#define CEC_STATUS				0x2004
> +#define CEC_CONFIG				0x2008
> +#define RX_AUTO_DRIVE_ACKNOWLEDGE		BIT(9)
> +#define CEC_ADDR				0x200c
> +#define CEC_TX_COUNT				0x2020
> +#define CEC_TX_DATA3_0				0x2024
> +#define CEC_RX_COUNT_STATUS			0x2040
> +#define CEC_RX_DATA3_0				0x2044
> +#define CEC_LOCK_CONTROL			0x2054
> +#define CEC_RXQUAL_BITTIME_CONFIG		0x2060
> +#define CEC_RX_BITTIME_CONFIG			0x2064
> +#define CEC_TX_BITTIME_CONFIG			0x2068
> +
> +#define DMA_CONFIG1				0x4400
> +#define UV_WID_MASK				GENMASK(31, 28)
> +#define UV_WID(x)				UPDATE(x, 31, 28)
> +#define Y_WID_MASK				GENMASK(27, 24)
> +#define Y_WID(x)				UPDATE(x, 27, 24)
> +#define DDR_STORE_FORMAT_MASK			GENMASK(15, 12)
> +#define DDR_STORE_FORMAT(x)			UPDATE(x, 15, 12)
> +#define ABANDON_EN				BIT(0)
> +#define DMA_CONFIG2				0x4404
> +#define DMA_CONFIG3				0x4408
> +#define DMA_CONFIG4				0x440c // dma irq en
> +#define DMA_CONFIG5				0x4410 // dma irq clear status
> +#define LINE_FLAG_INT_EN			BIT(8)
> +#define HDMIRX_DMA_IDLE_INT			BIT(7)
> +#define HDMIRX_LOCK_DISABLE_INT			BIT(6)
> +#define LAST_FRAME_AXI_UNFINISH_INT_EN		BIT(5)
> +#define FIFO_OVERFLOW_INT_EN			BIT(2)
> +#define FIFO_UNDERFLOW_INT_EN			BIT(1)
> +#define HDMIRX_AXI_ERROR_INT_EN			BIT(0)
> +#define DMA_CONFIG6				0x4414
> +#define RB_SWAP_EN				BIT(9)
> +#define HSYNC_TOGGLE_EN				BIT(5)
> +#define VSYNC_TOGGLE_EN				BIT(4)
> +#define HDMIRX_DMA_EN				BIT(1)
> +#define DMA_CONFIG7				0x4418
> +#define LINE_FLAG_NUM_MASK			GENMASK(31, 16)
> +#define LINE_FLAG_NUM(x)			UPDATE(x, 31, 16)
> +#define LOCK_FRAME_NUM_MASK			GENMASK(11, 0)
> +#define LOCK_FRAME_NUM(x)			UPDATE(x, 11, 0)
> +#define DMA_CONFIG8				0x441c
> +#define REG_MIRROR_EN				BIT(0)
> +#define DMA_CONFIG9				0x4420
> +#define DMA_CONFIG10				0x4424
> +#define DMA_CONFIG11				0x4428
> +#define EDID_READ_EN_MASK			BIT(8)
> +#define EDID_READ_EN(x)				UPDATE(x, 8, 8)
> +#define EDID_WRITE_EN_MASK			BIT(7)
> +#define EDID_WRITE_EN(x)			UPDATE(x, 7, 7)
> +#define EDID_SLAVE_ADDR_MASK			GENMASK(6, 0)
> +#define EDID_SLAVE_ADDR(x)			UPDATE(x, 6, 0)
> +#define DMA_STATUS1				0x4430 // dma irq status
> +#define DMA_STATUS2				0x4434
> +#define DMA_STATUS3				0x4438
> +#define DMA_STATUS4				0x443c
> +#define DMA_STATUS5				0x4440
> +#define DMA_STATUS6				0x4444
> +#define DMA_STATUS7				0x4448
> +#define DMA_STATUS8				0x444c
> +#define DMA_STATUS9				0x4450
> +#define DMA_STATUS10				0x4454
> +#define HDMIRX_LOCK				BIT(3)
> +#define DMA_STATUS11				0x4458
> +#define HDMIRX_TYPE_MASK			GENMASK(8, 7)
> +#define HDMIRX_COLOR_DEPTH_MASK			GENMASK(6, 3)
> +#define HDMIRX_FORMAT_MASK			GENMASK(2, 0)
> +#define DMA_STATUS12				0x445c
> +#define DMA_STATUS13				0x4460
> +#define DMA_STATUS14				0x4464
> +
> +#define MAINUNIT_INTVEC_INDEX			0x5000
> +#define MAINUNIT_0_INT_STATUS			0x5010
> +#define CECRX_NOTIFY_ERR			BIT(12)
> +#define CECRX_EOM				BIT(11)
> +#define CECTX_DRIVE_ERR				BIT(10)
> +#define CECRX_BUSY				BIT(9)
> +#define CECTX_BUSY				BIT(8)
> +#define CECTX_FRAME_DISCARDED			BIT(5)
> +#define CECTX_NRETRANSMIT_FAIL			BIT(4)
> +#define CECTX_LINE_ERR				BIT(3)
> +#define CECTX_ARBLOST				BIT(2)
> +#define CECTX_NACK				BIT(1)
> +#define CECTX_DONE				BIT(0)
> +#define MAINUNIT_0_INT_MASK_N			0x5014
> +#define MAINUNIT_0_INT_CLEAR			0x5018
> +#define MAINUNIT_0_INT_FORCE			0x501c
> +#define TIMER_BASE_LOCKED_IRQ			BIT(26)
> +#define TMDSQPCLK_OFF_CHG			BIT(5)
> +#define TMDSQPCLK_LOCKED_CHG			BIT(4)
> +#define MAINUNIT_1_INT_STATUS			0x5020
> +#define MAINUNIT_1_INT_MASK_N			0x5024
> +#define MAINUNIT_1_INT_CLEAR			0x5028
> +#define MAINUNIT_1_INT_FORCE			0x502c
> +#define MAINUNIT_2_INT_STATUS			0x5030
> +#define MAINUNIT_2_INT_MASK_N			0x5034
> +#define MAINUNIT_2_INT_CLEAR			0x5038
> +#define MAINUNIT_2_INT_FORCE			0x503c
> +#define PHYCREG_CR_READ_DONE			BIT(11)
> +#define PHYCREG_CR_WRITE_DONE			BIT(10)
> +#define TMDSVALID_STABLE_CHG			BIT(1)
> +
> +#define AVPUNIT_0_INT_STATUS			0x5040
> +#define AVPUNIT_0_INT_MASK_N			0x5044
> +#define AVPUNIT_0_INT_CLEAR			0x5048
> +#define AVPUNIT_0_INT_FORCE			0x504c
> +#define CED_DYN_CNT_CH2_IRQ			BIT(22)
> +#define CED_DYN_CNT_CH1_IRQ			BIT(21)
> +#define CED_DYN_CNT_CH0_IRQ			BIT(20)
> +#define AVPUNIT_1_INT_STATUS			0x5050
> +#define DEFRAMER_VSYNC_THR_REACHED_IRQ		BIT(1)
> +#define AVPUNIT_1_INT_MASK_N			0x5054
> +#define DEFRAMER_VSYNC_THR_REACHED_MASK_N	BIT(1)
> +#define DEFRAMER_VSYNC_MASK_N			BIT(0)
> +#define AVPUNIT_1_INT_CLEAR			0x5058
> +#define DEFRAMER_VSYNC_THR_REACHED_CLEAR	BIT(1)
> +#define PKT_0_INT_STATUS			0x5080
> +#define PKTDEC_ACR_CHG_IRQ			BIT(3)
> +#define PKT_0_INT_MASK_N			0x5084
> +#define PKTDEC_ACR_CHG_MASK_N			BIT(3)
> +#define PKT_0_INT_CLEAR				0x5088
> +#define PKT_1_INT_STATUS			0x5090
> +#define PKT_1_INT_MASK_N			0x5094
> +#define PKT_1_INT_CLEAR				0x5098
> +#define PKT_2_INT_STATUS			0x50a0
> +#define PKTDEC_ACR_RCV_IRQ			BIT(3)
> +#define PKT_2_INT_MASK_N			0x50a4
> +#define PKTDEC_AVIIF_RCV_IRQ			BIT(11)
> +#define PKTDEC_ACR_RCV_MASK_N			BIT(3)
> +#define PKT_2_INT_CLEAR				0x50a8
> +#define PKTDEC_AVIIF_RCV_CLEAR			BIT(11)
> +#define PKTDEC_ACR_RCV_CLEAR			BIT(3)
> +#define SCDC_INT_STATUS				0x50c0
> +#define SCDC_INT_MASK_N				0x50c4
> +#define SCDC_INT_CLEAR				0x50c8
> +#define SCDCTMDSCCFG_CHG			BIT(2)
> +
> +#define CEC_INT_STATUS				0x5100
> +#define CEC_INT_MASK_N				0x5104
> +#define CEC_INT_CLEAR				0x5108
> +
> +#endif
> diff --git a/drivers/media/platform/synopsys/hdmirx/snps_hdmirx_cec.c b/drivers/media/platform/synopsys/hdmirx/snps_hdmirx_cec.c
> new file mode 100644
> index 000000000000..9f67e2080bb6
> --- /dev/null
> +++ b/drivers/media/platform/synopsys/hdmirx/snps_hdmirx_cec.c
> @@ -0,0 +1,285 @@
> +// SPDX-License-Identifier: GPL-2.0
> +/*
> + * Copyright (c) 2021 Rockchip Electronics Co. Ltd.
> + *
> + * Author: Shunqing Chen <csq@rock-chips.com>
> + */
> +
> +#include <linux/interrupt.h>
> +#include <linux/io.h>
> +#include <linux/module.h>
> +#include <linux/platform_device.h>
> +#include <linux/slab.h>
> +
> +#include <media/cec.h>
> +#include <media/cec-notifier.h>
> +
> +#include "snps_hdmirx.h"
> +#include "snps_hdmirx_cec.h"
> +
> +static void hdmirx_cec_write(struct hdmirx_cec *cec, int reg, u32 val)
> +{
> +	cec->ops->write(cec->hdmirx, reg, val);
> +}
> +
> +static u32 hdmirx_cec_read(struct hdmirx_cec *cec, int reg)
> +{
> +	return cec->ops->read(cec->hdmirx, reg);
> +}
> +
> +static void hdmirx_cec_update_bits(struct hdmirx_cec *cec, int reg, u32 mask,
> +				   u32 data)
> +{
> +	u32 val = hdmirx_cec_read(cec, reg) & ~mask;
> +
> +	val |= (data & mask);
> +	hdmirx_cec_write(cec, reg, val);
> +}
> +
> +static int hdmirx_cec_log_addr(struct cec_adapter *adap, u8 logical_addr)
> +{
> +	struct hdmirx_cec *cec = cec_get_drvdata(adap);
> +
> +	if (logical_addr == CEC_LOG_ADDR_INVALID)
> +		cec->addresses = 0;
> +	else
> +		cec->addresses |= BIT(logical_addr) | BIT(15);
> +
> +	hdmirx_cec_write(cec, CEC_ADDR, cec->addresses);
> +
> +	return 0;
> +}
> +
> +/* signal_free_time is handled by the Synopsys Designware
> + * HDMIRX Controller hardware.
> + */
> +static int hdmirx_cec_transmit(struct cec_adapter *adap, u8 attempts,
> +			       u32 signal_free_time, struct cec_msg *msg)
> +{
> +	struct hdmirx_cec *cec = cec_get_drvdata(adap);
> +	u32 data[4] = {0};
> +	int i, data_len, msg_len;
> +
> +	msg_len = msg->len;
> +
> +	hdmirx_cec_write(cec, CEC_TX_COUNT, msg_len - 1);
> +	for (i = 0; i < msg_len; i++)
> +		data[i / 4] |= msg->msg[i] << (i % 4) * 8;
> +
> +	data_len = DIV_ROUND_UP(msg_len, 4);
> +
> +	for (i = 0; i < data_len; i++)
> +		hdmirx_cec_write(cec, CEC_TX_DATA3_0 + i * 4, data[i]);
> +
> +	hdmirx_cec_write(cec, CEC_TX_CONTROL, 0x1);
> +
> +	return 0;
> +}
> +
> +static irqreturn_t hdmirx_cec_hardirq(int irq, void *data)
> +{
> +	struct cec_adapter *adap = data;
> +	struct hdmirx_cec *cec = cec_get_drvdata(adap);
> +	u32 stat = hdmirx_cec_read(cec, CEC_INT_STATUS);
> +	irqreturn_t ret = IRQ_HANDLED;
> +	u32 val;
> +
> +	if (!stat)
> +		return IRQ_NONE;
> +
> +	hdmirx_cec_write(cec, CEC_INT_CLEAR, stat);
> +
> +	if (stat & CECTX_LINE_ERR) {
> +		cec->tx_status = CEC_TX_STATUS_ERROR;
> +		cec->tx_done = true;
> +		ret = IRQ_WAKE_THREAD;
> +	} else if (stat & CECTX_DONE) {
> +		cec->tx_status = CEC_TX_STATUS_OK;
> +		cec->tx_done = true;
> +		ret = IRQ_WAKE_THREAD;
> +	} else if (stat & CECTX_NACK) {
> +		cec->tx_status = CEC_TX_STATUS_NACK;
> +		cec->tx_done = true;
> +		ret = IRQ_WAKE_THREAD;
> +	} else if (stat & CECTX_ARBLOST) {
> +		cec->tx_status = CEC_TX_STATUS_ARB_LOST;
> +		cec->tx_done = true;
> +		ret = IRQ_WAKE_THREAD;
> +	}
> +
> +	if (stat & CECRX_EOM) {
> +		unsigned int len, i;
> +
> +		val = hdmirx_cec_read(cec, CEC_RX_COUNT_STATUS);
> +		/* rxbuffer locked status */
> +		if ((val & 0x80))
> +			return ret;
> +
> +		len = (val & 0xf) + 1;
> +		if (len > sizeof(cec->rx_msg.msg))
> +			len = sizeof(cec->rx_msg.msg);
> +
> +		for (i = 0; i < len; i++) {
> +			if (!(i % 4))
> +				val = hdmirx_cec_read(cec, CEC_RX_DATA3_0 + i / 4 * 4);
> +			cec->rx_msg.msg[i] = (val >> ((i % 4) * 8)) & 0xff;
> +		}
> +
> +		cec->rx_msg.len = len;
> +		smp_wmb(); /* receive RX msg */
> +		cec->rx_done = true;
> +		hdmirx_cec_write(cec, CEC_LOCK_CONTROL, 0x1);
> +
> +		ret = IRQ_WAKE_THREAD;
> +	}
> +
> +	return ret;
> +}
> +
> +static irqreturn_t hdmirx_cec_thread(int irq, void *data)
> +{
> +	struct cec_adapter *adap = data;
> +	struct hdmirx_cec *cec = cec_get_drvdata(adap);
> +
> +	if (cec->tx_done) {
> +		cec->tx_done = false;
> +		cec_transmit_attempt_done(adap, cec->tx_status);
> +	}
> +	if (cec->rx_done) {
> +		cec->rx_done = false;
> +		smp_rmb(); /* RX msg has been received */
> +		cec_received_msg(adap, &cec->rx_msg);
> +	}
> +
> +	return IRQ_HANDLED;
> +}
> +
> +static int hdmirx_cec_enable(struct cec_adapter *adap, bool enable)
> +{
> +	struct hdmirx_cec *cec = cec_get_drvdata(adap);
> +
> +	if (!enable) {
> +		hdmirx_cec_write(cec, CEC_INT_MASK_N, 0);
> +		hdmirx_cec_write(cec, CEC_INT_CLEAR, 0);
> +		if (cec->ops->disable)
> +			cec->ops->disable(cec->hdmirx);
> +	} else {
> +		unsigned int irqs;
> +
> +		hdmirx_cec_log_addr(cec->adap, CEC_LOG_ADDR_INVALID);
> +		if (cec->ops->enable)
> +			cec->ops->enable(cec->hdmirx);
> +		hdmirx_cec_update_bits(cec, GLOBAL_SWENABLE, CEC_ENABLE, CEC_ENABLE);
> +
> +		irqs = CECTX_LINE_ERR | CECTX_NACK | CECRX_EOM | CECTX_DONE;
> +		hdmirx_cec_write(cec, CEC_INT_MASK_N, irqs);
> +	}
> +
> +	return 0;
> +}
> +
> +static const struct cec_adap_ops hdmirx_cec_ops = {
> +	.adap_enable = hdmirx_cec_enable,
> +	.adap_log_addr = hdmirx_cec_log_addr,
> +	.adap_transmit = hdmirx_cec_transmit,
> +};
> +
> +static void hdmirx_cec_del(void *data)
> +{
> +	struct hdmirx_cec *cec = data;
> +
> +	cec_delete_adapter(cec->adap);
> +}
> +
> +struct hdmirx_cec *snps_hdmirx_cec_register(struct hdmirx_cec_data *data)
> +{
> +	struct hdmirx_cec *cec;
> +	unsigned int irqs;
> +	int ret;
> +
> +	/*
> +	 * Our device is just a convenience - we want to link to the real
> +	 * hardware device here, so that userspace can see the association
> +	 * between the HDMI hardware and its associated CEC chardev.
> +	 */
> +	cec = devm_kzalloc(data->dev, sizeof(*cec), GFP_KERNEL);
> +	if (!cec)
> +		return NULL;
> +
> +	cec->dev = data->dev;
> +	cec->irq = data->irq;
> +	cec->ops = data->ops;
> +	cec->hdmirx = data->hdmirx;
> +
> +	hdmirx_cec_update_bits(cec, GLOBAL_SWENABLE, CEC_ENABLE, CEC_ENABLE);
> +	hdmirx_cec_update_bits(cec, CEC_CONFIG, RX_AUTO_DRIVE_ACKNOWLEDGE,
> +			       RX_AUTO_DRIVE_ACKNOWLEDGE);
> +
> +	hdmirx_cec_write(cec, CEC_TX_COUNT, 0);
> +	hdmirx_cec_write(cec, CEC_INT_MASK_N, 0);
> +	hdmirx_cec_write(cec, CEC_INT_CLEAR, ~0);
> +
> +	cec->adap = cec_allocate_adapter(&hdmirx_cec_ops, cec, "snps-hdmirx",
> +					 CEC_CAP_LOG_ADDRS | CEC_CAP_TRANSMIT |
> +					 CEC_CAP_RC | CEC_CAP_PASSTHROUGH |
> +					 CEC_CAP_MONITOR_ALL,
> +					 CEC_MAX_LOG_ADDRS);
> +	if (IS_ERR(cec->adap)) {
> +		dev_err(cec->dev, "cec adap allocate failed\n");
> +		return NULL;
> +	}
> +
> +	/* override the module pointer */
> +	cec->adap->owner = THIS_MODULE;
> +
> +	ret = devm_add_action(cec->dev, hdmirx_cec_del, cec);
> +	if (ret) {
> +		cec_delete_adapter(cec->adap);
> +		return NULL;
> +	}
> +
> +	irq_set_status_flags(cec->irq, IRQ_NOAUTOEN);
> +
> +	ret = devm_request_threaded_irq(cec->dev, cec->irq,
> +					hdmirx_cec_hardirq,
> +					hdmirx_cec_thread, IRQF_ONESHOT,
> +					"rk_hdmirx_cec", cec->adap);
> +	if (ret) {
> +		dev_err(cec->dev, "cec irq request failed\n");
> +		return NULL;
> +	}
> +
> +	cec->notify = cec_notifier_cec_adap_register(cec->dev,
> +						     NULL, cec->adap);
> +	if (!cec->notify) {
> +		dev_err(cec->dev, "cec notify register failed\n");
> +		return NULL;
> +	}
> +
> +	ret = cec_register_adapter(cec->adap, cec->dev);
> +	if (ret < 0) {
> +		dev_err(cec->dev, "cec register adapter failed\n");
> +		cec_unregister_adapter(cec->adap);
> +		return NULL;
> +	}
> +
> +	irqs = CECTX_LINE_ERR | CECTX_NACK | CECRX_EOM | CECTX_DONE;
> +	hdmirx_cec_write(cec, CEC_INT_MASK_N, irqs);
> +
> +	/*
> +	 * CEC documentation says we must not call cec_delete_adapter
> +	 * after a successful call to cec_register_adapter().
> +	 */
> +	devm_remove_action(cec->dev, hdmirx_cec_del, cec);
> +
> +	enable_irq(cec->irq);
> +
> +	return cec;
> +}
> +
> +void snps_hdmirx_cec_unregister(struct hdmirx_cec *cec)
> +{
> +	disable_irq(cec->irq);
> +
> +	cec_unregister_adapter(cec->adap);
> +}
> diff --git a/drivers/media/platform/synopsys/hdmirx/snps_hdmirx_cec.h b/drivers/media/platform/synopsys/hdmirx/snps_hdmirx_cec.h
> new file mode 100644
> index 000000000000..c55c403cdb9f
> --- /dev/null
> +++ b/drivers/media/platform/synopsys/hdmirx/snps_hdmirx_cec.h
> @@ -0,0 +1,44 @@
> +/* SPDX-License-Identifier: GPL-2.0 */
> +/*
> + * Copyright (c) 2021 Rockchip Electronics Co. Ltd.
> + *
> + * Author: Shunqing Chen <csq@rock-chips.com>
> + */
> +
> +#ifndef DW_HDMI_RX_CEC_H
> +#define DW_HDMI_RX_CEC_H
> +
> +struct snps_hdmirx_dev;
> +
> +struct hdmirx_cec_ops {
> +	void (*write)(struct snps_hdmirx_dev *hdmirx_dev, int reg, u32 val);
> +	u32 (*read)(struct snps_hdmirx_dev *hdmirx_dev, int reg);
> +	void (*enable)(struct snps_hdmirx_dev *hdmirx);
> +	void (*disable)(struct snps_hdmirx_dev *hdmirx);
> +};
> +
> +struct hdmirx_cec_data {
> +	struct snps_hdmirx_dev *hdmirx;
> +	const struct hdmirx_cec_ops *ops;
> +	struct device *dev;
> +	int irq;
> +};
> +
> +struct hdmirx_cec {
> +	struct snps_hdmirx_dev *hdmirx;
> +	struct device *dev;
> +	const struct hdmirx_cec_ops *ops;
> +	u32 addresses;
> +	struct cec_adapter *adap;
> +	struct cec_msg rx_msg;
> +	unsigned int tx_status;
> +	bool tx_done;
> +	bool rx_done;
> +	struct cec_notifier *notify;
> +	int irq;
> +};
> +
> +struct hdmirx_cec *snps_hdmirx_cec_register(struct hdmirx_cec_data *data);
> +void snps_hdmirx_cec_unregister(struct hdmirx_cec *cec);
> +
> +#endif /* DW_HDMI_RX_CEC_H */
Shreeya Patel July 22, 2024, 8:26 p.m. UTC | #2
On Tuesday, July 23, 2024 01:09 IST, hoff.benjamin.k@gmail.com wrote:

Hi Benjamin,

> > Add initial support for the Synopsys DesignWare HDMI RX
> > Controller Driver used by Rockchip RK3588. The driver
> > supports:
> >  - HDMI 1.4b and 2.0 modes (HDMI 4k@60Hz)
> >  - RGB888, YUV422, YUV444 and YCC420 pixel formats
> >  - CEC
> >  - EDID configuration
> >
> > The hardware also has Audio and HDCP capabilities, but these are
> > not yet supported by the driver.
> >
> > Reviewed-by: Dmitry Osipenko <dmitry.osipenko@collabora.com>
> > Tested-by: Dmitry Osipenko <dmitry.osipenko@collabora.com>
> > Co-developed-by: Dingxian Wen <shawn.wen@rock-chips.com>
> > Signed-off-by: Dingxian Wen <shawn.wen@rock-chips.com>
> > Signed-off-by: Shreeya Patel <shreeya.patel@collabora.com>
> > ---
> >
...
> > +
> > +static const struct of_device_id hdmirx_id[] = {
> > +	{ .compatible = "rockchip,rk3588-hdmirx-ctrler" },
> > +	{ },
> > +};
> > +MODULE_DEVICE_TABLE(of, hdmirx_id);
> >
> >
> According to the platform_driver struct, they like the `remove_new` over remove. 
> When I was compiling for Armbian, I was getting a type mismatch that prevented compililng
> 
> See here: https://github.com/torvalds/linux/blob/933069701c1b507825b514317d4edd5d3fd9d417/include/linux/platform_device.h#L236
> 

This patch series is based on linux-next and there seems to be some recent changes
related to .remove and .remove_new. New drivers are supposed to use .remove()

See the reason here :-
https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git/tree/include/linux/platform_device.h?h=next-20240722#n239

If you apply the patches on top of linux-next then there shouldn't be any
compilation error.

> >
> > +
> > +static struct platform_driver hdmirx_driver = {
> > +	.probe = hdmirx_probe,
> > +	.remove = hdmirx_remove,
> > +	.driver = {
> > +		.name = "snps_hdmirx",
> > +		.of_match_table = hdmirx_id,
> > +		.pm = &snps_hdmirx_pm_ops,
> > +	}
> > +};
> > +module_platform_driver(hdmirx_driver);
> > +
> > +MODULE_DESCRIPTION("Rockchip HDMI Receiver Driver");
> > +MODULE_AUTHOR("Dingxian Wen <shawn.wen@rock-chips.com>");
> > +MODULE_AUTHOR("Shreeya Patel <shreeya.patel@collabora.com>");
> > +MODULE_LICENSE("GPL");
Tim Surber Aug. 3, 2024, 11:57 p.m. UTC | #3
Hi Shreeya,

I tested your patch and noticed problems when using 3840x2160 resolution 
at  60fps.

For my testing I connected an HDMI source and set it to 4k60fps. I 
verified that this source and the cables work on a screen at this 
resolution.

Using
'v4l2-ctl --verbose -d /dev/video1 
--set-fmt-video=width=3840,height=2160,pixelformat='NV12' 
--stream-mmap=4 --stream-skip=3 --stream-count=100 --stream-poll'
I get the video format output, but not the periodic output which shows 
the fps.

Using
'GST_DEBUG=4 gst-launch-1.0 -v v4l2src device=/dev/video1 ! 
fpsdisplaysink text-overlay=false video-sink="fakevideosink"'
I get the following error message:

(gst-launch-1.0:3231): GStreamer-CRITICAL **: 01:34:39.137: 
gst_memory_resize: assertion 'size + mem->offset + offset <= 
mem->maxsize' failed
0:00:03.489382529  3231 0xffffa0000b90 WARN  v4l2bufferpool 
gstv4l2bufferpool.c:2209:gst_v4l2_buffer_pool_process:<v4l2src0:pool0:src> 
Dropping truncated buffer, this is likely a driver bug.
0:00:03.489421906  3231 0xffffa0000b90 WARN  bufferpool 
gstbufferpool.c:1252:default_reset_buffer:<v4l2src0:pool0:src> Buffer 
0xffff98008e80 without the memory tag has maxsize (8294400) that is 
smaller than the configured buffer pool size (12441600). The buffer will 
be not be reused. This is most likely a bug in this GstBufferPool subclass


Everything works with 4k30fps or 1080p 60fps. The hardware should 
support 4k60fps.

Best regards,
Tim

On 19.07.24 14:40, Shreeya Patel wrote:
> This series implements support for the Synopsys DesignWare
> HDMI RX Controller, being compliant with standard HDMI 1.4b
> and HDMI 2.0.
>
> Features that are currently supported by the HDMI RX driver
> have been tested on rock5b board using a HDMI to micro-HDMI cable.
> It is recommended to use a good quality cable as there were
> multiple issues seen during testing the driver.
>
> Please note the below information :-
> * While testing the driver on rock5b we noticed that the binary BL31
> from Rockchip contains some unknown code to get the HDMI-RX PHY
> access working without any errors.
> With TF-A BL31, the HDMI-RX PHY also works fine but there were no
> interrupts seen for rk_hdmirx-hdmi leading to some errors when
> loading the driver [0]. It doesn't affect the functionality of the
> driver though.
> * We have tested the working of OBS studio with HDMIRX driver and
> there were no issues seen.
> * We also tested and verified the support for interlaced video.
>
> [0] https://gitlab.collabora.com/hardware-enablement/rockchip-3588/trusted-firmware-a/-/issues/1
>
> To test the HDMI RX Controller driver, following example commands can be used :-
>
> root@debian-rockchip-rock5b-rk3588:~# v4l2-ctl --verbose -d /dev/video0 \
> --set-fmt-video=width=1920,height=1080,pixelformat='BGR3' --stream-mmap=4 \
> --stream-skip=3 --stream-count=100 --stream-to=/home/hdmiin4k.raw --stream-poll
>
> root@debian-rockchip-rock5b-rk3588:~# ffmpeg -f rawvideo -vcodec rawvideo \
> -s 1920x1080 -r 60 -pix_fmt bgr24 -i /home/hdmiin4k.raw output.mkv
>
> CEC compliance test results :-
>
> * https://gitlab.collabora.com/-/snippets/381
> * https://gitlab.collabora.com/-/snippets/380
>
> Following is the v4l2-compliance test result :-
>
> root@debian-rockchip-rock5b-rk3588:~# v4l2-compliance -d /dev/video0
> v4l2-compliance 1.27.0-5220, 64 bits, 64-bit time_t
> v4l2-compliance SHA: 8387e3673837 2024-07-01 11:09:32
>
> Compliance test for snps_hdmirx device /dev/video0:
>
> Driver Info:
> 	Driver name      : snps_hdmirx
> 	Card type        : snps_hdmirx
> 	Bus info         : platform:fdee0000.hdmi-receiver
> 	Driver version   : 6.10.0
> 	Capabilities     : 0x84201000
> 		Video Capture Multiplanar
> 		Streaming
> 		Extended Pix Format
> 		Device Capabilities
> 	Device Caps      : 0x04201000
> 		Video Capture Multiplanar
> 		Streaming
> 		Extended Pix Format
>
> Required ioctls:
> 	test VIDIOC_QUERYCAP: OK
> 	test invalid ioctls: OK
>
> Allow for multiple opens:
> 	test second /dev/video0 open: OK
> 	test VIDIOC_QUERYCAP: OK
> 	test VIDIOC_G/S_PRIORITY: OK
> 	test for unlimited opens: OK
>
> Debug ioctls:
> 	test VIDIOC_DBG_G/S_REGISTER: OK (Not Supported)
> 	test VIDIOC_LOG_STATUS: OK
>
> Input ioctls:
> 	test VIDIOC_G/S_TUNER/ENUM_FREQ_BANDS: OK (Not Supported)
> 	test VIDIOC_G/S_FREQUENCY: OK (Not Supported)
> 	test VIDIOC_S_HW_FREQ_SEEK: OK (Not Supported)
> 	test VIDIOC_ENUMAUDIO: OK (Not Supported)
> 	test VIDIOC_G/S/ENUMINPUT: OK
> 	test VIDIOC_G/S_AUDIO: OK (Not Supported)
> 	Inputs: 1 Audio Inputs: 0 Tuners: 0
>
> Output ioctls:
> 	test VIDIOC_G/S_MODULATOR: OK (Not Supported)
> 	test VIDIOC_G/S_FREQUENCY: OK (Not Supported)
> 	test VIDIOC_ENUMAUDOUT: OK (Not Supported)
> 	test VIDIOC_G/S/ENUMOUTPUT: OK (Not Supported)
> 	test VIDIOC_G/S_AUDOUT: OK (Not Supported)
> 	Outputs: 0 Audio Outputs: 0 Modulators: 0
>
> Input/Output configuration ioctls:
> 	test VIDIOC_ENUM/G/S/QUERY_STD: OK (Not Supported)
> 	test VIDIOC_ENUM/G/S/QUERY_DV_TIMINGS: OK
> 	test VIDIOC_DV_TIMINGS_CAP: OK
> 	test VIDIOC_G/S_EDID: OK
>
> Control ioctls (Input 0):
> 	test VIDIOC_QUERY_EXT_CTRL/QUERYMENU: OK
> 	test VIDIOC_QUERYCTRL: OK
> 	test VIDIOC_G/S_CTRL: OK
> 	test VIDIOC_G/S/TRY_EXT_CTRLS: OK
> 	test VIDIOC_(UN)SUBSCRIBE_EVENT/DQEVENT: OK
> 	test VIDIOC_G/S_JPEGCOMP: OK (Not Supported)
> 	Standard Controls: 3 Private Controls: 0
>
> Format ioctls (Input 0):
> 	test VIDIOC_ENUM_FMT/FRAMESIZES/FRAMEINTERVALS: OK
> 	test VIDIOC_G/S_PARM: OK
> 	test VIDIOC_G_FBUF: OK (Not Supported)
> 	test VIDIOC_G_FMT: OK
> 	test VIDIOC_TRY_FMT: OK
> 	test VIDIOC_S_FMT: OK
> 	test VIDIOC_G_SLICED_VBI_CAP: OK (Not Supported)
> 	test Cropping: OK (Not Supported)
> 	test Composing: OK (Not Supported)
> 	test Scaling: OK (Not Supported)
>
> Codec ioctls (Input 0):
> 	test VIDIOC_(TRY_)ENCODER_CMD: OK (Not Supported)
> 	test VIDIOC_G_ENC_INDEX: OK (Not Supported)
> 	test VIDIOC_(TRY_)DECODER_CMD: OK (Not Supported)
>
> Buffer ioctls (Input 0):
> 	test VIDIOC_REQBUFS/CREATE_BUFS/QUERYBUF: OK
> 	test CREATE_BUFS maximum buffers: OK
> 	test VIDIOC_REMOVE_BUFS: OK
> 	test VIDIOC_EXPBUF: OK
> 	test Requests: OK (Not Supported)
>
> Total for snps_hdmirx device /dev/video0: 47, Succeeded: 47, Failed: 0, Warnings: 0
>
> Changes in v4 :-
>    - Remove DTS changes included in the device tree patch
>    - Remove the hdmi rx pin info as it's already present
>      in the rk3588-base-pinctrl.dtsi
>    - Create a separate config option for selecting the EDID
>      and enable it by default
>    - Improve the comment related to DV timings and move it
>      to the side of hdmirx_get_detected_timings
>    - Add 100ms delay before pulling the HPD high
>    - Do not return the detected timings from VIDIOC_G_DV_TIMINGS
>    - Drop the bus info from hdmirx_querycap
>    - If *num_planes != 0 then return 0 in hdmirx_queue_setup
>    - Set queue->min_queued_buffers to 1
>    - Drop q->allow_cache_hints = 0; as it's always 0 by default
>    - Add a comment for q->dma_attrs = DMA_ATTR_FORCE_CONTIGUOUS;
>    - Drop .read = vb2_fop_read as it's not supported by driver
>    - Remove redundant edid_init_data_600M
>    - Make HPD low when driver is loaded
>    - Add support for reading AVI Infoframe
>    - Remove msg_len checks from hdmirx_cec_transmit
>    - Add info about the CEC compliance test in the cover letter
>    - Add arbitration lost status
>    - Validate the physical address inside the EDID
>
> Changes in v3 :-
>    - Use v4l2-common helpers in the HDMIRX driver
>    - Rename cma node and phandle names
>    - Elaborate the comment to explain 160MiB calculation
>    - Move &hdmi_receiver_cma to the rock5b dts file
>    - Add information about interlaced video testing in the
>      cover-letter
>
> Changes in v2 :-
>    - Fix checkpatch --strict warnings
>    - Move the dt-binding include file changes in a separate patch
>    - Add a description for the hardware in the dt-bindings file
>    - Rename resets, vo1 grf and HPD properties
>    - Add a proper description for grf and vo1-grf phandles in the
>      bindings
>    - Rename the HDMI RX node name to hdmi-receiver
>    - Include gpio header file in binding example to fix the
>      dt_binding_check failure
>    - Move hdmirx_cma node to the rk3588.dtsi file
>    - Add an entry to MAINTAINERS file for the HDMIRX driver
>
> Shreeya Patel (4):
>    MAINTAINERS: Add entry for Synopsys DesignWare HDMI RX Driver
>    dt-bindings: media: Document bindings for HDMI RX Controller
>    arm64: dts: rockchip: Add device tree support for HDMI RX Controller
>    media: platform: synopsys: Add support for hdmi input driver
>
>   .../bindings/media/snps,dw-hdmi-rx.yaml       |  132 +
>   MAINTAINERS                                   |    8 +
>   .../dts/rockchip/rk3588-base-pinctrl.dtsi     |   14 +
>   .../arm64/boot/dts/rockchip/rk3588-extra.dtsi |   56 +
>   drivers/media/platform/Kconfig                |    1 +
>   drivers/media/platform/Makefile               |    1 +
>   drivers/media/platform/synopsys/Kconfig       |    3 +
>   drivers/media/platform/synopsys/Makefile      |    2 +
>   .../media/platform/synopsys/hdmirx/Kconfig    |   27 +
>   .../media/platform/synopsys/hdmirx/Makefile   |    4 +
>   .../platform/synopsys/hdmirx/snps_hdmirx.c    | 2763 +++++++++++++++++
>   .../platform/synopsys/hdmirx/snps_hdmirx.h    |  394 +++
>   .../synopsys/hdmirx/snps_hdmirx_cec.c         |  285 ++
>   .../synopsys/hdmirx/snps_hdmirx_cec.h         |   44 +
>   14 files changed, 3734 insertions(+)
>   create mode 100644 Documentation/devicetree/bindings/media/snps,dw-hdmi-rx.yaml
>   create mode 100644 drivers/media/platform/synopsys/Kconfig
>   create mode 100644 drivers/media/platform/synopsys/Makefile
>   create mode 100644 drivers/media/platform/synopsys/hdmirx/Kconfig
>   create mode 100644 drivers/media/platform/synopsys/hdmirx/Makefile
>   create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx.c
>   create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx.h
>   create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx_cec.c
>   create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx_cec.h
>
Nicolas Dufresne Aug. 5, 2024, 5:02 p.m. UTC | #4
Hi Tim,

Le dimanche 04 août 2024 à 01:57 +0200, Tim Surber a écrit :
> Hi Shreeya,
> 
> I tested your patch and noticed problems when using 3840x2160 resolution 
> at  60fps.
> 
> For my testing I connected an HDMI source and set it to 4k60fps. I 
> verified that this source and the cables work on a screen at this 
> resolution.
> 
> Using
> 'v4l2-ctl --verbose -d /dev/video1 
> --set-fmt-video=width=3840,height=2160,pixelformat='NV12' 
> --stream-mmap=4 --stream-skip=3 --stream-count=100 --stream-poll'
> I get the video format output, but not the periodic output which shows 
> the fps.
> 
> Using
> 'GST_DEBUG=4 gst-launch-1.0 -v v4l2src device=/dev/video1 ! 
> fpsdisplaysink text-overlay=false video-sink="fakevideosink"'
> I get the following error message:
> 
> (gst-launch-1.0:3231): GStreamer-CRITICAL **: 01:34:39.137: 
> gst_memory_resize: assertion 'size + mem->offset + offset <= 
> mem->maxsize' failed
> 0:00:03.489382529  3231 0xffffa0000b90 WARN  v4l2bufferpool 
> gstv4l2bufferpool.c:2209:gst_v4l2_buffer_pool_process:<v4l2src0:pool0:src> 
> Dropping truncated buffer, this is likely a driver bug.
> 0:00:03.489421906  3231 0xffffa0000b90 WARN  bufferpool 
> gstbufferpool.c:1252:default_reset_buffer:<v4l2src0:pool0:src> Buffer 
> 0xffff98008e80 without the memory tag has maxsize (8294400) that is 
> smaller than the configured buffer pool size (12441600). The buffer will 
> be not be reused. This is most likely a bug in this GstBufferPool subclass

We'll need to check if its a userspace issue rather then kernel one. You can
test with v4l2-ctl (change 0 to the index of your video node):

v4l2-ctl -d 0 --stream-mmap --set-fmt-video=width=3840,height=2160 --set-parm 60

The option --stream-to let you write to a file (will be slower then real-time
though).

Nicolas

> 
> 
> Everything works with 4k30fps or 1080p 60fps. The hardware should 
> support 4k60fps.
> 
> Best regards,
> Tim
> 
> On 19.07.24 14:40, Shreeya Patel wrote:
> > This series implements support for the Synopsys DesignWare
> > HDMI RX Controller, being compliant with standard HDMI 1.4b
> > and HDMI 2.0.
> > 
> > Features that are currently supported by the HDMI RX driver
> > have been tested on rock5b board using a HDMI to micro-HDMI cable.
> > It is recommended to use a good quality cable as there were
> > multiple issues seen during testing the driver.
> > 
> > Please note the below information :-
> > * While testing the driver on rock5b we noticed that the binary BL31
> > from Rockchip contains some unknown code to get the HDMI-RX PHY
> > access working without any errors.
> > With TF-A BL31, the HDMI-RX PHY also works fine but there were no
> > interrupts seen for rk_hdmirx-hdmi leading to some errors when
> > loading the driver [0]. It doesn't affect the functionality of the
> > driver though.
> > * We have tested the working of OBS studio with HDMIRX driver and
> > there were no issues seen.
> > * We also tested and verified the support for interlaced video.
> > 
> > [0] https://gitlab.collabora.com/hardware-enablement/rockchip-3588/trusted-firmware-a/-/issues/1
> > 
> > To test the HDMI RX Controller driver, following example commands can be used :-
> > 
> > root@debian-rockchip-rock5b-rk3588:~# v4l2-ctl --verbose -d /dev/video0 \
> > --set-fmt-video=width=1920,height=1080,pixelformat='BGR3' --stream-mmap=4 \
> > --stream-skip=3 --stream-count=100 --stream-to=/home/hdmiin4k.raw --stream-poll
> > 
> > root@debian-rockchip-rock5b-rk3588:~# ffmpeg -f rawvideo -vcodec rawvideo \
> > -s 1920x1080 -r 60 -pix_fmt bgr24 -i /home/hdmiin4k.raw output.mkv
> > 
> > CEC compliance test results :-
> > 
> > * https://gitlab.collabora.com/-/snippets/381
> > * https://gitlab.collabora.com/-/snippets/380
> > 
> > Following is the v4l2-compliance test result :-
> > 
> > root@debian-rockchip-rock5b-rk3588:~# v4l2-compliance -d /dev/video0
> > v4l2-compliance 1.27.0-5220, 64 bits, 64-bit time_t
> > v4l2-compliance SHA: 8387e3673837 2024-07-01 11:09:32
> > 
> > Compliance test for snps_hdmirx device /dev/video0:
> > 
> > Driver Info:
> > 	Driver name      : snps_hdmirx
> > 	Card type        : snps_hdmirx
> > 	Bus info         : platform:fdee0000.hdmi-receiver
> > 	Driver version   : 6.10.0
> > 	Capabilities     : 0x84201000
> > 		Video Capture Multiplanar
> > 		Streaming
> > 		Extended Pix Format
> > 		Device Capabilities
> > 	Device Caps      : 0x04201000
> > 		Video Capture Multiplanar
> > 		Streaming
> > 		Extended Pix Format
> > 
> > Required ioctls:
> > 	test VIDIOC_QUERYCAP: OK
> > 	test invalid ioctls: OK
> > 
> > Allow for multiple opens:
> > 	test second /dev/video0 open: OK
> > 	test VIDIOC_QUERYCAP: OK
> > 	test VIDIOC_G/S_PRIORITY: OK
> > 	test for unlimited opens: OK
> > 
> > Debug ioctls:
> > 	test VIDIOC_DBG_G/S_REGISTER: OK (Not Supported)
> > 	test VIDIOC_LOG_STATUS: OK
> > 
> > Input ioctls:
> > 	test VIDIOC_G/S_TUNER/ENUM_FREQ_BANDS: OK (Not Supported)
> > 	test VIDIOC_G/S_FREQUENCY: OK (Not Supported)
> > 	test VIDIOC_S_HW_FREQ_SEEK: OK (Not Supported)
> > 	test VIDIOC_ENUMAUDIO: OK (Not Supported)
> > 	test VIDIOC_G/S/ENUMINPUT: OK
> > 	test VIDIOC_G/S_AUDIO: OK (Not Supported)
> > 	Inputs: 1 Audio Inputs: 0 Tuners: 0
> > 
> > Output ioctls:
> > 	test VIDIOC_G/S_MODULATOR: OK (Not Supported)
> > 	test VIDIOC_G/S_FREQUENCY: OK (Not Supported)
> > 	test VIDIOC_ENUMAUDOUT: OK (Not Supported)
> > 	test VIDIOC_G/S/ENUMOUTPUT: OK (Not Supported)
> > 	test VIDIOC_G/S_AUDOUT: OK (Not Supported)
> > 	Outputs: 0 Audio Outputs: 0 Modulators: 0
> > 
> > Input/Output configuration ioctls:
> > 	test VIDIOC_ENUM/G/S/QUERY_STD: OK (Not Supported)
> > 	test VIDIOC_ENUM/G/S/QUERY_DV_TIMINGS: OK
> > 	test VIDIOC_DV_TIMINGS_CAP: OK
> > 	test VIDIOC_G/S_EDID: OK
> > 
> > Control ioctls (Input 0):
> > 	test VIDIOC_QUERY_EXT_CTRL/QUERYMENU: OK
> > 	test VIDIOC_QUERYCTRL: OK
> > 	test VIDIOC_G/S_CTRL: OK
> > 	test VIDIOC_G/S/TRY_EXT_CTRLS: OK
> > 	test VIDIOC_(UN)SUBSCRIBE_EVENT/DQEVENT: OK
> > 	test VIDIOC_G/S_JPEGCOMP: OK (Not Supported)
> > 	Standard Controls: 3 Private Controls: 0
> > 
> > Format ioctls (Input 0):
> > 	test VIDIOC_ENUM_FMT/FRAMESIZES/FRAMEINTERVALS: OK
> > 	test VIDIOC_G/S_PARM: OK
> > 	test VIDIOC_G_FBUF: OK (Not Supported)
> > 	test VIDIOC_G_FMT: OK
> > 	test VIDIOC_TRY_FMT: OK
> > 	test VIDIOC_S_FMT: OK
> > 	test VIDIOC_G_SLICED_VBI_CAP: OK (Not Supported)
> > 	test Cropping: OK (Not Supported)
> > 	test Composing: OK (Not Supported)
> > 	test Scaling: OK (Not Supported)
> > 
> > Codec ioctls (Input 0):
> > 	test VIDIOC_(TRY_)ENCODER_CMD: OK (Not Supported)
> > 	test VIDIOC_G_ENC_INDEX: OK (Not Supported)
> > 	test VIDIOC_(TRY_)DECODER_CMD: OK (Not Supported)
> > 
> > Buffer ioctls (Input 0):
> > 	test VIDIOC_REQBUFS/CREATE_BUFS/QUERYBUF: OK
> > 	test CREATE_BUFS maximum buffers: OK
> > 	test VIDIOC_REMOVE_BUFS: OK
> > 	test VIDIOC_EXPBUF: OK
> > 	test Requests: OK (Not Supported)
> > 
> > Total for snps_hdmirx device /dev/video0: 47, Succeeded: 47, Failed: 0, Warnings: 0
> > 
> > Changes in v4 :-
> >    - Remove DTS changes included in the device tree patch
> >    - Remove the hdmi rx pin info as it's already present
> >      in the rk3588-base-pinctrl.dtsi
> >    - Create a separate config option for selecting the EDID
> >      and enable it by default
> >    - Improve the comment related to DV timings and move it
> >      to the side of hdmirx_get_detected_timings
> >    - Add 100ms delay before pulling the HPD high
> >    - Do not return the detected timings from VIDIOC_G_DV_TIMINGS
> >    - Drop the bus info from hdmirx_querycap
> >    - If *num_planes != 0 then return 0 in hdmirx_queue_setup
> >    - Set queue->min_queued_buffers to 1
> >    - Drop q->allow_cache_hints = 0; as it's always 0 by default
> >    - Add a comment for q->dma_attrs = DMA_ATTR_FORCE_CONTIGUOUS;
> >    - Drop .read = vb2_fop_read as it's not supported by driver
> >    - Remove redundant edid_init_data_600M
> >    - Make HPD low when driver is loaded
> >    - Add support for reading AVI Infoframe
> >    - Remove msg_len checks from hdmirx_cec_transmit
> >    - Add info about the CEC compliance test in the cover letter
> >    - Add arbitration lost status
> >    - Validate the physical address inside the EDID
> > 
> > Changes in v3 :-
> >    - Use v4l2-common helpers in the HDMIRX driver
> >    - Rename cma node and phandle names
> >    - Elaborate the comment to explain 160MiB calculation
> >    - Move &hdmi_receiver_cma to the rock5b dts file
> >    - Add information about interlaced video testing in the
> >      cover-letter
> > 
> > Changes in v2 :-
> >    - Fix checkpatch --strict warnings
> >    - Move the dt-binding include file changes in a separate patch
> >    - Add a description for the hardware in the dt-bindings file
> >    - Rename resets, vo1 grf and HPD properties
> >    - Add a proper description for grf and vo1-grf phandles in the
> >      bindings
> >    - Rename the HDMI RX node name to hdmi-receiver
> >    - Include gpio header file in binding example to fix the
> >      dt_binding_check failure
> >    - Move hdmirx_cma node to the rk3588.dtsi file
> >    - Add an entry to MAINTAINERS file for the HDMIRX driver
> > 
> > Shreeya Patel (4):
> >    MAINTAINERS: Add entry for Synopsys DesignWare HDMI RX Driver
> >    dt-bindings: media: Document bindings for HDMI RX Controller
> >    arm64: dts: rockchip: Add device tree support for HDMI RX Controller
> >    media: platform: synopsys: Add support for hdmi input driver
> > 
> >   .../bindings/media/snps,dw-hdmi-rx.yaml       |  132 +
> >   MAINTAINERS                                   |    8 +
> >   .../dts/rockchip/rk3588-base-pinctrl.dtsi     |   14 +
> >   .../arm64/boot/dts/rockchip/rk3588-extra.dtsi |   56 +
> >   drivers/media/platform/Kconfig                |    1 +
> >   drivers/media/platform/Makefile               |    1 +
> >   drivers/media/platform/synopsys/Kconfig       |    3 +
> >   drivers/media/platform/synopsys/Makefile      |    2 +
> >   .../media/platform/synopsys/hdmirx/Kconfig    |   27 +
> >   .../media/platform/synopsys/hdmirx/Makefile   |    4 +
> >   .../platform/synopsys/hdmirx/snps_hdmirx.c    | 2763 +++++++++++++++++
> >   .../platform/synopsys/hdmirx/snps_hdmirx.h    |  394 +++
> >   .../synopsys/hdmirx/snps_hdmirx_cec.c         |  285 ++
> >   .../synopsys/hdmirx/snps_hdmirx_cec.h         |   44 +
> >   14 files changed, 3734 insertions(+)
> >   create mode 100644 Documentation/devicetree/bindings/media/snps,dw-hdmi-rx.yaml
> >   create mode 100644 drivers/media/platform/synopsys/Kconfig
> >   create mode 100644 drivers/media/platform/synopsys/Makefile
> >   create mode 100644 drivers/media/platform/synopsys/hdmirx/Kconfig
> >   create mode 100644 drivers/media/platform/synopsys/hdmirx/Makefile
> >   create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx.c
> >   create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx.h
> >   create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx_cec.c
> >   create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx_cec.h
> > 
>
Dmitry Osipenko Aug. 6, 2024, 11:58 a.m. UTC | #5
On 8/4/24 02:57, Tim Surber wrote:
> Hi Shreeya,
> 
> I tested your patch and noticed problems when using 3840x2160 resolution
> at  60fps.
> 
> For my testing I connected an HDMI source and set it to 4k60fps. I
> verified that this source and the cables work on a screen at this
> resolution.
> 
> Using
> 'v4l2-ctl --verbose -d /dev/video1
> --set-fmt-video=width=3840,height=2160,pixelformat='NV12'
> --stream-mmap=4 --stream-skip=3 --stream-count=100 --stream-poll'
> I get the video format output, but not the periodic output which shows
> the fps.
> 
> Using
> 'GST_DEBUG=4 gst-launch-1.0 -v v4l2src device=/dev/video1 !
> fpsdisplaysink text-overlay=false video-sink="fakevideosink"'
> I get the following error message:
> 
> (gst-launch-1.0:3231): GStreamer-CRITICAL **: 01:34:39.137:
> gst_memory_resize: assertion 'size + mem->offset + offset <=
> mem->maxsize' failed
> 0:00:03.489382529  3231 0xffffa0000b90 WARN  v4l2bufferpool
> gstv4l2bufferpool.c:2209:gst_v4l2_buffer_pool_process:<v4l2src0:pool0:src> Dropping truncated buffer, this is likely a driver bug.
> 0:00:03.489421906  3231 0xffffa0000b90 WARN  bufferpool
> gstbufferpool.c:1252:default_reset_buffer:<v4l2src0:pool0:src> Buffer
> 0xffff98008e80 without the memory tag has maxsize (8294400) that is
> smaller than the configured buffer pool size (12441600). The buffer will
> be not be reused. This is most likely a bug in this GstBufferPool subclass
> 
> 
> Everything works with 4k30fps or 1080p 60fps. The hardware should
> support 4k60fps.

Please do `echo 3 > /sys/module/synopsys_hdmirx/parameters/debug` and
show the kernel log of capturing 4k@60 with v4l2-ctl.
Tim Surber Aug. 6, 2024, 8:37 p.m. UTC | #6
Here are the results of some more debugging.
I see that in the first example the pixel format is set to RGB888 and in 
the second to NV12, I was not able to successfully change this on my 
source, nevertheless the HDMI RX should work I think.

###source set to 4k30fps####
---------------------------
v4l2-ctl --verbose -d /dev/video1 
--set-fmt-video=width=3840,height=2160,pixelformat='NV12' 
--stream-mmap=4 --stream-skip=3 --stream-count=100 --stream-poll
---------------------------
VIDIOC_QUERYCAP: ok
VIDIOC_G_FMT: ok
The pixelformat 'NV12' is invalid
New timings found
         VIDIOC_REQBUFS returned 0 (Success)
         VIDIOC_CREATE_BUFS returned 0 (Success)
         VIDIOC_QUERYBUF returned 0 (Success)
         VIDIOC_QUERYBUF returned 0 (Success)
         VIDIOC_QUERYBUF returned 0 (Success)
         VIDIOC_QUERYBUF returned 0 (Success)
         VIDIOC_G_FMT returned 0 (Success)
         VIDIOC_QBUF returned 0 (Success)
         VIDIOC_QBUF returned 0 (Success)
         VIDIOC_QBUF returned 0 (Success)
         VIDIOC_QBUF returned 0 (Success)
         VIDIOC_STREAMON returned 0 (Success)
cap dqbuf: 0 seq:      0 bytesused: 8294400 ts: 536.006261 field: Any 
(ts-monotonic, ts-src-eof)
cap dqbuf: 1 seq:      1 bytesused: 8294400 ts: 536.039574 delta: 33.313 
ms field: Any (ts-monotonic, ts-src-eof)
cap dqbuf: 2 seq:      2 bytesused: 8294400 ts: 536.072906 delta: 33.332 
ms field: Any (ts-monotonic, ts-src-eof)
cap dqbuf: 3 seq:      3 bytesused: 8294400 ts: 536.106239 delta: 33.333 
ms field: Any (ts-monotonic, ts-src-eof)
cap dqbuf: 0 seq:      4 bytesused: 8294400 ts: 536.139571 delta: 33.332 
ms fps: 30.01 field: Any (ts-monotonic, ts-src-eof)
cap dqbuf: 1 seq:      5 bytesused: 8294400 ts: 536.172903 delta: 33.332 
ms fps: 30.00 field: Any (ts-monotonic, ts-src-eof)
[...]

---------------------------
dmesg
---------------------------
[  529.266804] fdee0000.hdmi_receiver: hb
[  530.280073] fdee0000.hdmi_receiver: hb
[  531.293412] fdee0000.hdmi_receiver: hb
[  532.306716] fdee0000.hdmi_receiver: hb
[  533.319906] fdee0000.hdmi_receiver: hb
[  534.333263] fdee0000.hdmi_receiver: hb
[  535.346616] fdee0000.hdmi_receiver: hb
[  535.739795] fdee0000.hdmi_receiver: C-Plane 0 size: 24883200, Total 
imagesize: 24883200
[  535.747733] fdee0000.hdmi_receiver: tx_5v_power_present: 1
[  535.747750] fdee0000.hdmi_receiver: hdmirx_get_pix_fmt: pix_fmt: RGB888
[  535.747760] fdee0000.hdmi_receiver: hdmirx_get_colordepth: 
color_depth: 24, reg_val:4
[  535.747780] fdee0000.hdmi_receiver: get timings from dma
[  535.747787] fdee0000.hdmi_receiver: act:3840x2160, total:4400x2250, 
fps:30, pixclk:297016000
[  535.747799] fdee0000.hdmi_receiver: hfp:172, hs:92, hbp:296, vfp:8, 
vs:10, vbp:72
[  535.747809] fdee0000.hdmi_receiver: tmds_clk:297016000
[  535.747816] fdee0000.hdmi_receiver: interlace:0, fmt:0, vic:127, 
color:24, mode:hdmi
[  535.747825] fdee0000.hdmi_receiver: deframer_st:0x11
[  535.747833] fdee0000.hdmi_receiver: query_dv_timings: 3840x2160p30.00 
(4400x2250)
[  535.747854] fdee0000.hdmi_receiver: s_dv_timings: 3840x2160p30.00 
(4400x2250)
[  535.747875] fdee0000.hdmi_receiver: hdmirx_s_dv_timings: no change
[  535.747924] fdee0000.hdmi_receiver: vid-cap-mplane: count 4, size 8294400
[  535.752754] fdee0000.hdmi_receiver: C-Plane 0 size: 24883200, Total 
imagesize: 24883200
[  535.752884] fdee0000.hdmi_receiver: C-Plane 0 size: 24883200, Total 
imagesize: 24883200
[  535.752904] fdee0000.hdmi_receiver: hdmirx_start_streaming: 
start_stream cur_buf y_addr:0xe0ea5000, uv_addr:0xe168e000
[  535.752920] fdee0000.hdmi_receiver: hdmirx_start_streaming: enable dma
[  535.780112] fdee0000.hdmi_receiver: dma_irq st1:0x100, st13:1085
[  535.780128] fdee0000.hdmi_receiver: line_flag_int_handler: last have 
no dma_idle_irq
[  535.796093] fdee0000.hdmi_receiver: dma_irq st1:0x80, st13:2160
[  535.813435] fdee0000.hdmi_receiver: dma_irq st1:0x100, st13:1085
[  535.829423] fdee0000.hdmi_receiver: dma_irq st1:0x80, st13:2160
[...]
---------------------------

###source set to 4k60fps####
---------------------------
v4l2-ctl --verbose -d /dev/video1 
--set-fmt-video=width=3840,height=2160,pixelformat='NV12' 
--stream-mmap=4 --stream-skip=3 --stream-count=100 --stream-poll
---------------------------
VIDIOC_QUERYCAP: ok
VIDIOC_G_FMT: ok
VIDIOC_S_FMT: ok
Format Video Capture Multiplanar:
     Width/Height      : 3840/2160
     Pixel Format      : 'NV12' (Y/UV 4:2:0)
     Field             : None
     Number of planes  : 1
     Flags             :
     Colorspace        : sRGB
     Transfer Function : Default
     YCbCr/HSV Encoding: Default
     Quantization      : Default
     Plane 0           :
        Bytes per Line : 3840
        Size Image     : 8294400
[stuck here, have to end with ctrl c]


---------------------------
dmesg
---------------------------
[ 1520.198123] fdee0000.hdmi_receiver: hb
[ 1521.211383] fdee0000.hdmi_receiver: hb
[ 1522.224680] fdee0000.hdmi_receiver: hb
[ 1523.237936] fdee0000.hdmi_receiver: hb
[ 1524.251313] fdee0000.hdmi_receiver: hb
[ 1525.264606] fdee0000.hdmi_receiver: hb
[ 1526.277937] fdee0000.hdmi_receiver: hb
[ 1526.427540] fdee0000.hdmi_receiver: C-Plane 0 size: 8294400, Total 
imagesize: 8294400
[ 1526.427587] fdee0000.hdmi_receiver: C-Plane 0 size: 8294400, Total 
imagesize: 8294400
[ 1526.427598] fdee0000.hdmi_receiver: hdmirx_set_fmt: req(3840, 2160), 
out(3840, 2160), fmt:0x3231564e
[ 1526.435569] fdee0000.hdmi_receiver: tx_5v_power_present: 1
[ 1526.435588] fdee0000.hdmi_receiver: hdmirx_get_pix_fmt: pix_fmt: YUV420
[ 1526.435597] fdee0000.hdmi_receiver: hdmirx_get_colordepth: 
color_depth: 24, reg_val:4
[ 1526.435618] fdee0000.hdmi_receiver: get timings from dma
[ 1526.435626] fdee0000.hdmi_receiver: act:3840x2160, total:4400x2250, 
fps:60, pixclk:297008000
[ 1526.435637] fdee0000.hdmi_receiver: hfp:4294965460, hs:48, hbp:148, 
vfp:8, vs:10, vbp:72
[ 1526.435648] fdee0000.hdmi_receiver: tmds_clk:297008000
[ 1526.435656] fdee0000.hdmi_receiver: interlace:0, fmt:3, vic:127, 
color:24, mode:hdmi
[ 1526.435665] fdee0000.hdmi_receiver: deframer_st:0x11
[ 1527.291212] fdee0000.hdmi_receiver: hb
[ 1527.443533] fdee0000.hdmi_receiver: tx_5v_power_present: 1
[ 1527.443550] fdee0000.hdmi_receiver: hdmirx_get_pix_fmt: pix_fmt: YUV420
[ 1527.443560] fdee0000.hdmi_receiver: hdmirx_get_colordepth: 
color_depth: 24, reg_val:4
[ 1527.443579] fdee0000.hdmi_receiver: get timings from dma
[ 1527.443586] fdee0000.hdmi_receiver: act:3840x2160, total:4400x2250, 
fps:60, pixclk:297008000
[ 1527.443597] fdee0000.hdmi_receiver: hfp:4294965460, hs:48, hbp:148, 
vfp:8, vs:10, vbp:72
[ 1527.443608] fdee0000.hdmi_receiver: tmds_clk:297008000
[ 1527.443615] fdee0000.hdmi_receiver: interlace:0, fmt:3, vic:127, 
color:24, mode:hdmi
[ 1527.443625] fdee0000.hdmi_receiver: deframer_st:0x11
[ 1528.304515] fdee0000.hdmi_receiver: hb
[ 1528.451543] fdee0000.hdmi_receiver: tx_5v_power_present: 1
[ 1528.451560] fdee0000.hdmi_receiver: hdmirx_get_pix_fmt: pix_fmt: YUV420
[ 1528.451569] fdee0000.hdmi_receiver: hdmirx_get_colordepth: 
color_depth: 24, reg_val:4
[ 1528.451588] fdee0000.hdmi_receiver: get timings from dma
[ 1528.451595] fdee0000.hdmi_receiver: act:3840x2160, total:4400x2250, 
fps:60, pixclk:297008000
[ 1528.451606] fdee0000.hdmi_receiver: hfp:4294965460, hs:48, hbp:148, 
vfp:8, vs:10, vbp:72
[ 1528.451617] fdee0000.hdmi_receiver: tmds_clk:297008000
[ 1528.451624] fdee0000.hdmi_receiver: interlace:0, fmt:3, vic:127, 
color:24, mode:hdmi
[ 1528.451634] fdee0000.hdmi_receiver: deframer_st:0x11
[ 1529.317814] fdee0000.hdmi_receiver: hb
[ 1529.459549] fdee0000.hdmi_receiver: tx_5v_power_present: 1
[ 1529.459566] fdee0000.hdmi_receiver: hdmirx_get_pix_fmt: pix_fmt: YUV420
[ 1529.459575] fdee0000.hdmi_receiver: hdmirx_get_colordepth: 
color_depth: 24, reg_val:4
[ 1529.459593] fdee0000.hdmi_receiver: get timings from dma
[ 1529.459601] fdee0000.hdmi_receiver: act:3840x2160, total:4400x2250, 
fps:60, pixclk:297008000
[ 1529.459612] fdee0000.hdmi_receiver: hfp:4294965460, hs:48, hbp:148, 
vfp:8, vs:10, vbp:72
[ 1529.459623] fdee0000.hdmi_receiver: tmds_clk:297008000
[ 1529.459630] fdee0000.hdmi_receiver: interlace:0, fmt:3, vic:127, 
color:24, mode:hdmi
[ 1529.459640] fdee0000.hdmi_receiver: deframer_st:0x11
[ 1530.331085] fdee0000.hdmi_receiver: hb
[ 1530.467555] fdee0000.hdmi_receiver: tx_5v_power_present: 1
[ 1530.467571] fdee0000.hdmi_receiver: hdmirx_get_pix_fmt: pix_fmt: YUV420
[ 1530.467580] fdee0000.hdmi_receiver: hdmirx_get_colordepth: 
color_depth: 24, reg_val:4
[ 1530.467599] fdee0000.hdmi_receiver: get timings from dma
[ 1530.467606] fdee0000.hdmi_receiver: act:3840x2160, total:4400x2250, 
fps:60, pixclk:297008000
[ 1530.467618] fdee0000.hdmi_receiver: hfp:4294965460, hs:48, hbp:148, 
vfp:8, vs:10, vbp:72
[ 1530.467628] fdee0000.hdmi_receiver: tmds_clk:297008000
[ 1530.467635] fdee0000.hdmi_receiver: interlace:0, fmt:3, vic:127, 
color:24, mode:hdmi
[ 1530.467664] fdee0000.hdmi_receiver: deframer_st:0x11
[ 1531.344437] fdee0000.hdmi_receiver: hb
[ 1531.475649] fdee0000.hdmi_receiver: tx_5v_power_present: 1
[ 1531.475665] fdee0000.hdmi_receiver: hdmirx_get_pix_fmt: pix_fmt: YUV420
[ 1531.475674] fdee0000.hdmi_receiver: hdmirx_get_colordepth: 
color_depth: 24, reg_val:4
[ 1531.475693] fdee0000.hdmi_receiver: get timings from dma
[ 1531.475700] fdee0000.hdmi_receiver: act:3840x2160, total:4400x2250, 
fps:60, pixclk:297008000
[ 1531.475711] fdee0000.hdmi_receiver: hfp:4294965460, hs:48, hbp:148, 
vfp:8, vs:10, vbp:72
[ 1531.475722] fdee0000.hdmi_receiver: tmds_clk:297008000
[ 1531.475729] fdee0000.hdmi_receiver: interlace:0, fmt:3, vic:127, 
color:24, mode:hdmi
[ 1531.475739] fdee0000.hdmi_receiver: deframer_st:0x11
[ 1532.357695] fdee0000.hdmi_receiver: hb
[ 1532.483716] fdee0000.hdmi_receiver: tx_5v_power_present: 1
[ 1532.483733] fdee0000.hdmi_receiver: hdmirx_get_pix_fmt: pix_fmt: YUV420
[ 1532.483742] fdee0000.hdmi_receiver: hdmirx_get_colordepth: 
color_depth: 24, reg_val:4
[ 1532.483761] fdee0000.hdmi_receiver: get timings from dma
[ 1532.483768] fdee0000.hdmi_receiver: act:3840x2160, total:4400x2250, 
fps:60, pixclk:297008000
[ 1532.483780] fdee0000.hdmi_receiver: hfp:4294965460, hs:48, hbp:148, 
vfp:8, vs:10, vbp:72
[ 1532.483790] fdee0000.hdmi_receiver: tmds_clk:297008000
[ 1532.483797] fdee0000.hdmi_receiver: interlace:0, fmt:3, vic:127, 
color:24, mode:hdmi
[ 1532.483807] fdee0000.hdmi_receiver: deframer_st:0x11
[ 1533.370994] fdee0000.hdmi_receiver: hb
[ 1533.491726] fdee0000.hdmi_receiver: tx_5v_power_present: 1
[ 1533.491743] fdee0000.hdmi_receiver: hdmirx_get_pix_fmt: pix_fmt: YUV420
[ 1533.491752] fdee0000.hdmi_receiver: hdmirx_get_colordepth: 
color_depth: 24, reg_val:4
[ 1533.491770] fdee0000.hdmi_receiver: get timings from dma
[ 1533.491778] fdee0000.hdmi_receiver: act:3840x2160, total:4400x2250, 
fps:60, pixclk:297008000
[ 1533.491789] fdee0000.hdmi_receiver: hfp:4294965460, hs:48, hbp:148, 
vfp:8, vs:10, vbp:72
[ 1533.491800] fdee0000.hdmi_receiver: tmds_clk:297008000
[ 1533.491807] fdee0000.hdmi_receiver: interlace:0, fmt:3, vic:127, 
color:24, mode:hdmi
[ 1533.491816] fdee0000.hdmi_receiver: deframer_st:0x11
[ 1534.384324] fdee0000.hdmi_receiver: hb
[ 1534.499888] fdee0000.hdmi_receiver: tx_5v_power_present: 1
[ 1534.499904] fdee0000.hdmi_receiver: hdmirx_get_pix_fmt: pix_fmt: YUV420
[ 1534.499913] fdee0000.hdmi_receiver: hdmirx_get_colordepth: 
color_depth: 24, reg_val:4
[ 1534.499932] fdee0000.hdmi_receiver: get timings from dma
[ 1534.499939] fdee0000.hdmi_receiver: act:3840x2160, total:4400x2250, 
fps:60, pixclk:297008000
[ 1534.499950] fdee0000.hdmi_receiver: hfp:4294965460, hs:48, hbp:148, 
vfp:8, vs:10, vbp:72
[ 1534.499960] fdee0000.hdmi_receiver: tmds_clk:297008000
[ 1534.499968] fdee0000.hdmi_receiver: interlace:0, fmt:3, vic:127, 
color:24, mode:hdmi
[ 1534.499977] fdee0000.hdmi_receiver: deframer_st:0x11
[ 1535.397596] fdee0000.hdmi_receiver: hb
[ 1535.507961] fdee0000.hdmi_receiver: tx_5v_power_present: 1
[ 1535.507977] fdee0000.hdmi_receiver: hdmirx_get_pix_fmt: pix_fmt: YUV420
[ 1535.507986] fdee0000.hdmi_receiver: hdmirx_get_colordepth: 
color_depth: 24, reg_val:4
[ 1535.508005] fdee0000.hdmi_receiver: get timings from dma
[ 1535.508012] fdee0000.hdmi_receiver: act:3840x2160, total:4400x2250, 
fps:60, pixclk:297008000
[ 1535.508023] fdee0000.hdmi_receiver: hfp:4294965460, hs:48, hbp:148, 
vfp:8, vs:10, vbp:72
[ 1535.508034] fdee0000.hdmi_receiver: tmds_clk:297008000
[ 1535.508041] fdee0000.hdmi_receiver: interlace:0, fmt:3, vic:127, 
color:24, mode:hdmi
[ 1535.508051] fdee0000.hdmi_receiver: deframer_st:0x11
[ 1536.410933] fdee0000.hdmi_receiver: hb
[ 1537.424223] fdee0000.hdmi_receiver: hb
[ 1538.437523] fdee0000.hdmi_receiver: hb
[ 1539.450848] fdee0000.hdmi_receiver: hb

Best regards
Tim

On 06.08.24 13:58, Dmitry Osipenko wrote:
> On 8/4/24 02:57, Tim Surber wrote:
>> Hi Shreeya,
>>
>> I tested your patch and noticed problems when using 3840x2160 resolution
>> at  60fps.
>>
>> For my testing I connected an HDMI source and set it to 4k60fps. I
>> verified that this source and the cables work on a screen at this
>> resolution.
>>
>> Using
>> 'v4l2-ctl --verbose -d /dev/video1
>> --set-fmt-video=width=3840,height=2160,pixelformat='NV12'
>> --stream-mmap=4 --stream-skip=3 --stream-count=100 --stream-poll'
>> I get the video format output, but not the periodic output which shows
>> the fps.
>>
>> Using
>> 'GST_DEBUG=4 gst-launch-1.0 -v v4l2src device=/dev/video1 !
>> fpsdisplaysink text-overlay=false video-sink="fakevideosink"'
>> I get the following error message:
>>
>> (gst-launch-1.0:3231): GStreamer-CRITICAL **: 01:34:39.137:
>> gst_memory_resize: assertion 'size + mem->offset + offset <=
>> mem->maxsize' failed
>> 0:00:03.489382529  3231 0xffffa0000b90 WARN  v4l2bufferpool
>> gstv4l2bufferpool.c:2209:gst_v4l2_buffer_pool_process:<v4l2src0:pool0:src> Dropping truncated buffer, this is likely a driver bug.
>> 0:00:03.489421906  3231 0xffffa0000b90 WARN  bufferpool
>> gstbufferpool.c:1252:default_reset_buffer:<v4l2src0:pool0:src> Buffer
>> 0xffff98008e80 without the memory tag has maxsize (8294400) that is
>> smaller than the configured buffer pool size (12441600). The buffer will
>> be not be reused. This is most likely a bug in this GstBufferPool subclass
>>
>>
>> Everything works with 4k30fps or 1080p 60fps. The hardware should
>> support 4k60fps.
> Please do `echo 3 > /sys/module/synopsys_hdmirx/parameters/debug` and
> show the kernel log of capturing 4k@60 with v4l2-ctl.
>
Nicolas Dufresne Aug. 6, 2024, 9:17 p.m. UTC | #7
Hi Tim,

Le mardi 06 août 2024 à 22:37 +0200, Tim Surber a écrit :
> ###source set to 4k60fps####
> ---------------------------
> v4l2-ctl --verbose -d /dev/video1 
> --set-fmt-video=width=3840,height=2160,pixelformat='NV12' 
> --stream-mmap=4 --stream-skip=3 --stream-count=100 --stream-poll
> ---------------------------
> VIDIOC_QUERYCAP: ok
> VIDIOC_G_FMT: ok
> VIDIOC_S_FMT: ok
> Format Video Capture Multiplanar:
>      Width/Height      : 3840/2160
>      Pixel Format      : 'NV12' (Y/UV 4:2:0)
>      Field             : None
>      Number of planes  : 1
>      Flags             :
>      Colorspace        : sRGB
>      Transfer Function : Default
>      YCbCr/HSV Encoding: Default
>      Quantization      : Default
>      Plane 0           :
>         Bytes per Line : 3840
>         Size Image     : 8294400

You have highlighted a bug here. NV12 has 2 planes, but the size image only
allow for the luma to be stored.

   Size Image: 3840 * 2160 * 3 / 2 = 12441600 bytes.

Lets at least get that fixed, and check again.

Nicolas
Shreeya Patel Aug. 14, 2024, 10:22 a.m. UTC | #8
---- On Sun, 04 Aug 2024 05:27:08 +0530  Tim Surber  wrote --- 
 > Hi Shreeya,
 > 

Hi Tim,


 > I tested your patch and noticed problems when using 3840x2160 resolution 
 > at  60fps.
 > 
 > For my testing I connected an HDMI source and set it to 4k60fps. I 
 > verified that this source and the cables work on a screen at this 
 > resolution.
 > 
 > Using
 > 'v4l2-ctl --verbose -d /dev/video1 
 > --set-fmt-video=width=3840,height=2160,pixelformat='NV12' 
 > --stream-mmap=4 --stream-skip=3 --stream-count=100 --stream-poll'
 > I get the video format output, but not the periodic output which shows 
 > the fps.
 > 
 > Using
 > 'GST_DEBUG=4 gst-launch-1.0 -v v4l2src device=/dev/video1 ! 
 > fpsdisplaysink text-overlay=false video-sink="fakevideosink"'
 > I get the following error message:
 > 
 > (gst-launch-1.0:3231): GStreamer-CRITICAL **: 01:34:39.137: 
 > gst_memory_resize: assertion 'size + mem->offset + offset <= 
 > mem->maxsize' failed
 > 0:00:03.489382529  3231 0xffffa0000b90 WARN  v4l2bufferpool 
 > gstv4l2bufferpool.c:2209:gst_v4l2_buffer_pool_process: 
 > Dropping truncated buffer, this is likely a driver bug.
 > 0:00:03.489421906  3231 0xffffa0000b90 WARN  bufferpool 
 > gstbufferpool.c:1252:default_reset_buffer: Buffer 
 > 0xffff98008e80 without the memory tag has maxsize (8294400) that is 
 > smaller than the configured buffer pool size (12441600). The buffer will 
 > be not be reused. This is most likely a bug in this GstBufferPool subclass
 > 
 > 
 > Everything works with 4k30fps or 1080p 60fps. The hardware should 
 > support 4k60fps.
 > 


Sorry for the delayed response, I've been trying to reproduce this on my side
and to also fix it.

It seems you are right, 4K@60 fps doesn't work with the latest version of HDMIRX.
We found out that it could be because of the current EDID which shows some failures.

Though I wasn't able to test the following on my side since my device doesn't support
4K, one of my colleague tried to replace the EDID and 4K@60 fps worked fine after that.

If you'd like to try it yourself then following is the command to get the new EDID

v4l2-ctl --show-edid type=hdmi-4k-600mhz

You will have to replace the EDID in the driver with the EDID you get the from the above
command in HEX format.

Thanks for reporting this, I will soon send v5 with this change included in it.


Thanks,
Shreeya Patel


 > Best regards,
 > Tim
 > 
 > On 19.07.24 14:40, Shreeya Patel wrote:
 > > This series implements support for the Synopsys DesignWare
 > > HDMI RX Controller, being compliant with standard HDMI 1.4b
 > > and HDMI 2.0.
 > >
 > > Features that are currently supported by the HDMI RX driver
 > > have been tested on rock5b board using a HDMI to micro-HDMI cable.
 > > It is recommended to use a good quality cable as there were
 > > multiple issues seen during testing the driver.
 > >
 > > Please note the below information :-
 > > * While testing the driver on rock5b we noticed that the binary BL31
 > > from Rockchip contains some unknown code to get the HDMI-RX PHY
 > > access working without any errors.
 > > With TF-A BL31, the HDMI-RX PHY also works fine but there were no
 > > interrupts seen for rk_hdmirx-hdmi leading to some errors when
 > > loading the driver [0]. It doesn't affect the functionality of the
 > > driver though.
 > > * We have tested the working of OBS studio with HDMIRX driver and
 > > there were no issues seen.
 > > * We also tested and verified the support for interlaced video.
 > >
 > > [0] https://gitlab.collabora.com/hardware-enablement/rockchip-3588/trusted-firmware-a/-/issues/1
 > >
 > > To test the HDMI RX Controller driver, following example commands can be used :-
 > >
 > > root@debian-rockchip-rock5b-rk3588:~# v4l2-ctl --verbose -d /dev/video0 \
 > > --set-fmt-video=width=1920,height=1080,pixelformat='BGR3' --stream-mmap=4 \
 > > --stream-skip=3 --stream-count=100 --stream-to=/home/hdmiin4k.raw --stream-poll
 > >
 > > root@debian-rockchip-rock5b-rk3588:~# ffmpeg -f rawvideo -vcodec rawvideo \
 > > -s 1920x1080 -r 60 -pix_fmt bgr24 -i /home/hdmiin4k.raw output.mkv
 > >
 > > CEC compliance test results :-
 > >
 > > * https://gitlab.collabora.com/-/snippets/381
 > > * https://gitlab.collabora.com/-/snippets/380
 > >
 > > Following is the v4l2-compliance test result :-
 > >
 > > root@debian-rockchip-rock5b-rk3588:~# v4l2-compliance -d /dev/video0
 > > v4l2-compliance 1.27.0-5220, 64 bits, 64-bit time_t
 > > v4l2-compliance SHA: 8387e3673837 2024-07-01 11:09:32
 > >
 > > Compliance test for snps_hdmirx device /dev/video0:
 > >
 > > Driver Info:
 > >     Driver name      : snps_hdmirx
 > >     Card type        : snps_hdmirx
 > >     Bus info         : platform:fdee0000.hdmi-receiver
 > >     Driver version   : 6.10.0
 > >     Capabilities     : 0x84201000
 > >         Video Capture Multiplanar
 > >         Streaming
 > >         Extended Pix Format
 > >         Device Capabilities
 > >     Device Caps      : 0x04201000
 > >         Video Capture Multiplanar
 > >         Streaming
 > >         Extended Pix Format
 > >
 > > Required ioctls:
 > >     test VIDIOC_QUERYCAP: OK
 > >     test invalid ioctls: OK
 > >
 > > Allow for multiple opens:
 > >     test second /dev/video0 open: OK
 > >     test VIDIOC_QUERYCAP: OK
 > >     test VIDIOC_G/S_PRIORITY: OK
 > >     test for unlimited opens: OK
 > >
 > > Debug ioctls:
 > >     test VIDIOC_DBG_G/S_REGISTER: OK (Not Supported)
 > >     test VIDIOC_LOG_STATUS: OK
 > >
 > > Input ioctls:
 > >     test VIDIOC_G/S_TUNER/ENUM_FREQ_BANDS: OK (Not Supported)
 > >     test VIDIOC_G/S_FREQUENCY: OK (Not Supported)
 > >     test VIDIOC_S_HW_FREQ_SEEK: OK (Not Supported)
 > >     test VIDIOC_ENUMAUDIO: OK (Not Supported)
 > >     test VIDIOC_G/S/ENUMINPUT: OK
 > >     test VIDIOC_G/S_AUDIO: OK (Not Supported)
 > >     Inputs: 1 Audio Inputs: 0 Tuners: 0
 > >
 > > Output ioctls:
 > >     test VIDIOC_G/S_MODULATOR: OK (Not Supported)
 > >     test VIDIOC_G/S_FREQUENCY: OK (Not Supported)
 > >     test VIDIOC_ENUMAUDOUT: OK (Not Supported)
 > >     test VIDIOC_G/S/ENUMOUTPUT: OK (Not Supported)
 > >     test VIDIOC_G/S_AUDOUT: OK (Not Supported)
 > >     Outputs: 0 Audio Outputs: 0 Modulators: 0
 > >
 > > Input/Output configuration ioctls:
 > >     test VIDIOC_ENUM/G/S/QUERY_STD: OK (Not Supported)
 > >     test VIDIOC_ENUM/G/S/QUERY_DV_TIMINGS: OK
 > >     test VIDIOC_DV_TIMINGS_CAP: OK
 > >     test VIDIOC_G/S_EDID: OK
 > >
 > > Control ioctls (Input 0):
 > >     test VIDIOC_QUERY_EXT_CTRL/QUERYMENU: OK
 > >     test VIDIOC_QUERYCTRL: OK
 > >     test VIDIOC_G/S_CTRL: OK
 > >     test VIDIOC_G/S/TRY_EXT_CTRLS: OK
 > >     test VIDIOC_(UN)SUBSCRIBE_EVENT/DQEVENT: OK
 > >     test VIDIOC_G/S_JPEGCOMP: OK (Not Supported)
 > >     Standard Controls: 3 Private Controls: 0
 > >
 > > Format ioctls (Input 0):
 > >     test VIDIOC_ENUM_FMT/FRAMESIZES/FRAMEINTERVALS: OK
 > >     test VIDIOC_G/S_PARM: OK
 > >     test VIDIOC_G_FBUF: OK (Not Supported)
 > >     test VIDIOC_G_FMT: OK
 > >     test VIDIOC_TRY_FMT: OK
 > >     test VIDIOC_S_FMT: OK
 > >     test VIDIOC_G_SLICED_VBI_CAP: OK (Not Supported)
 > >     test Cropping: OK (Not Supported)
 > >     test Composing: OK (Not Supported)
 > >     test Scaling: OK (Not Supported)
 > >
 > > Codec ioctls (Input 0):
 > >     test VIDIOC_(TRY_)ENCODER_CMD: OK (Not Supported)
 > >     test VIDIOC_G_ENC_INDEX: OK (Not Supported)
 > >     test VIDIOC_(TRY_)DECODER_CMD: OK (Not Supported)
 > >
 > > Buffer ioctls (Input 0):
 > >     test VIDIOC_REQBUFS/CREATE_BUFS/QUERYBUF: OK
 > >     test CREATE_BUFS maximum buffers: OK
 > >     test VIDIOC_REMOVE_BUFS: OK
 > >     test VIDIOC_EXPBUF: OK
 > >     test Requests: OK (Not Supported)
 > >
 > > Total for snps_hdmirx device /dev/video0: 47, Succeeded: 47, Failed: 0, Warnings: 0
 > >
 > > Changes in v4 :-
 > >    - Remove DTS changes included in the device tree patch
 > >    - Remove the hdmi rx pin info as it's already present
 > >      in the rk3588-base-pinctrl.dtsi
 > >    - Create a separate config option for selecting the EDID
 > >      and enable it by default
 > >    - Improve the comment related to DV timings and move it
 > >      to the side of hdmirx_get_detected_timings
 > >    - Add 100ms delay before pulling the HPD high
 > >    - Do not return the detected timings from VIDIOC_G_DV_TIMINGS
 > >    - Drop the bus info from hdmirx_querycap
 > >    - If *num_planes != 0 then return 0 in hdmirx_queue_setup
 > >    - Set queue->min_queued_buffers to 1
 > >    - Drop q->allow_cache_hints = 0; as it's always 0 by default
 > >    - Add a comment for q->dma_attrs = DMA_ATTR_FORCE_CONTIGUOUS;
 > >    - Drop .read = vb2_fop_read as it's not supported by driver
 > >    - Remove redundant edid_init_data_600M
 > >    - Make HPD low when driver is loaded
 > >    - Add support for reading AVI Infoframe
 > >    - Remove msg_len checks from hdmirx_cec_transmit
 > >    - Add info about the CEC compliance test in the cover letter
 > >    - Add arbitration lost status
 > >    - Validate the physical address inside the EDID
 > >
 > > Changes in v3 :-
 > >    - Use v4l2-common helpers in the HDMIRX driver
 > >    - Rename cma node and phandle names
 > >    - Elaborate the comment to explain 160MiB calculation
 > >    - Move &hdmi_receiver_cma to the rock5b dts file
 > >    - Add information about interlaced video testing in the
 > >      cover-letter
 > >
 > > Changes in v2 :-
 > >    - Fix checkpatch --strict warnings
 > >    - Move the dt-binding include file changes in a separate patch
 > >    - Add a description for the hardware in the dt-bindings file
 > >    - Rename resets, vo1 grf and HPD properties
 > >    - Add a proper description for grf and vo1-grf phandles in the
 > >      bindings
 > >    - Rename the HDMI RX node name to hdmi-receiver
 > >    - Include gpio header file in binding example to fix the
 > >      dt_binding_check failure
 > >    - Move hdmirx_cma node to the rk3588.dtsi file
 > >    - Add an entry to MAINTAINERS file for the HDMIRX driver
 > >
 > > Shreeya Patel (4):
 > >    MAINTAINERS: Add entry for Synopsys DesignWare HDMI RX Driver
 > >    dt-bindings: media: Document bindings for HDMI RX Controller
 > >    arm64: dts: rockchip: Add device tree support for HDMI RX Controller
 > >    media: platform: synopsys: Add support for hdmi input driver
 > >
 > >   .../bindings/media/snps,dw-hdmi-rx.yaml       |  132 +
 > >   MAINTAINERS                                   |    8 +
 > >   .../dts/rockchip/rk3588-base-pinctrl.dtsi     |   14 +
 > >   .../arm64/boot/dts/rockchip/rk3588-extra.dtsi |   56 +
 > >   drivers/media/platform/Kconfig                |    1 +
 > >   drivers/media/platform/Makefile               |    1 +
 > >   drivers/media/platform/synopsys/Kconfig       |    3 +
 > >   drivers/media/platform/synopsys/Makefile      |    2 +
 > >   .../media/platform/synopsys/hdmirx/Kconfig    |   27 +
 > >   .../media/platform/synopsys/hdmirx/Makefile   |    4 +
 > >   .../platform/synopsys/hdmirx/snps_hdmirx.c    | 2763 +++++++++++++++++
 > >   .../platform/synopsys/hdmirx/snps_hdmirx.h    |  394 +++
 > >   .../synopsys/hdmirx/snps_hdmirx_cec.c         |  285 ++
 > >   .../synopsys/hdmirx/snps_hdmirx_cec.h         |   44 +
 > >   14 files changed, 3734 insertions(+)
 > >   create mode 100644 Documentation/devicetree/bindings/media/snps,dw-hdmi-rx.yaml
 > >   create mode 100644 drivers/media/platform/synopsys/Kconfig
 > >   create mode 100644 drivers/media/platform/synopsys/Makefile
 > >   create mode 100644 drivers/media/platform/synopsys/hdmirx/Kconfig
 > >   create mode 100644 drivers/media/platform/synopsys/hdmirx/Makefile
 > >   create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx.c
 > >   create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx.h
 > >   create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx_cec.c
 > >   create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx_cec.h
 > >
 >
Tim Surber Aug. 28, 2024, 10:13 p.m. UTC | #9
Hi Shreeya,

another hint:

Changing the EDID like you described fixed the 4k60fps BGR3 input.

But still for NV16/NV24 (I can't output NV12 for some reason) there is 
the error which Nicolas described.

The output from v4l2-ctl for NV16/NV24 is:

Plane 0           :
        Bytes per Line : 3840
        Size Image     : 8294400

According to Nicolas there should be an additional plane/more memory 
reserved.

This leads to errors when trying to read the device using for example 
gstreamer:

  gst_memory_resize: assertion 'size + mem->offset + offset <= 
mem->maxsize' failed


This seems to always happen using the  NV16/NV24 formats regardless of 
resolution/fps.


Best regards,

Tim

On 14.08.24 12:22, Shreeya Patel wrote:
>   ---- On Sun, 04 Aug 2024 05:27:08 +0530  Tim Surber  wrote ---
>   > Hi Shreeya,
>   >
>
> Hi Tim,
>
>
>   > I tested your patch and noticed problems when using 3840x2160 resolution
>   > at  60fps.
>   >
>   > For my testing I connected an HDMI source and set it to 4k60fps. I
>   > verified that this source and the cables work on a screen at this
>   > resolution.
>   >
>   > Using
>   > 'v4l2-ctl --verbose -d /dev/video1
>   > --set-fmt-video=width=3840,height=2160,pixelformat='NV12'
>   > --stream-mmap=4 --stream-skip=3 --stream-count=100 --stream-poll'
>   > I get the video format output, but not the periodic output which shows
>   > the fps.
>   >
>   > Using
>   > 'GST_DEBUG=4 gst-launch-1.0 -v v4l2src device=/dev/video1 !
>   > fpsdisplaysink text-overlay=false video-sink="fakevideosink"'
>   > I get the following error message:
>   >
>   > (gst-launch-1.0:3231): GStreamer-CRITICAL **: 01:34:39.137:
>   > gst_memory_resize: assertion 'size + mem->offset + offset <=
>   > mem->maxsize' failed
>   > 0:00:03.489382529  3231 0xffffa0000b90 WARN  v4l2bufferpool
>   > gstv4l2bufferpool.c:2209:gst_v4l2_buffer_pool_process:
>   > Dropping truncated buffer, this is likely a driver bug.
>   > 0:00:03.489421906  3231 0xffffa0000b90 WARN  bufferpool
>   > gstbufferpool.c:1252:default_reset_buffer: Buffer
>   > 0xffff98008e80 without the memory tag has maxsize (8294400) that is
>   > smaller than the configured buffer pool size (12441600). The buffer will
>   > be not be reused. This is most likely a bug in this GstBufferPool subclass
>   >
>   >
>   > Everything works with 4k30fps or 1080p 60fps. The hardware should
>   > support 4k60fps.
>   >
>
>
> Sorry for the delayed response, I've been trying to reproduce this on my side
> and to also fix it.
>
> It seems you are right, 4K@60 fps doesn't work with the latest version of HDMIRX.
> We found out that it could be because of the current EDID which shows some failures.
>
> Though I wasn't able to test the following on my side since my device doesn't support
> 4K, one of my colleague tried to replace the EDID and 4K@60 fps worked fine after that.
>
> If you'd like to try it yourself then following is the command to get the new EDID
>
> v4l2-ctl --show-edid type=hdmi-4k-600mhz
>
> You will have to replace the EDID in the driver with the EDID you get the from the above
> command in HEX format.
>
> Thanks for reporting this, I will soon send v5 with this change included in it.
>
>
> Thanks,
> Shreeya Patel
>
>
>   > Best regards,
>   > Tim
>   >
>   > On 19.07.24 14:40, Shreeya Patel wrote:
>   > > This series implements support for the Synopsys DesignWare
>   > > HDMI RX Controller, being compliant with standard HDMI 1.4b
>   > > and HDMI 2.0.
>   > >
>   > > Features that are currently supported by the HDMI RX driver
>   > > have been tested on rock5b board using a HDMI to micro-HDMI cable.
>   > > It is recommended to use a good quality cable as there were
>   > > multiple issues seen during testing the driver.
>   > >
>   > > Please note the below information :-
>   > > * While testing the driver on rock5b we noticed that the binary BL31
>   > > from Rockchip contains some unknown code to get the HDMI-RX PHY
>   > > access working without any errors.
>   > > With TF-A BL31, the HDMI-RX PHY also works fine but there were no
>   > > interrupts seen for rk_hdmirx-hdmi leading to some errors when
>   > > loading the driver [0]. It doesn't affect the functionality of the
>   > > driver though.
>   > > * We have tested the working of OBS studio with HDMIRX driver and
>   > > there were no issues seen.
>   > > * We also tested and verified the support for interlaced video.
>   > >
>   > > [0] https://gitlab.collabora.com/hardware-enablement/rockchip-3588/trusted-firmware-a/-/issues/1
>   > >
>   > > To test the HDMI RX Controller driver, following example commands can be used :-
>   > >
>   > > root@debian-rockchip-rock5b-rk3588:~# v4l2-ctl --verbose -d /dev/video0 \
>   > > --set-fmt-video=width=1920,height=1080,pixelformat='BGR3' --stream-mmap=4 \
>   > > --stream-skip=3 --stream-count=100 --stream-to=/home/hdmiin4k.raw --stream-poll
>   > >
>   > > root@debian-rockchip-rock5b-rk3588:~# ffmpeg -f rawvideo -vcodec rawvideo \
>   > > -s 1920x1080 -r 60 -pix_fmt bgr24 -i /home/hdmiin4k.raw output.mkv
>   > >
>   > > CEC compliance test results :-
>   > >
>   > > * https://gitlab.collabora.com/-/snippets/381
>   > > * https://gitlab.collabora.com/-/snippets/380
>   > >
>   > > Following is the v4l2-compliance test result :-
>   > >
>   > > root@debian-rockchip-rock5b-rk3588:~# v4l2-compliance -d /dev/video0
>   > > v4l2-compliance 1.27.0-5220, 64 bits, 64-bit time_t
>   > > v4l2-compliance SHA: 8387e3673837 2024-07-01 11:09:32
>   > >
>   > > Compliance test for snps_hdmirx device /dev/video0:
>   > >
>   > > Driver Info:
>   > >     Driver name      : snps_hdmirx
>   > >     Card type        : snps_hdmirx
>   > >     Bus info         : platform:fdee0000.hdmi-receiver
>   > >     Driver version   : 6.10.0
>   > >     Capabilities     : 0x84201000
>   > >         Video Capture Multiplanar
>   > >         Streaming
>   > >         Extended Pix Format
>   > >         Device Capabilities
>   > >     Device Caps      : 0x04201000
>   > >         Video Capture Multiplanar
>   > >         Streaming
>   > >         Extended Pix Format
>   > >
>   > > Required ioctls:
>   > >     test VIDIOC_QUERYCAP: OK
>   > >     test invalid ioctls: OK
>   > >
>   > > Allow for multiple opens:
>   > >     test second /dev/video0 open: OK
>   > >     test VIDIOC_QUERYCAP: OK
>   > >     test VIDIOC_G/S_PRIORITY: OK
>   > >     test for unlimited opens: OK
>   > >
>   > > Debug ioctls:
>   > >     test VIDIOC_DBG_G/S_REGISTER: OK (Not Supported)
>   > >     test VIDIOC_LOG_STATUS: OK
>   > >
>   > > Input ioctls:
>   > >     test VIDIOC_G/S_TUNER/ENUM_FREQ_BANDS: OK (Not Supported)
>   > >     test VIDIOC_G/S_FREQUENCY: OK (Not Supported)
>   > >     test VIDIOC_S_HW_FREQ_SEEK: OK (Not Supported)
>   > >     test VIDIOC_ENUMAUDIO: OK (Not Supported)
>   > >     test VIDIOC_G/S/ENUMINPUT: OK
>   > >     test VIDIOC_G/S_AUDIO: OK (Not Supported)
>   > >     Inputs: 1 Audio Inputs: 0 Tuners: 0
>   > >
>   > > Output ioctls:
>   > >     test VIDIOC_G/S_MODULATOR: OK (Not Supported)
>   > >     test VIDIOC_G/S_FREQUENCY: OK (Not Supported)
>   > >     test VIDIOC_ENUMAUDOUT: OK (Not Supported)
>   > >     test VIDIOC_G/S/ENUMOUTPUT: OK (Not Supported)
>   > >     test VIDIOC_G/S_AUDOUT: OK (Not Supported)
>   > >     Outputs: 0 Audio Outputs: 0 Modulators: 0
>   > >
>   > > Input/Output configuration ioctls:
>   > >     test VIDIOC_ENUM/G/S/QUERY_STD: OK (Not Supported)
>   > >     test VIDIOC_ENUM/G/S/QUERY_DV_TIMINGS: OK
>   > >     test VIDIOC_DV_TIMINGS_CAP: OK
>   > >     test VIDIOC_G/S_EDID: OK
>   > >
>   > > Control ioctls (Input 0):
>   > >     test VIDIOC_QUERY_EXT_CTRL/QUERYMENU: OK
>   > >     test VIDIOC_QUERYCTRL: OK
>   > >     test VIDIOC_G/S_CTRL: OK
>   > >     test VIDIOC_G/S/TRY_EXT_CTRLS: OK
>   > >     test VIDIOC_(UN)SUBSCRIBE_EVENT/DQEVENT: OK
>   > >     test VIDIOC_G/S_JPEGCOMP: OK (Not Supported)
>   > >     Standard Controls: 3 Private Controls: 0
>   > >
>   > > Format ioctls (Input 0):
>   > >     test VIDIOC_ENUM_FMT/FRAMESIZES/FRAMEINTERVALS: OK
>   > >     test VIDIOC_G/S_PARM: OK
>   > >     test VIDIOC_G_FBUF: OK (Not Supported)
>   > >     test VIDIOC_G_FMT: OK
>   > >     test VIDIOC_TRY_FMT: OK
>   > >     test VIDIOC_S_FMT: OK
>   > >     test VIDIOC_G_SLICED_VBI_CAP: OK (Not Supported)
>   > >     test Cropping: OK (Not Supported)
>   > >     test Composing: OK (Not Supported)
>   > >     test Scaling: OK (Not Supported)
>   > >
>   > > Codec ioctls (Input 0):
>   > >     test VIDIOC_(TRY_)ENCODER_CMD: OK (Not Supported)
>   > >     test VIDIOC_G_ENC_INDEX: OK (Not Supported)
>   > >     test VIDIOC_(TRY_)DECODER_CMD: OK (Not Supported)
>   > >
>   > > Buffer ioctls (Input 0):
>   > >     test VIDIOC_REQBUFS/CREATE_BUFS/QUERYBUF: OK
>   > >     test CREATE_BUFS maximum buffers: OK
>   > >     test VIDIOC_REMOVE_BUFS: OK
>   > >     test VIDIOC_EXPBUF: OK
>   > >     test Requests: OK (Not Supported)
>   > >
>   > > Total for snps_hdmirx device /dev/video0: 47, Succeeded: 47, Failed: 0, Warnings: 0
>   > >
>   > > Changes in v4 :-
>   > >    - Remove DTS changes included in the device tree patch
>   > >    - Remove the hdmi rx pin info as it's already present
>   > >      in the rk3588-base-pinctrl.dtsi
>   > >    - Create a separate config option for selecting the EDID
>   > >      and enable it by default
>   > >    - Improve the comment related to DV timings and move it
>   > >      to the side of hdmirx_get_detected_timings
>   > >    - Add 100ms delay before pulling the HPD high
>   > >    - Do not return the detected timings from VIDIOC_G_DV_TIMINGS
>   > >    - Drop the bus info from hdmirx_querycap
>   > >    - If *num_planes != 0 then return 0 in hdmirx_queue_setup
>   > >    - Set queue->min_queued_buffers to 1
>   > >    - Drop q->allow_cache_hints = 0; as it's always 0 by default
>   > >    - Add a comment for q->dma_attrs = DMA_ATTR_FORCE_CONTIGUOUS;
>   > >    - Drop .read = vb2_fop_read as it's not supported by driver
>   > >    - Remove redundant edid_init_data_600M
>   > >    - Make HPD low when driver is loaded
>   > >    - Add support for reading AVI Infoframe
>   > >    - Remove msg_len checks from hdmirx_cec_transmit
>   > >    - Add info about the CEC compliance test in the cover letter
>   > >    - Add arbitration lost status
>   > >    - Validate the physical address inside the EDID
>   > >
>   > > Changes in v3 :-
>   > >    - Use v4l2-common helpers in the HDMIRX driver
>   > >    - Rename cma node and phandle names
>   > >    - Elaborate the comment to explain 160MiB calculation
>   > >    - Move &hdmi_receiver_cma to the rock5b dts file
>   > >    - Add information about interlaced video testing in the
>   > >      cover-letter
>   > >
>   > > Changes in v2 :-
>   > >    - Fix checkpatch --strict warnings
>   > >    - Move the dt-binding include file changes in a separate patch
>   > >    - Add a description for the hardware in the dt-bindings file
>   > >    - Rename resets, vo1 grf and HPD properties
>   > >    - Add a proper description for grf and vo1-grf phandles in the
>   > >      bindings
>   > >    - Rename the HDMI RX node name to hdmi-receiver
>   > >    - Include gpio header file in binding example to fix the
>   > >      dt_binding_check failure
>   > >    - Move hdmirx_cma node to the rk3588.dtsi file
>   > >    - Add an entry to MAINTAINERS file for the HDMIRX driver
>   > >
>   > > Shreeya Patel (4):
>   > >    MAINTAINERS: Add entry for Synopsys DesignWare HDMI RX Driver
>   > >    dt-bindings: media: Document bindings for HDMI RX Controller
>   > >    arm64: dts: rockchip: Add device tree support for HDMI RX Controller
>   > >    media: platform: synopsys: Add support for hdmi input driver
>   > >
>   > >   .../bindings/media/snps,dw-hdmi-rx.yaml       |  132 +
>   > >   MAINTAINERS                                   |    8 +
>   > >   .../dts/rockchip/rk3588-base-pinctrl.dtsi     |   14 +
>   > >   .../arm64/boot/dts/rockchip/rk3588-extra.dtsi |   56 +
>   > >   drivers/media/platform/Kconfig                |    1 +
>   > >   drivers/media/platform/Makefile               |    1 +
>   > >   drivers/media/platform/synopsys/Kconfig       |    3 +
>   > >   drivers/media/platform/synopsys/Makefile      |    2 +
>   > >   .../media/platform/synopsys/hdmirx/Kconfig    |   27 +
>   > >   .../media/platform/synopsys/hdmirx/Makefile   |    4 +
>   > >   .../platform/synopsys/hdmirx/snps_hdmirx.c    | 2763 +++++++++++++++++
>   > >   .../platform/synopsys/hdmirx/snps_hdmirx.h    |  394 +++
>   > >   .../synopsys/hdmirx/snps_hdmirx_cec.c         |  285 ++
>   > >   .../synopsys/hdmirx/snps_hdmirx_cec.h         |   44 +
>   > >   14 files changed, 3734 insertions(+)
>   > >   create mode 100644 Documentation/devicetree/bindings/media/snps,dw-hdmi-rx.yaml
>   > >   create mode 100644 drivers/media/platform/synopsys/Kconfig
>   > >   create mode 100644 drivers/media/platform/synopsys/Makefile
>   > >   create mode 100644 drivers/media/platform/synopsys/hdmirx/Kconfig
>   > >   create mode 100644 drivers/media/platform/synopsys/hdmirx/Makefile
>   > >   create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx.c
>   > >   create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx.h
>   > >   create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx_cec.c
>   > >   create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx_cec.h
>   > >
>   >
Shreeya Patel Aug. 29, 2024, 10:03 a.m. UTC | #10
---- On Thu, 29 Aug 2024 03:43:40 +0530  Tim Surber  wrote --- 
 > Hi Shreeya,
 > 
 > another hint:
 > 
 > Changing the EDID like you described fixed the 4k60fps BGR3 input.
 > 
 > But still for NV16/NV24 (I can't output NV12 for some reason) there is 
 > the error which Nicolas described.
 > 
 > The output from v4l2-ctl for NV16/NV24 is:
 > 
 > Plane 0           :
 >         Bytes per Line : 3840
 >         Size Image     : 8294400
 > 
 > According to Nicolas there should be an additional plane/more memory 
 > reserved.
 > 

Yes, it could be possible that the imagesize is incorrect as we made some
modifications related to it in v4. I'll increase this as required by the NV12/24
and see if that fixes the issue.


Thanks,
Shreeya Patel

 > This leads to errors when trying to read the device using for example 
 > gstreamer:
 > 
 >   gst_memory_resize: assertion 'size + mem->offset + offset <= 
 > mem->maxsize' failed
 > 
 > 
 > This seems to always happen using the  NV16/NV24 formats regardless of 
 > resolution/fps.
 > 
 > 
 > Best regards,
 > 
 > Tim
 > 
 > On 14.08.24 12:22, Shreeya Patel wrote:
 > >   ---- On Sun, 04 Aug 2024 05:27:08 +0530  Tim Surber  wrote ---
 > >   > Hi Shreeya,
 > >   >
 > >
 > > Hi Tim,
 > >
 > >
 > >   > I tested your patch and noticed problems when using 3840x2160 resolution
 > >   > at  60fps.
 > >   >
 > >   > For my testing I connected an HDMI source and set it to 4k60fps. I
 > >   > verified that this source and the cables work on a screen at this
 > >   > resolution.
 > >   >
 > >   > Using
 > >   > 'v4l2-ctl --verbose -d /dev/video1
 > >   > --set-fmt-video=width=3840,height=2160,pixelformat='NV12'
 > >   > --stream-mmap=4 --stream-skip=3 --stream-count=100 --stream-poll'
 > >   > I get the video format output, but not the periodic output which shows
 > >   > the fps.
 > >   >
 > >   > Using
 > >   > 'GST_DEBUG=4 gst-launch-1.0 -v v4l2src device=/dev/video1 !
 > >   > fpsdisplaysink text-overlay=false video-sink="fakevideosink"'
 > >   > I get the following error message:
 > >   >
 > >   > (gst-launch-1.0:3231): GStreamer-CRITICAL **: 01:34:39.137:
 > >   > gst_memory_resize: assertion 'size + mem->offset + offset <=
 > >   > mem->maxsize' failed
 > >   > 0:00:03.489382529  3231 0xffffa0000b90 WARN  v4l2bufferpool
 > >   > gstv4l2bufferpool.c:2209:gst_v4l2_buffer_pool_process:
 > >   > Dropping truncated buffer, this is likely a driver bug.
 > >   > 0:00:03.489421906  3231 0xffffa0000b90 WARN  bufferpool
 > >   > gstbufferpool.c:1252:default_reset_buffer: Buffer
 > >   > 0xffff98008e80 without the memory tag has maxsize (8294400) that is
 > >   > smaller than the configured buffer pool size (12441600). The buffer will
 > >   > be not be reused. This is most likely a bug in this GstBufferPool subclass
 > >   >
 > >   >
 > >   > Everything works with 4k30fps or 1080p 60fps. The hardware should
 > >   > support 4k60fps.
 > >   >
 > >
 > >
 > > Sorry for the delayed response, I've been trying to reproduce this on my side
 > > and to also fix it.
 > >
 > > It seems you are right, 4K@60 fps doesn't work with the latest version of HDMIRX.
 > > We found out that it could be because of the current EDID which shows some failures.
 > >
 > > Though I wasn't able to test the following on my side since my device doesn't support
 > > 4K, one of my colleague tried to replace the EDID and 4K@60 fps worked fine after that.
 > >
 > > If you'd like to try it yourself then following is the command to get the new EDID
 > >
 > > v4l2-ctl --show-edid type=hdmi-4k-600mhz
 > >
 > > You will have to replace the EDID in the driver with the EDID you get the from the above
 > > command in HEX format.
 > >
 > > Thanks for reporting this, I will soon send v5 with this change included in it.
 > >
 > >
 > > Thanks,
 > > Shreeya Patel
 > >
 > >
 > >   > Best regards,
 > >   > Tim
 > >   >
 > >   > On 19.07.24 14:40, Shreeya Patel wrote:
 > >   > > This series implements support for the Synopsys DesignWare
 > >   > > HDMI RX Controller, being compliant with standard HDMI 1.4b
 > >   > > and HDMI 2.0.
 > >   > >
 > >   > > Features that are currently supported by the HDMI RX driver
 > >   > > have been tested on rock5b board using a HDMI to micro-HDMI cable.
 > >   > > It is recommended to use a good quality cable as there were
 > >   > > multiple issues seen during testing the driver.
 > >   > >
 > >   > > Please note the below information :-
 > >   > > * While testing the driver on rock5b we noticed that the binary BL31
 > >   > > from Rockchip contains some unknown code to get the HDMI-RX PHY
 > >   > > access working without any errors.
 > >   > > With TF-A BL31, the HDMI-RX PHY also works fine but there were no
 > >   > > interrupts seen for rk_hdmirx-hdmi leading to some errors when
 > >   > > loading the driver [0]. It doesn't affect the functionality of the
 > >   > > driver though.
 > >   > > * We have tested the working of OBS studio with HDMIRX driver and
 > >   > > there were no issues seen.
 > >   > > * We also tested and verified the support for interlaced video.
 > >   > >
 > >   > > [0] https://gitlab.collabora.com/hardware-enablement/rockchip-3588/trusted-firmware-a/-/issues/1
 > >   > >
 > >   > > To test the HDMI RX Controller driver, following example commands can be used :-
 > >   > >
 > >   > > root@debian-rockchip-rock5b-rk3588:~# v4l2-ctl --verbose -d /dev/video0 \
 > >   > > --set-fmt-video=width=1920,height=1080,pixelformat='BGR3' --stream-mmap=4 \
 > >   > > --stream-skip=3 --stream-count=100 --stream-to=/home/hdmiin4k.raw --stream-poll
 > >   > >
 > >   > > root@debian-rockchip-rock5b-rk3588:~# ffmpeg -f rawvideo -vcodec rawvideo \
 > >   > > -s 1920x1080 -r 60 -pix_fmt bgr24 -i /home/hdmiin4k.raw output.mkv
 > >   > >
 > >   > > CEC compliance test results :-
 > >   > >
 > >   > > * https://gitlab.collabora.com/-/snippets/381
 > >   > > * https://gitlab.collabora.com/-/snippets/380
 > >   > >
 > >   > > Following is the v4l2-compliance test result :-
 > >   > >
 > >   > > root@debian-rockchip-rock5b-rk3588:~# v4l2-compliance -d /dev/video0
 > >   > > v4l2-compliance 1.27.0-5220, 64 bits, 64-bit time_t
 > >   > > v4l2-compliance SHA: 8387e3673837 2024-07-01 11:09:32
 > >   > >
 > >   > > Compliance test for snps_hdmirx device /dev/video0:
 > >   > >
 > >   > > Driver Info:
 > >   > >     Driver name      : snps_hdmirx
 > >   > >     Card type        : snps_hdmirx
 > >   > >     Bus info         : platform:fdee0000.hdmi-receiver
 > >   > >     Driver version   : 6.10.0
 > >   > >     Capabilities     : 0x84201000
 > >   > >         Video Capture Multiplanar
 > >   > >         Streaming
 > >   > >         Extended Pix Format
 > >   > >         Device Capabilities
 > >   > >     Device Caps      : 0x04201000
 > >   > >         Video Capture Multiplanar
 > >   > >         Streaming
 > >   > >         Extended Pix Format
 > >   > >
 > >   > > Required ioctls:
 > >   > >     test VIDIOC_QUERYCAP: OK
 > >   > >     test invalid ioctls: OK
 > >   > >
 > >   > > Allow for multiple opens:
 > >   > >     test second /dev/video0 open: OK
 > >   > >     test VIDIOC_QUERYCAP: OK
 > >   > >     test VIDIOC_G/S_PRIORITY: OK
 > >   > >     test for unlimited opens: OK
 > >   > >
 > >   > > Debug ioctls:
 > >   > >     test VIDIOC_DBG_G/S_REGISTER: OK (Not Supported)
 > >   > >     test VIDIOC_LOG_STATUS: OK
 > >   > >
 > >   > > Input ioctls:
 > >   > >     test VIDIOC_G/S_TUNER/ENUM_FREQ_BANDS: OK (Not Supported)
 > >   > >     test VIDIOC_G/S_FREQUENCY: OK (Not Supported)
 > >   > >     test VIDIOC_S_HW_FREQ_SEEK: OK (Not Supported)
 > >   > >     test VIDIOC_ENUMAUDIO: OK (Not Supported)
 > >   > >     test VIDIOC_G/S/ENUMINPUT: OK
 > >   > >     test VIDIOC_G/S_AUDIO: OK (Not Supported)
 > >   > >     Inputs: 1 Audio Inputs: 0 Tuners: 0
 > >   > >
 > >   > > Output ioctls:
 > >   > >     test VIDIOC_G/S_MODULATOR: OK (Not Supported)
 > >   > >     test VIDIOC_G/S_FREQUENCY: OK (Not Supported)
 > >   > >     test VIDIOC_ENUMAUDOUT: OK (Not Supported)
 > >   > >     test VIDIOC_G/S/ENUMOUTPUT: OK (Not Supported)
 > >   > >     test VIDIOC_G/S_AUDOUT: OK (Not Supported)
 > >   > >     Outputs: 0 Audio Outputs: 0 Modulators: 0
 > >   > >
 > >   > > Input/Output configuration ioctls:
 > >   > >     test VIDIOC_ENUM/G/S/QUERY_STD: OK (Not Supported)
 > >   > >     test VIDIOC_ENUM/G/S/QUERY_DV_TIMINGS: OK
 > >   > >     test VIDIOC_DV_TIMINGS_CAP: OK
 > >   > >     test VIDIOC_G/S_EDID: OK
 > >   > >
 > >   > > Control ioctls (Input 0):
 > >   > >     test VIDIOC_QUERY_EXT_CTRL/QUERYMENU: OK
 > >   > >     test VIDIOC_QUERYCTRL: OK
 > >   > >     test VIDIOC_G/S_CTRL: OK
 > >   > >     test VIDIOC_G/S/TRY_EXT_CTRLS: OK
 > >   > >     test VIDIOC_(UN)SUBSCRIBE_EVENT/DQEVENT: OK
 > >   > >     test VIDIOC_G/S_JPEGCOMP: OK (Not Supported)
 > >   > >     Standard Controls: 3 Private Controls: 0
 > >   > >
 > >   > > Format ioctls (Input 0):
 > >   > >     test VIDIOC_ENUM_FMT/FRAMESIZES/FRAMEINTERVALS: OK
 > >   > >     test VIDIOC_G/S_PARM: OK
 > >   > >     test VIDIOC_G_FBUF: OK (Not Supported)
 > >   > >     test VIDIOC_G_FMT: OK
 > >   > >     test VIDIOC_TRY_FMT: OK
 > >   > >     test VIDIOC_S_FMT: OK
 > >   > >     test VIDIOC_G_SLICED_VBI_CAP: OK (Not Supported)
 > >   > >     test Cropping: OK (Not Supported)
 > >   > >     test Composing: OK (Not Supported)
 > >   > >     test Scaling: OK (Not Supported)
 > >   > >
 > >   > > Codec ioctls (Input 0):
 > >   > >     test VIDIOC_(TRY_)ENCODER_CMD: OK (Not Supported)
 > >   > >     test VIDIOC_G_ENC_INDEX: OK (Not Supported)
 > >   > >     test VIDIOC_(TRY_)DECODER_CMD: OK (Not Supported)
 > >   > >
 > >   > > Buffer ioctls (Input 0):
 > >   > >     test VIDIOC_REQBUFS/CREATE_BUFS/QUERYBUF: OK
 > >   > >     test CREATE_BUFS maximum buffers: OK
 > >   > >     test VIDIOC_REMOVE_BUFS: OK
 > >   > >     test VIDIOC_EXPBUF: OK
 > >   > >     test Requests: OK (Not Supported)
 > >   > >
 > >   > > Total for snps_hdmirx device /dev/video0: 47, Succeeded: 47, Failed: 0, Warnings: 0
 > >   > >
 > >   > > Changes in v4 :-
 > >   > >    - Remove DTS changes included in the device tree patch
 > >   > >    - Remove the hdmi rx pin info as it's already present
 > >   > >      in the rk3588-base-pinctrl.dtsi
 > >   > >    - Create a separate config option for selecting the EDID
 > >   > >      and enable it by default
 > >   > >    - Improve the comment related to DV timings and move it
 > >   > >      to the side of hdmirx_get_detected_timings
 > >   > >    - Add 100ms delay before pulling the HPD high
 > >   > >    - Do not return the detected timings from VIDIOC_G_DV_TIMINGS
 > >   > >    - Drop the bus info from hdmirx_querycap
 > >   > >    - If *num_planes != 0 then return 0 in hdmirx_queue_setup
 > >   > >    - Set queue->min_queued_buffers to 1
 > >   > >    - Drop q->allow_cache_hints = 0; as it's always 0 by default
 > >   > >    - Add a comment for q->dma_attrs = DMA_ATTR_FORCE_CONTIGUOUS;
 > >   > >    - Drop .read = vb2_fop_read as it's not supported by driver
 > >   > >    - Remove redundant edid_init_data_600M
 > >   > >    - Make HPD low when driver is loaded
 > >   > >    - Add support for reading AVI Infoframe
 > >   > >    - Remove msg_len checks from hdmirx_cec_transmit
 > >   > >    - Add info about the CEC compliance test in the cover letter
 > >   > >    - Add arbitration lost status
 > >   > >    - Validate the physical address inside the EDID
 > >   > >
 > >   > > Changes in v3 :-
 > >   > >    - Use v4l2-common helpers in the HDMIRX driver
 > >   > >    - Rename cma node and phandle names
 > >   > >    - Elaborate the comment to explain 160MiB calculation
 > >   > >    - Move &hdmi_receiver_cma to the rock5b dts file
 > >   > >    - Add information about interlaced video testing in the
 > >   > >      cover-letter
 > >   > >
 > >   > > Changes in v2 :-
 > >   > >    - Fix checkpatch --strict warnings
 > >   > >    - Move the dt-binding include file changes in a separate patch
 > >   > >    - Add a description for the hardware in the dt-bindings file
 > >   > >    - Rename resets, vo1 grf and HPD properties
 > >   > >    - Add a proper description for grf and vo1-grf phandles in the
 > >   > >      bindings
 > >   > >    - Rename the HDMI RX node name to hdmi-receiver
 > >   > >    - Include gpio header file in binding example to fix the
 > >   > >      dt_binding_check failure
 > >   > >    - Move hdmirx_cma node to the rk3588.dtsi file
 > >   > >    - Add an entry to MAINTAINERS file for the HDMIRX driver
 > >   > >
 > >   > > Shreeya Patel (4):
 > >   > >    MAINTAINERS: Add entry for Synopsys DesignWare HDMI RX Driver
 > >   > >    dt-bindings: media: Document bindings for HDMI RX Controller
 > >   > >    arm64: dts: rockchip: Add device tree support for HDMI RX Controller
 > >   > >    media: platform: synopsys: Add support for hdmi input driver
 > >   > >
 > >   > >   .../bindings/media/snps,dw-hdmi-rx.yaml       |  132 +
 > >   > >   MAINTAINERS                                   |    8 +
 > >   > >   .../dts/rockchip/rk3588-base-pinctrl.dtsi     |   14 +
 > >   > >   .../arm64/boot/dts/rockchip/rk3588-extra.dtsi |   56 +
 > >   > >   drivers/media/platform/Kconfig                |    1 +
 > >   > >   drivers/media/platform/Makefile               |    1 +
 > >   > >   drivers/media/platform/synopsys/Kconfig       |    3 +
 > >   > >   drivers/media/platform/synopsys/Makefile      |    2 +
 > >   > >   .../media/platform/synopsys/hdmirx/Kconfig    |   27 +
 > >   > >   .../media/platform/synopsys/hdmirx/Makefile   |    4 +
 > >   > >   .../platform/synopsys/hdmirx/snps_hdmirx.c    | 2763 +++++++++++++++++
 > >   > >   .../platform/synopsys/hdmirx/snps_hdmirx.h    |  394 +++
 > >   > >   .../synopsys/hdmirx/snps_hdmirx_cec.c         |  285 ++
 > >   > >   .../synopsys/hdmirx/snps_hdmirx_cec.h         |   44 +
 > >   > >   14 files changed, 3734 insertions(+)
 > >   > >   create mode 100644 Documentation/devicetree/bindings/media/snps,dw-hdmi-rx.yaml
 > >   > >   create mode 100644 drivers/media/platform/synopsys/Kconfig
 > >   > >   create mode 100644 drivers/media/platform/synopsys/Makefile
 > >   > >   create mode 100644 drivers/media/platform/synopsys/hdmirx/Kconfig
 > >   > >   create mode 100644 drivers/media/platform/synopsys/hdmirx/Makefile
 > >   > >   create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx.c
 > >   > >   create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx.h
 > >   > >   create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx_cec.c
 > >   > >   create mode 100644 drivers/media/platform/synopsys/hdmirx/snps_hdmirx_cec.h
 > >   > >
 > >   >
 >
Nicolas Dufresne Sept. 6, 2024, 8:02 p.m. UTC | #11
Hi Shreya,

Le jeudi 29 août 2024 à 15:33 +0530, Shreeya Patel a écrit :
>  ---- On Thu, 29 Aug 2024 03:43:40 +0530  Tim Surber  wrote --- 
>  > Hi Shreeya,
>  > 
>  > another hint:
>  > 
>  > Changing the EDID like you described fixed the 4k60fps BGR3 input.
>  > 
>  > But still for NV16/NV24 (I can't output NV12 for some reason) there is 
>  > the error which Nicolas described.
>  > 
>  > The output from v4l2-ctl for NV16/NV24 is:
>  > 
>  > Plane 0           :
>  >         Bytes per Line : 3840
>  >         Size Image     : 8294400
>  > 
>  > According to Nicolas there should be an additional plane/more memory 
>  > reserved.
>  > 
> 
> Yes, it could be possible that the imagesize is incorrect as we made some
> modifications related to it in v4. I'll increase this as required by the NV12/24
> and see if that fixes the issue.


Sorry for the slow feedback, just noticed this message. Please make sure to us
v4l2-common, these exists exactly because no one can get strides and image size
right on first go.

Nicolas