Image signal processing driving method, control module, processing module and medium

Patent metadata

Field	Value
Publication number	US-12452528-B2
Application number	US-202218284500-A
Country	US
Kind code	B2
Filing date	Nov 24, 2022
Priority date	Nov 24, 2022
Publication date	Oct 21, 2025
Grant date	Oct 21, 2025

Abstract

Provided are image signal processing driving method, control module, processing module and medium, being applied to an image signal processing module including a plurality of ISP cores or an ISP core supporting time division multiplexing. The image signal processing module is equipped with driver architecture. The method includes: receiving, by the interface layer, image signal processing (ISP) instruction sent by upper application, wherein the ISP instruction carries initial control parameters and image size parameters; determining, by the connection layer, processing mode of image signals according to the image size parameters, and determining target control parameters according to the initial control parameters for different processing modes, wherein the processing modes include single-core mode or multi-core mode; and sending, by the driver layer, the target control parameters to target ISP core, so as to drive the target ISP core to perform image signal processing according to the target control parameters.

First claim

What is claimed is:

1. An image signal processing driving method, applicable to an image signal processing module comprising a plurality of ISP cores or an ISP core supporting time division multiplexing, wherein the image signal processing module is equipped with a driver architecture, the driver architecture comprises an interface layer, a connection layer and a driver layer, and the driver layer is connected to the ISP cores or the ISP core; the method comprising:
receiving, by the interface layer, an image signal processing (ISP) instruction sent by an upper application, wherein the ISP instruction carries initial control parameters and image size parameters;
determining, by the connection layer, a processing mode of image signals according to the image size parameters, and determining target control parameters according to the initial control parameters for different processing modes, wherein the processing mode comprises a single-core mode or a multi-core mode; and
sending, by the driver layer, the target control parameters to a target ISP core, so as to drive the target ISP core to perform image signal processing according to the target control parameters.

2. The method according to claim 1 , wherein the processing mode is the multi-core mode, and wherein the determining target control parameters according to the initial control parameters comprises:
constructing a plurality of control parameters as the target control parameters according to the initial control parameters.

3. The method according to claim 2 , wherein the ISP instruction comprises a called target function, and the constructing a plurality of control parameters as the target control parameters according to the initial control parameters comprises:
calling a member function pointed by a function pointer bound to the multi-core mode to construct the initial control parameters into the plurality of control parameters as the target control parameters, wherein the member function corresponds to the target function.

4. The method according to claim 3 , wherein the target function comprises one or more of a functional module opening function, a functional module closing function and a driver interface function.

5. The method according to claim 2 , wherein the ISP instruction indicates a target image processing function to be implemented; the target control parameters comprise control parameters of size type, the control parameters of size type comprise one or more of image width, parameters related to image width, image height, and parameters related to image height; the target ISP core performs image signal processing to implement the target image processing function; and the constructing a plurality of control parameters as the target control parameters according to the initial control parameters comprises:
if the target image processing function is a preset function, constructing a plurality of different control parameters as the target control parameters, wherein the preset function is implemented by performing image signal processing in the target ISP core according to the control parameters of size type; and
if the target image processing function is not the preset function, constructing a plurality of same control parameters as the target control parameters.

6. The method according to claim 5 , wherein the constructing a plurality of different control parameters as the target control parameters comprises:
calculating according to a preset image position to obtain a plurality of different control parameters as the target control parameters.

7. The method according to claim 1 , wherein in the multi-core mode, the method further comprises:
in response to having received all interrupt signals of the image signal processing corresponding to the target ISP core, synchronizing, merging and sending, by the connection layer, the all interrupt signals to the interface layer.

8. The method according to claim 7 , wherein the method further comprises:
after receiving interrupt signals corresponding to the target ISP core, storing the interrupt signals in a corresponding queue; and
the in response to having received all interrupt signals of the image signal processing corresponding to the target ISP core, synchronizing, merging and sending the all interrupt signals to the interface layer comprises:
when the interrupt signals are stored in all queues, reading the interrupt signals in each queue, then synchronizing, merging and sending to the interface layer.

9. The method according to claim 8 , wherein
if a plurality of target ISP cores are provided, the all interrupt signals comprise interrupt signals corresponding to all the target ISP cores, and the corresponding queue is a queue corresponding to a target ISP core sending the interrupt signals; and
if the target ISP core supports time division multiplexing, the all interrupt signals comprise interrupt signals sent by the target ISP core in all multiplexing time periods, and the corresponding queue is a queue corresponding to a multiplexing time period where the interrupt signals are sent.

10. The method according to claim 8 , wherein the interrupt signals comprise a plurality of types, and the storing the interrupt signals in a corresponding queue comprises:
according to a target type to which the interrupt signals belong, storing the interrupt signals in a target position corresponding to the target type in the queue; and
all the queues storing the interrupt signals comprises that:
the interrupt signals are stored in target positions of all the queues.

11. The method according to claim 1 , wherein the processing mode is the single-core mode, and wherein the determining target control parameters according to the initial control parameters comprises:
determining the initial control parameters to be the target control parameters.

12. An image processing control module, wherein the image processing control module is configured for being connected to a plurality of ISP cores or an ISP core supporting time division multiplexing, and the image processing control module is configured for implementing the steps of the method according to claim 1 .

13. An image signal processing module, comprising the image processing control module according to claim 12 , and a plurality of ISP cores or an ISP core supporting time division multiplexing, wherein the image processing control module is connected to the plurality of ISP cores or the ISP core supporting time division multiplexing.

14. The image signal processing module according to claim 13 , wherein the image signal processing module is an IP core, a chip or an electronic device configured for image signal processing.

15. The method according to claim 3 , wherein the ISP instruction indicates a target image processing function to be implemented; the target control parameters comprise control parameters of size type, the control parameters of size type comprise one or more of image width, parameters related to image width, image height, and parameters related to image height; the target ISP core performs image signal processing to implement the target image processing function; and the constructing a plurality of control parameters as the target control parameters according to the initial control parameters comprises:
if the target image processing function is a preset function, constructing a plurality of different control parameters as the target control parameters, wherein the preset function is implemented by performing image signal processing in the target ISP core according to the control parameters of size type; and
if the target image processin

Assignees

• Verisilicon Microelectronics Shanghai Co Ltd
• Verisilicon Microelectronics Chengdu Co Ltd
• Verisilicon Microelectronics Nanjing Co Ltd

Inventors

• Fu Yinsheng
• Zhong Xia
• Tang Xianfeng
• Liang Chao
• Men Hongling

Classifications

• G06T1/60

  Memory management · CPC title

• H04N1/387

  Composing, repositioning or otherwise {geometrically} modifying originals · CPC title

• H04N23/73

  by influencing the exposure time · CPC title

• H04N23/64 Primary

  Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image · CPC title

• G06T1/20 Primary

  Processor architectures; Processor configuration, e.g. pipelining · CPC title