Image processing device and image processing method

Patent metadata

Field	Value
Publication number	US-11718229-B2
Application number	US-202017076531-A
Country	US
Kind code	B2
Filing date	Oct 21, 2020
Priority date	Nov 19, 2019
Publication date	Aug 8, 2023
Grant date	Aug 8, 2023

Abstract

The image processing device acquires feature quantities (maximum value, minimum value, average value, histogram, etc.) of the entire area (GA) of the image and feature quantities of each local area (LA) of the image from the input image, and calculates a plurality of modulation gain values (gamma correction curves) for GA and each LA. Furthermore, the image processing device determines the correction intensity for each LA from the feature quantity of the GA and the feature quantity of each LA, and creates the LA correction intensity map. Finally, the image processing device finally applies the result of combining a plurality of modulation gain values based on the LA correction intensity map to the input image.

First claim

What is claimed is:

1. An image processing device that generates a video output signal and a backlight control signal from a video input signal and outputs the generated video output signal and the generated backlight control signal to a display device, the image processing device comprising:
a CPU; and
a memory storing instructions that, when executed by the CPU, cause the CPU to function as:
a feature data calculating unit for obtaining an entire area of a video from the video input signal and a divided area obtained by dividing the entire area into a plurality of areas, and calculating a first feature data indicating characteristics of the entire area and a second feature data group indicating features of each divided area;
a correction data calculating unit for calculating correction data for correcting video data for each divided area from the first feature data and the second feature data group;
a correction processing unit for performing image correction of the entire area based on the correction data;
a correction intensity unit for setting a first correction intensity for each divided area from the first feature data and the second feature data group;
a detection unit for detecting an object included in the video from the video input signal, and outputting object information including position information of the detected object; and
a discriminating unit for determining a driving scene from driving information of a vehicle onto which the image processing device is mounted and outputting the driving information,

wherein the correction intensity unit sets a second correction intensity based on the object information,
wherein the correction intensity unit sets a third correction intensity based on the driving information, and
wherein the correction data calculating unit adjusts the correction data based on the first correction intensity, the second correction intensity, and the third correction intensity.

2. The image processing device according to claim 1 , wherein the first feature data and the second feature data group include at least one of a maximum value, a minimum value, an average value, and a histogram of a brightness value.

3. The image processing device according to claim 1 , wherein the first correction intensity, the second correction intensity, and the third correction intensity are data in a map format in which the correction intensity for each divided area is set.

4. The image processing device according to claim 1 , wherein the driving information is any one or combined information of a vehicle speed of the vehicle and a traveling direction of the vehicle.

5. An image processing method for generating a video output signal and a backlight control signal from a video input signal and outputting to a display device, the image processing method comprising:
a feature data calculating step of obtaining an entire area of video from the video input signal and a divided area obtained by dividing the entire area into a plurality of areas, and calculating first feature data indicating features of the entire area, and a second feature data group indicating features of each divided area;
a correction data calculating step of calculating correction data for correcting video data for each divided area from the first feature data and the second feature data group;
a correction processing step of performing video correction of the entire area based on the correction data;
a correction intensity setting step of setting a first correction intensity for each divided area from the first feature data and the second feature data group;
a detection step of detecting an object included in the video from the video input signal, and outputting object information including position information of the detected object; and
a determination step of determining a driving scene from driving information of a vehicle and outputting the driving information,
wherein the correction intensity setting step sets a second correction intensity based on the object information,
wherein the correction intensity setting step sets a third correction intensity based on the driving information, and
wherein the correction data calculating step adjusts the correction data based on the first correction intensity, the second correction intensity, and the third correction intensity.

Assignees

• Renesas Electronics Corp

Inventors

• Kimura Mitsuhiro
• Takahashi Akihide

Classifications

• G09G3/3406 Primary

  Control of illumination source (illumination devices structurally associated with liquid crystal cells G02F1/1336) · CPC title

• B60R1/00 Primary

  Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles · CPC title

• G06V10/50

  by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis · CPC title

• G06V10/56

  relating to colour · CPC title

• G06V10/60

  relating to illumination properties, e.g. using a reflectance or lighting model · CPC title