Image processing device, image processing method, and program

Patent metadata

Field	Value
Publication number	US-2016371823-A1
Application number	US-201615181922-A
Country	US
Kind code	A1
Filing date	Jun 14, 2016
Priority date	Jun 16, 2015
Publication date	Dec 22, 2016
Grant date	—

Abstract

An image processing device includes an input unit, a generation unit, a gain processing unit, a development processing unit, and a composition unit. The input unit receives input of a plurality of images having different exposures from one another. The generation unit generates gain information according to each of the plurality of images input through the input unit. The gain processing unit applies gain processing to each of the plurality of images based on the gain information generated by the generation unit. The development processing unit applies development processing to each of the plurality of images to which the gain processing has been applied by the gain processing unit. The composition unit composites the plurality of images to which the development processing has been applied by the development processing unit.

First claim

What is claimed is:

1 . An image processing device comprising:
an input unit configured to receive input of a plurality of images having different exposures from one another; a generation unit configured to generate gain information according to each of the plurality of images input through the input unit; a gain processing unit configured to apply gain processing to each of the plurality of images based on the gain information generated by the generation unit; a development processing unit configured to apply development processing to each of the plurality of images to which the gain processing has been applied by the gain processing unit; and a composition unit configured to composite the plurality of images to which the development processing has been applied by the development processing unit.

2 . The image processing device according to claim 1 , further comprising a position alignment unit configured to align positions among the plurality of images to which the development processing has been applied by the development processing unit,
wherein the composition unit composites the plurality of images for which the position alignment has been completed by the position alignment unit.

3 . The image processing device according to claim 2 , wherein the position alignment unit corrects distortion aberration in the plurality of images to which the development processing has been applied by the development processing unit and, thereafter, aligns positions among the plurality of images.

4 . The image processing device according to claim 3 , wherein the position alignment unit determines whether to correct the distortion aberration in the plurality of images based on lens information and, when determining to correct the distortion aberration, corrects the distortion aberration in the plurality of images.

5 . The image processing device according to claim 1 , wherein the generation unit generates the gain information according to one image among the plurality of images and generates the gain information according to the rest of the plurality of images based on the generated gain information.

6 . The image processing device according to claim 5 , wherein the generation unit generates the gain information according to one image among the plurality of images using images having different resolutions or different frequency bands.

7 . The image processing device according to claim 5 , wherein, when generating the gain information according to the rest of the plurality of images, the generation unit generates the gain information in which positions are adjusted among the plurality of images.

8 . The image processing device according to claim 7 , wherein, when generating the gain information according to the rest of the plurality of images, the generation unit corrects the distortion aberration in the gain information according to the one image, then carries out projective transformation of that gain information, and thereafter adds the corrected distortion aberration to that gain information, to generate the gain information in which positions are adjusted among the plurality of images.

9 . The image processing device according to claim 8 , wherein the generation unit determines whether to correct the distortion aberration in the gain information based on lens information and, when determining to correct the distortion aberration, corrects the distortion aberration in the gain information according to the one image.

10 . The image processing device according to claim 5 , wherein the one image is an image having a minimum exposure.

11 . The image processing device according to claim 1 , wherein the composition unit calculates a composition ratio for the plurality of images based on the gain information according to one image among the plurality of images and carries out the composition based on the calculated composition ratio.

12 . The image processing device according to claim 1 , wherein the development processing includes noise reduction processing and edge enhancement processing.

13 . The image processing device according to claim 1 , wherein the gain information is information indicating relationships between respective coordinates and respective gains within the image.

14 . An image processing method for an image processing device, the image processing method comprising:
receiving input of a plurality of images having different exposures from one another; generating gain information according to each of the input plurality of images; applying gain processing to each of the plurality of images based on the generated gain information; applying development processing to each of the plurality of images to which the gain processing has been of images applied; and compositing the plurality of images to which the development processing has been applied.

15 . A non-transitory computer readable storage medium storing a program that causes a computer to perform an image processing method for an image processing device, the image processing method comprising:
receiving input of a plurality of images having different exposures from one another; generating gain information according to each of the input plurality of images; applying gain processing to each of the plurality of images based on the generated gain information; applying development processing to each of the plurality of images to which the gain processing has been applied; and compositing the plurality of images to which the development processing has been applied.

Assignees

• Canon Kk

Inventors

• Kimura Naoto

Classifications

• G06T2207/20221

  Image fusion; Image merging · CPC title

• G06T2207/10144

  Varying exposure · CPC title

• G06T2207/20208

  High dynamic range [HDR] image processing · CPC title

• G06T5/50 Primary

  using two or more images, e.g. averaging or subtraction · CPC title

• G06T2207/10016

  Video; Image sequence · CPC title