Image device with image defocus function and method generating a defocus image thereof

Patent metadata

Field	Value
Publication number	US-10165247-B2
Application number	US-201615155084-A
Country	US
Kind code	B2
Filing date	May 16, 2016
Priority date	Mar 2, 2016
Publication date	Dec 25, 2018
Grant date	Dec 25, 2018

Abstract

An image device with image defocus function includes an image capture unit, a depth map generation unit, and a processor. The image capture unit captures an image corresponding to an object. The depth map generation unit generates a depth map corresponding to the object. The processor determines an integration block corresponding to each pixel image of the image according to a depth of the depth map corresponding to the each pixel image and a predetermined depth corresponding to the each pixel image, utilizes the integration block to generate a defocus color pixel value corresponding to the each pixel image, and outputs a defocus image corresponding to the image according to defocus color pixel values corresponding to all pixel images of the image, wherein the each pixel image of the image corresponds to a pixel of the image capture unit.

First claim

What is claimed is:

1. An image device with image defocus function, comprising:
an image capture unit capturing an image corresponding to an object;
a depth map generation unit generating a depth map corresponding to the object;
a processor coupled to the image capture unit and the depth map generation unit for determining an integration block corresponding to each pixel image of the image according to a practical depth of the depth map corresponding to the each pixel image and a variable depth corresponding to the each pixel image, utilizing the integration block to determine an integral image corresponding to the integration block, utilizing the integral image and an area corresponding to the integration block to generate a defocus color pixel value corresponding to the each pixel image, and outputting a defocus image corresponding to the image according to defocus color pixel values corresponding to all pixel images of the image;
wherein the each pixel image of the image corresponds to a pixel of the image capture unit.

2. The image device of claim 1 , wherein the processor generates a defocus index corresponding to the each pixel image according to the practical depth corresponding to the each pixel image and the variable depth corresponding to the each pixel image, and determines the integration block corresponding to the each pixel image according to a coordinate of the each pixel image and the defocus index corresponding to the each pixel image.

3. The image device of claim 2 , wherein the processor generates the defocus index corresponding to the each pixel image according to the following equation:
DI= a×|d−df|;
wherein:
DI is the defocus index corresponding to the each pixel image;
a is a coefficient which makes the defocus index greater than 0;
d is the practical depth corresponding to the each pixel image; and
df is the variable depth corresponding to the each pixel image, wherein the variable depth is changed with a predetermined object within the depth map.

4. The image device of claim 2 , wherein the processor generates the defocus index corresponding to the each pixel image according to the following equation:
DI=Σ a n ×|d−df| n ;

wherein:
DI is the defocus index corresponding to the each pixel image;
a n is a coefficient of an n th order polynomial which makes the defocus index greater than 0;
d is the practical depth corresponding to the each pixel image; and
df is the variable depth corresponding to the each pixel image, wherein the variable depth is changed with a predetermined object within the depth map.

5. A method of an image device generating a defocus image, wherein the image device comprises an image capture unit, a depth map generation unit, and a processor, the method comprising:
the image capture unit capturing an image corresponding to an object;
the depth map generation unit generating a depth map corresponding to the object;
the processor determining an integration block corresponding to each pixel image of the image according to a depth corresponding to the each pixel image and a predetermined depth corresponding to the each pixel image, wherein the each pixel image of the image corresponds to a pixel of the image capture unit;
the processor utilizing the integration block to determine an integral image corresponding to the integration block;
the processor utilizing the integral image and an area corresponding to the integration block to generate a defocus color pixel value corresponding to the each pixel image; and
the processor outputting a defocus image corresponding to the image according to defocus color pixel values corresponding to all pixel images of the image.

6. The method of claim 5 , wherein the processor determining the integration block corresponding to the each pixel image comprises:
the processor generating a defocus index corresponding to the each pixel image according to the practical depth corresponding to the each pixel image and the variable depth corresponding to the each pixel image; and
the processor determining the integration block corresponding to the each pixel image according to a coordinate of the each pixel image and the defocus index corresponding to the each pixel image.

7. The method of claim 6 , wherein the processor generates the defocus index corresponding to the each pixel image according to the following equation:
DI= a×|d−df|;
wherein:
DI is the defocus index corresponding to the each pixel image;
a is a coefficient which makes the defocus index greater than 0;
d is the practical depth corresponding to the each pixel image; and
df is variable depth corresponding to the each pixel image wherein the variable depth is changed with a predetermined object within the depth map.

8. The method of claim 6 , wherein the processor generates the defocus index corresponding to the each pixel image according to the following equation:
DI=Σ a n ×|d−df| n ;

wherein:
DI is the defocus index corresponding to the each pixel image;
a n is a coefficient of an n th order polynomial which makes the defocus index greater than 0;
d is the practical depth corresponding to the each pixel image; and
df is the variable depth corresponding to the each pixel image, wherein the variable depth is changed with a predetermined object within the depth map.

Assignees

• Eys3D Microelectronics Co

Inventors

• Lee Chi-Feng

Classifications

• H04N23/60 Primary

  Control of cameras or camera modules · CPC title

• H04N23/843

  Demosaicing, e.g. interpolating colour pixel values · CPC title

• G06T2207/10028

  Range image; Depth image; 3D point clouds · CPC title

• H04N13/204

  using stereoscopic image cameras (stereoscopic photography G03B35/00) · CPC title

• H04N13/257

  Colour aspects · CPC title