Image processing device and method, and imaging device

Patent metadata

Field	Value
Publication number	US-9596455-B2
Application number	US-201414493879-A
Country	US
Kind code	B2
Filing date	Sep 23, 2014
Priority date	Mar 28, 2012
Publication date	Mar 14, 2017
Grant date	Mar 14, 2017

Abstract

An image processing device comprising: an image acquisition device; a parallax information acquisition device; and a calculation device configured to calculate a first pixel and a second pixel for each pixel of the acquired image, the first digital filter and the second digital filter corresponding to the parallax information for each pixel of the acquired image, the first digital filter group and the second digital filter group being digital filter groups for giving a parallax to the acquired image and having left-right symmetry to each other, and each of the first digital filter group and the second digital filter group having filter sizes that are different depending on a magnitude of the parallax to be given, wherein the left-right symmetry of the first and second digital filter groups is different between a central part and an edge part of the image.

First claim

What is claimed is:

1. An image processing device comprising:
an image acquisition device configured to acquire an image;
a parallax information acquisition device configured to acquire parallax information to be given to a pixel, for each pixel of the acquired image; and
a calculation device configured to calculate a first pixel and a second pixel for each pixel of the acquired image, by performing a filtering process with a first digital filter and a second digital filter, based on a first digital filter group, a second digital filter group and the parallax information for each pixel acquired by the parallax information acquisition device, the first pixel and the second pixel being pixels to which a parallax has been given, the first digital filter and the second digital filter corresponding to the parallax information for each pixel of the acquired image, the first digital filter group and the second digital filter group being digital filter groups for giving a parallax to the acquired image and having left-right symmetry to each other, and each of the first digital filter group and the second digital filter group having filter sizes that are different depending on a magnitude of the parallax to be given,
wherein the left-right symmetry of the first and second digital filter groups is different between a central part and an edge part of the image.

2. The image processing device according to claim 1 , comprising a parallax map acquisition device configured to acquire a parallax map that indicates the parallax to be given to the acquired image,
wherein, for each pixel of the acquired image, the parallax information acquisition device acquires the parallax information corresponding to a position of the pixel, from the parallax map.

3. The image processing device according to claim 2 , wherein the first digital filter group and the second digital filter group each have normalized filter coefficients.

4. The image processing device according to claim 2 , comprising a parallax map storage device configured to store a parallax map that is previously defined depending on a position on the image,
wherein the parallax map acquisition device acquires the parallax map from the parallax map storage device.

5. The image processing device according to claim 4 , wherein the first digital filter group and the second digital filter group each have normalized filter coefficients.

6. The image processing device according to claim 4 , comprising a device configured to acquire information indicating a top-bottom direction of the image to which the parallax is to be given,
wherein, in the acquisition of the parallax map from the parallax map storage device, the parallax map acquisition device acquires a corresponding parallax map, based on the information indicating the top-bottom direction of the acquired image.

7. The image processing device according to claim 6 , wherein the first digital filter group and the second digital filter group each have normalized filter coefficients.

8. The image processing device according to claim 1 , wherein the first digital filter group and the second digital filter group each have normalized filter coefficients.

9. An imaging device comprising:
an imaging device including an image-taking optical system, and an imaging element on which a subject image is formed through the image-taking optical system;
the image acquisition device configured to acquire an image that is output from the imaging device; and
the image processing device according to claim 1 .

10. The imaging device according to claim 9 , comprising a length information acquisition device configured to acquire length information for each of multiple regions of a picked-up image or for each pixel of the picked-up image, when the image is picked up by the imaging device,
wherein the parallax information acquisition device acquires the parallax information of the picked-up image, based on the acquired length information.

11. The imaging device according to claim 9 , comprising a phase difference detection device configured to detect a phase difference for each of multiple regions of an image picked up by the imaging device or for each pixel of the image,
wherein the parallax information acquisition device acquires the parallax information of the picked-up image, based on the phase difference detected by the phase difference detection device.

12. The imaging device according to claim 9 , further comprising another imaging device including an image-taking optical system and an imaging element and being different from the imaging device,
wherein the parallax information acquisition device acquires the parallax information of the picked-up image, based on two images picked up by the two imaging device.

13. An image processing device comprising:
an image acquisition device configured to acquire an image;
a parallax information acquisition device configured to acquire parallax information to be given to a pixel, for each pixel of the acquired image; and
a calculation device configured to calculate a first pixel and a second pixel for each pixel of the acquired image, by performing a filtering process with a first digital filter and a second digital filter, based on a first digital filter group, a second digital filter group and the parallax information for each pixel acquired by the parallax information acquisition device, the first pixel and the second pixel being pixels to which a parallax has been given, the first digital filter and the second digital filter corresponding to the parallax information for each pixel of the acquired image, the first digital filter group and the second digital filter group being digital filter groups for giving a parallax to the acquired image and having left-right symmetry to each other, and each of the first digital filter group and the second digital filter group having filter sizes that are different depending on a magnitude of the parallax to be given,
wherein the first digital filter group and the second digital filter group are calculated based on a sensitivity characteristic of a single imaging element, the sensitivity characteristic depending on an incidence angle, the single imaging element being configured by a first pixel group and a second pixel group, the first pixel group and the second pixel group respectively receiving light fluxes into which light flux having passed through a single image-taking optical system is pupil-divided.

14. The image processing device according to claim 13 , wherein the first digital filter group and the second digital filter group each have normalized filter coefficients.

15. An image processing device comprising:
an image acquisition device configured to acquire an image;
a parallax information acquisition device configured to acquire parallax information to be given to a pixel, for each pixel of the acquired image; and
a calculation device configured to calculate a first pixel and a second pixel for each pixel of the acquired image, by performing a filtering process with a first digital filter and a second digital filter, based on a first digital filter group, a second digital filter group and the parallax information for each pixel acquired by the parallax information acquisition device, the first pixel and the second pixel being pixels to which a parallax has been given, the first digital filter and the second digital filter corresponding to the parallax information for each pixel of the acquired image, the first digital filter group and the second digital filter group being digital filter groups for giving a parallax to the acquired image and having left

Assignees

• Fujifilm Corp

Inventors

• Izawa Katsutoshi
• Kawai Tomoyuki

Classifications

• H04N13/261 Primary

  with monoscopic-to-stereoscopic image conversion · CPC title

• H04N13/207

  using a single two-dimensional [2D] image sensor · CPC title

• H04N13/211 Primary

  using temporal multiplexing · CPC title

• H04N13/0018

  Electricity · mapped topic

• H04N13/0207

  Electricity · mapped topic