Array camera design with dedicated Bayer camera

Patent metadata

Field	Value
Publication number	US-9742973-B2
Application number	US-201313962204-A
Country	US
Kind code	B2
Filing date	Aug 8, 2013
Priority date	Aug 8, 2013
Publication date	Aug 22, 2017
Grant date	Aug 22, 2017

Abstract

The invention is directed to systems, methods and computer program products for capturing an image using an array camera. A method comprises determining an application associated with capturing an image using an array camera, wherein the array camera comprises a first sensor and at least one second sensor, wherein the first sensor comprises a red filter, a green filter, and a blue filter, and wherein each second sensor comprises a red filter, a green filter, or a blue filter; determining whether the application requires the image to have a first resolution equal to or greater than a predetermined resolution; determining whether the application requires depth information associated with the image; and in response to determining the application does not require the image to have the first resolution and does not require depth information, activating the first sensor, and capturing the image using the first sensor.

First claim

What is claimed is:

1. A method for capturing an image using an array camera, the method comprising:
providing the array camera comprising:
a processor, and
a grid of sensors comprising:
a single first sensor in operable communication with the processor and comprising a Bayer filter including at least one red filter, at least one green filter and at least blue filter, and
a plurality of second sensors in operable communication with the processor, each second sensor comprising one of a red filter, a green filter or a blue filter;

prior to capturing the image, determining, by the processor, whether an application associated with capturing an image requires (1) the image to have a first resolution equal to or greater than a predetermined resolution, and (2) depth information associated with the image; and
in response to determining the application does not require at least one of (1) the image to have the first resolution, and (2) depth information, activating the single first sensor, deactivating the plurality of second sensors and capturing the image using the single first sensor including the Bayer filter.

2. The method of claim 1 , wherein the application comprises a video recording application.

3. The method of claim 1 , wherein the application comprises a camera preview application.

4. The method of claim 1 , wherein deactivating the plurality of second sensors comprises deactivating at least one power source associated with the plurality of second sensors.

5. The method of claim 1 further comprising:
in response to determining the application requires (1) the image to have the first resolution and (2) depth information, activating the plurality of second sensors, and capturing the image using the plurality of second sensors.

6. The method of claim 5 , further comprising:
in response to determining the application requires (1) the image to have the first resolution and (2) depth information, deactivating the first sensor.

7. The method of claim 1 , wherein the first sensor is positioned substantially near the center of the grid.

8. The method of claim 1 , wherein the first sensor is positioned near an edge of the grid.

9. The method of claim 1 , wherein the at least one red filter, the at least one green filter, and the at least one blue filter of the first sensor are arranged in a second grid.

10. The method of claim 1 , wherein the application is determined by a user of the array camera.

11. The method of claim 1 , wherein activating the first sensor comprises activating a power source associated with the first sensor.

12. An apparatus for capturing an image, the apparatus comprising:
a memory;
a processor in operable with the memory;
an array camera in operable communication with the processor and comprising a grid of sensors comprising:
a single first sensor, wherein the first sensor comprises a Bayer filter comprising at least one red filter, at least one green filter, and at least one blue filter, and
a plurality of second sensors, wherein each second sensor comprises one of a red filter, a green filter, or a blue filter; and
a module stored in the memory, executable by the processor, and configured to:
prior to capturing the image, determine whether an application associated with capturing the image requires (1) the image to have a first resolution equal to or greater than a predetermined resolution, and (2) depth information associated with the image, and
in response to determining the application does not require at least one of (1) the image to have the first resolution, and (2) depth information, activate the single first sensor, deactivate the plurality of second sensors, and capture the image using the single first sensor including the Bayer filter.

13. A computer program product for capturing an image using an array camera, the computer program product comprising:
a non-transitory computer-readable medium comprising a set of codes for causing a computer to:
prior to capturing an image, determine whether an application associated with capturing an image requires (1) the image to have a first resolution equal to or greater than a predetermined resolution, and (2) depth information associated with the image; and
in response to determining the application does not require at least one of (1) the image to have the first resolution, and (2) depth information, activate a single first sensor in the array camera, deactivate a plurality of second sensors in the array camera and capture the image using the single first sensor including a Bayer filter,
wherein the single first sensor and the plurality of second sensors are positioned in a grid and the single first sensor comprises the Bayer filter comprising at least one red filter, at least one green filter and at least blue filter, and the plurality of second sensors each comprise one of a red filter, a green filter or a blue filter.

Assignees

• Sony Corp
• Sony Mobile Communications Inc

Inventors

• Linåker Daniel
• Elg Johannes
• Gustavsson Jonas
• Wernersson Mats

Classifications

• H04N25/134

  based on three different wavelength filter elements · CPC title

• H04N23/45 Primary

  for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images · CPC title

• H04N23/843

  Demosaicing, e.g. interpolating colour pixel values · CPC title

• H04N23/13

  with multiple sensors · CPC title

• H04N23/667

  Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes · CPC title