Array camera, mobile terminal, and methods for operating the same

Patent metadata

Field	Value
Publication number	US-9253397-B2
Application number	US-201313869240-A
Country	US
Kind code	B2
Filing date	Apr 24, 2013
Priority date	Nov 15, 2012
Publication date	Feb 2, 2016
Grant date	Feb 2, 2016

Abstract

An array camera, a mobile terminal, and methods for operating the same are disclosed. The method for operating an array camera including a plurality of camera modules includes applying a different camera environment setting from the other camera modules to at least one of the plurality of camera modules, acquiring images through the plurality of camera modules, and combining the acquired images.

First claim

What is claimed is:

1. A method for operating an array camera including a plurality of camera modules, the method comprising:
applying a different camera environment setting from the other camera modules to at least one of the plurality of camera modules;
acquiring images through the plurality of camera modules;
combining the acquired images, wherein at least one of the plurality of camera modules includes a lens of a different magnification or type from the other camera modules, wherein the plurality of camera modules include a camera module having a wide angle lens and a camera module having a telephoto lens that are arranged alternately;
generating a depth map from an image acquired from the camera module having the wide angle lens; and
extracting an object area from an image acquired from the camera module having the telephoto lens,
wherein the combining comprises giving perspective to a background area based on the depth map and inserting the extracted object area.

2. The method according to claim 1 , wherein the application comprises applying settings to the plurality of camera modules according to a user setting input or loading of a preset setting value.

3. The method according to claim 1 , wherein the application comprises applying a different setting to each of the plurality of camera modules.

4. The method according to claim 1 , wherein the application comprises applying a different resolution and frame rate setting to the at least one of the plurality of camera modules.

5. The method according to claim 4 , wherein the combining comprises generating a high-resolution, high-frame rate image based on images acquired from a camera module under a low-resolution, fast-shot setting and images acquired from a camera module under a high-resolution, slot-shot setting.

6. The method according to claim 4 , wherein the combining comprises generating a composite image based on images acquired from a camera module under a first setting of a low resolution and a high frame rate and images acquired from a camera module under a second setting of a high resolution and a low frame rate relative to the first setting.

7. The method according to claim 6 , wherein the combining further comprises generating the composite image based on images acquired from a camera module under a third setting of a high resolution and a low frame rate relative to the second setting.

8. The method according to claim 1 , further comprising generating a depth map based on images acquired through the plurality of camera modules.

9. The method according to claim 1 , wherein the application comprises applying a different exposure setting to the at least one of the plurality of camera modules.

10. A method for operating a mobile terminal having an array camera including a plurality of camera modules, the method comprising:
applying a different camera environment setting from the other camera modules to at least one of the plurality of camera modules;
acquiring images through the plurality of camera modules;
combining the acquired images, wherein at least one of the plurality of camera modules includes a lens of a different magnification or type from the other camera modules, wherein the plurality of camera modules include a camera module having a wide angle lens and a camera module having a telephoto lens that are arranged alternately;
generating a depth map from an image acquired from the camera module having the wide angle lens; and
extracting an object area from an image acquired from the camera module having the telephoto lens,
wherein the combining comprises giving perspective to a background area based on the depth map and inserting the extracted object area.

11. The method according to claim 10 , wherein the application comprises applying settings to the plurality of camera modules according to a user setting input or loading of a preset setting value.

12. The method according to claim 10 , wherein the application comprises applying a different setting to each of the plurality of camera modules.

13. The method according to claim 10 , wherein the application comprises applying a different resolution and frame rate setting to the at least one of the plurality of camera modules.

14. The method according to claim 13 , wherein the combining comprises generating a high-resolution, high-frame rate image based on images acquired from a camera module under a low-resolution, fast-shot setting and images acquired from a camera module under a high-resolution, slot-shot setting.

15. The method according to claim 14 , wherein the combining comprises generating a composite image based on images acquired from a camera module under a first setting of a low resolution and a high frame rate and images acquired from a camera module under a second setting of a high resolution and a low frame rate relative to the first setting.

16. The method according to claim 15 , wherein the combining further comprises generating the composite image based on images acquired from a camera module under a third setting of a high resolution and a low frame rate relative to the second setting.

17. The method according to claim 10 , further comprising generating a depth map based on images acquired through the plurality of camera modules.

Assignees

• Lee Jeehong
• Shim Eunji
• Huh Hyungmoo
• Do Hoseok
• Lg Electronics Inc

Inventors

• Lee Jeehong
• Shim Eunji
• Huh Hyungmoo
• Do Hoseok

Classifications

• H04N23/951

  by using two or more images to influence resolution, frame rate or aspect ratio · CPC title

• H04N23/45 Primary

  for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images · CPC title

• H04N23/698 Primary

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N23/90

  Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums · CPC title

• H04N5/23232

  Electricity · mapped topic