Camera module having multi-cell structure and portable communication device including the same

Patent metadata

Field	Value
Publication number	US-11057577-B2
Application number	US-201916723976-A
Country	US
Kind code	B2
Filing date	Dec 20, 2019
Priority date	Dec 21, 2018
Publication date	Jul 6, 2021
Grant date	Jul 6, 2021

Abstract

A portable communication device configured to activate an image capturing function of a camera module. When the image capturing function is activated, use an image sensor to obtain first raw image data including a specified channel pattern, generated by binning image data obtained from the specified number of image pixels corresponding to the same channel. Display a first image generated based on the first raw image data on a display. While the image capturing function is activated, receive an input associated with adjustment of a zoom setting. Use the image sensor to obtain second raw image data having the specified channel pattern, generated by re-mosaicing image data obtained from some of the plurality of image pixels corresponding to a portion of the image sensor based on the input. Display a second image generated based on the second raw image data on the display.

First claim

What is claimed is:

1. A portable communication device comprising:
a camera module including an image sensor including a plurality of image pixels and a control circuit configured to control the image sensor;
a display; and
a processor configured to:
activate an image capturing function of the camera module;
based on the image capturing function being activated, obtain first raw image data comprising a specified channel pattern generated by binning image data obtained from a specified number of image pixels corresponding to a same channel with respect to the plurality of image pixels, by using the image sensor;
display a first image generated based on the first raw image data on the display;
while the image capturing function is activated, receive an input associated with an adjustment of a zoom setting;
obtain second raw image data comprising a specified channel pattern, generated by re-mosaicing image data obtained from a portion of the plurality of image pixels corresponding to a portion of the image sensor based at least on the input, by using the image sensor; and
display a second image generated based on the second raw image data on the display.

2. The portable communication device of claim 1 , wherein the processor is configured to identify a position selected as a zoom region and a zoom magnification based at least on the input associated with the adjustment of the zoom setting,
wherein the portion of the plurality of image pixels are image pixels corresponding to the identified zoom magnification mapped on the selected position.

3. The portable communication device of claim 1 , wherein the second raw image data is raw image data generated to have a resolution corresponding to a resolution of the first raw image data.

4. The portable communication device of claim 1 , wherein the processor is configured to:
identify ambient illuminance; and
when the ambient illuminance is within a specified illuminance range, use the image sensor to obtain the second raw image data.

5. The portable communication device of claim 4 , wherein the processor is configured to:
when the ambient illuminance is not within the specified illuminance range, use the image sensor to obtain third raw image data generated by at least binning image data obtained from the specified number of image pixels corresponding to the same channel among the portion of the plurality of image pixels corresponding to the portion of the image sensor; and
display a third image generated based on the third raw image data on the display.

6. The portable communication device of claim 1 , wherein the processor is configured to:
identify a signal to noise ratio of the first image; and
when the signal to noise ratio of the first image is within a specified ratio range, use the image sensor to obtain the second raw image data.

7. The portable communication device of claim 6 , wherein the processor is configured to:
when the signal to noise ratio is not within the specified ratio range, use the image sensor to obtain third raw image data generated by binning image data obtained from the specified number of image pixels corresponding to the same channel among the portion of the plurality of image pixels corresponding to the portion of the image sensor; and
display a third image generated based on the third raw image data on the display.

8. A portable communication device comprising:
a camera module including an image sensor including a plurality of image pixels and a control circuit configured to control the image sensor;
a display; and
a processor configured to:
receive an input associated with an adjustment of a zoom setting related to capturing an image;
obtain first raw image data generated by binning image data obtained from a first set number of pixels corresponding to a same channel with respect to the plurality of image pixels based on the zoom setting being within a specified first magnification range by using the image sensor, and display a first image generated based on the obtained first raw image data on the display; and
obtain second raw image data generated by re-mosaicing image data obtained from a portion of the plurality of image pixels corresponding to a portion of the image sensor based on the zoom setting being within a specified second magnification range by using the image sensor, and display a second image generated based on the obtained second raw image data on the display.

9. The portable communication device of claim 8 , wherein the processor is configured to:
use the image sensor to obtain third raw image data generated by at least binning image data obtained from a second set number of pixels corresponding to the same channel with respect to the plurality of image pixels based on the zoom setting being within a specified third magnification range, wherein the second set number of pixels is different from the first set number of pixels; and
display a third image generated using the third raw image data on the display.

10. The portable communication device of claim 9 , wherein the processor is configured to:
use the image sensor to obtain the third raw image data, generated by binning the image data obtained from the second set number of pixels corresponding to the same channel with respect to the plurality of image pixels and then further re-mosaicing the binned image data.

11. The portable communication device of claim 9 , wherein the processor is configured to:
use the image sensor to obtain the third raw image data generated by at least binning image data obtained from the second set number of pixels corresponding to the same channel among a portion of a remaining image pixels corresponding to another portion of the image sensor among the plurality of image pixels based on the zoom setting being within the specified third magnification range.

12. The portable communication device of claim 8 , wherein the processor is configured to:
identify information associated with a position and a magnification of a zoom region based at least on the input associated with the adjustment of the zoom setting, and
wherein the portion of the image sensor is a portion corresponding to the position and the magnification of the zoom region.

13. The portable communication device of claim 8 , wherein the processor is configured to:
identify ambient illuminance;
based on the ambient illuminance being within a specified illuminance range, obtain the second raw image data comprising a specified channel pattern, generated by re-mosaicing the image data obtained from the portion of the plurality of image pixels corresponding to the portion of the image sensor, by using the image sensor;
based on the ambient illuminance not being within the specified illuminance range, obtain third raw image data generated by binning image data obtained from a specified number of image pixels corresponding to the same channel among the portion of the plurality of image pixels corresponding to the portion of the image sensor, by using the image sensor; and
display a third image generated based on the third raw image data on the display.

14. The portable communication device of claim 8 , wherein the processor is configured to:
identify a signal to noise ratio of the first image;
based on the signal to noise ratio is within a specified ratio range, obtain the second raw image data comprising a specified channel pattern, generated by re-mosaicing the image data obtained from the portion of the plurality of image pixels corresponding to the portion of the image sensor, by using the image sensor;
based on the signal to noise ratio not being within the sp

Assignees

• Samsung Electronics Co Ltd

Inventors

• Kang Hwayong
• Won Jonghun
• Lee Kihuk

Classifications

• H04N23/632 Primary

  for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters · CPC title

• H04N25/443 Primary

  by reading pixels from selected two-dimensional [2D] regions of the array, e.g. for windowing or digital zooming · CPC title

• H04N25/46

  by combining or binning pixels · CPC title

• H04N23/57

  Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices · CPC title

• H04N25/134

  based on three different wavelength filter elements · CPC title