Electronic device comprising image sensor for identifying an operation setting and an external environmental condition and method of operation thereof

Patent metadata

Field	Value
Publication number	US-12230663-B2
Application number	US-202318132625-A
Country	US
Kind code	B2
Filing date	Apr 10, 2023
Priority date	Dec 23, 2019
Publication date	Feb 18, 2025
Grant date	Feb 18, 2025

Abstract

An electronic device is provided and includes an image sensor including a plurality of unit pixels including a first unit pixel and a second unit pixel, the first unit pixel including a first micro-lens, a first color filter disposed under the first micro-lens, and a first photodiode-array disposed under the first color filter and including a plurality of photodiodes arranged in a same number of columns and rows as each other, and the second unit pixel including a second micro-lens, a second color filter disposed under the second micro-lens and having a different color from that of the first color filter, and a second photodiode-array disposed under the second color filter and including a plurality of photodiodes arranged in a same number of columns and rows as each other; and a processor operatively coupled with the image sensor, wherein the processor is configured to identify a mode corresponding to an auto-focus function; if the mode is identified as a first mode, perform the auto-focus function based at least in part on comparing a first combined signal generated by combining signals obtained from a first column of the first photodiode-array with a second combined signal generated by combining signals obtained from a second column of the first photodiode-array; if the mode is identified as a second mode different from the first mode, perform the auto-focus function based at least in part on comparing the first combined signal with the second combined signal and comparing a third combined signal generated by combining signals obtained from a first row of the first photodiode-array with a fourth combined signal generated by combining signals obtained from a second row of the first photodiode-array; and generate an image signal based at least in part on signals obtained from the first unit pixel and the second unit pixel while the auto-focus function is performed according to a one of the first mode and the second mode.

First claim

What is claimed is:

1. An electronic device comprising:
an image sensor including a plurality of unit pixels including a first unit pixel and a second unit pixel, the first unit pixel including a first micro-lens, a first color filter disposed under the first micro-lens, and a first photodiode-array disposed under the first color filter and including a plurality of photodiodes arranged in a same number of columns and rows as each other, and the second unit pixel including a second micro-lens, a second color filter disposed under the second micro-lens and having a different color from that of the first color filter, and a second photodiode-array disposed under the second color filter and including a plurality of photodiodes arranged in a same number of columns and rows as each other; and
a processor operatively coupled with the image sensor, wherein the processor is configured to:
identify a luminance level corresponding to an external environment of the electronic device;
if the mode is identified as a first mode where the luminance level falls into a first range, perform the auto-focus function based at least in part on comparing a first combined signal generated by combining signals obtained from a first column of the first photodiode-array with a second combined signal generated by combining signals obtained from a second column of the first photodiode-array;
if the mode is identified as a second mode where the luminance level falls into a second range lower than the first range, perform the auto-focus function based at least in part on comparing the first combined signal with the second combined signal and comparing a third combined signal generated by combining signals obtained from a first row of the first photodiode-array with a fourth combined signal generated by combining signals obtained from a second row of the first photodiode-array;
generate an image signal based at least in part on signals obtained from the first unit pixel and the second unit pixel while the auto-focus function is performed according to a one of the first mode and the second mode;
identify a live-preview mode for shooting; and
generate the image signal for a preview image based on a first synthesizing signal and a second synthesizing signal, different than the first synthesizing signal.

2. The electronic device of claim 1 , wherein the processor is configured to:
perform the identifying of the luminance level using one or more signals obtained via a luminance sensor external to the image sensor.

3. The electronic device of claim 1 , wherein the processor is further configured to:
provide, via a display, a live-preview corresponding to one or more external objects while the auto-focus function is set according to the first mode; and
based on receiving a capture signal, capture a photograph image corresponding to the one or more external objects while the auto-focus function is set according to the second mode.

4. The electronic device of claim 1 , wherein the processor is further configured to:
perform a remosaic between the first unit pixel and the second unit pixel to generate the image signal.

5. The electronic device of claim 1 , wherein the processor is further configured to:
obtain the first synthesizing signal by synthesizing the first unit pixel, and
obtain the second synthesizing signal by synthesizing the second unit pixel.

6. The electronic device of claim 5 , wherein the processor is further configured to:
identify a video mode or a photograph mode.

7. The electronic device of claim 6 , wherein the processor is further configured to:
if the luminance level falls into the first range in the video mode or the photograph mode, perform a remosaic between the first unit pixel and the second unit pixel to generate the image signal.

8. The electronic device of claim 7 , wherein the processor is further configured to:
if the luminance level falls into the second range lower than the first range in the video mode or the photograph mode, generate the image signal for the preview image based on the first synthesizing signal and the second synthesizing signal.

9. The electronic device of claim 7 , wherein the processor is further configured to:
generate a Bayer-patterned image by performing the remosaic to the first unit pixel and the second unit pixel.

10. An electronic device comprising:
a memory;
a display;
a camera module including an image sensor, the image sensor including a plurality of unit pixels including a first unit pixel and a second unit pixel, the first unit pixel including a first micro-lens, a first color filter disposed under the first micro-lens, and a first photodiode-array disposed under the first color filter and including a plurality of photodiodes arranged in a same number of columns and rows as each other, and the second unit pixel including a second micro-lens, a second color filter disposed under the second micro-lens and having a different color from that of the first color filter, and a second photodiode-array disposed under the second color filter and including a plurality of photodiodes arranged in a same number of columns and rows as each other; and
a processor operatively coupled with the image sensor, wherein the processor is configured to:
identify a luminance level corresponding to an external environment of the electronic device;
if the mode is identified as a first mode where the luminance level falls into a first range, perform the auto-focus function based at least in part on comparing a first combined signal generated by combining signals obtained a first column of the first photodiode-array with a second combined signal generated by combining signals obtained from a second column of the first photodiode-array;
if the mode is identified as a second mode where the luminance level falls into a second range lower than the first range, perform the auto-focus function based at least in part on comparing the first combined signal with the second combined signal and comparing a third combined signal generated by combining signals obtained from a first row of the first photodiode-array with a fourth combined signal generated by combining signals obtained from a second row of the first photodiode-array;
display, via the display, an image generated based at least in part on signals obtained from the first unit pixel and the second unit pixel while the auto-focus function is performed according to a one of the first mode and the second mode;
identify a live-preview mode for shooting; and
generate the image signal for a preview image based on a first synthesizing signal and a second synthesizing signal, different than the first synthesizing signal.

11. The electronic device of claim 10 , wherein the processor is further configured to:
perform the identifying of the luminance level using one or more signals obtained via a luminance sensor external to the image sensor.

12. The electronic device of claim 10 , wherein the processor is further configured to:
provide, via a display, a live-preview corresponding to one or more external objects while the auto-focus function is set according to the first mode; and
based on receiving a capture signal, capture a photograph image corresponding to the one or more external objects while the auto-focus function is set according to the second mode.

13. The electronic device of claim 10 , wherein the processor is further configured to:
perform a remosaic between the first unit pixel and the second unit pixel to generate the image signal.

14. The electronic device of claim 10 , wherein the processor is further configured to:
obtain the first synthe

Assignees

• Samsung Electronics Co Ltd

Inventors

• Kim Dongsoo
• Kang Hwayong
• Kim Yeongeun
• Park Minyoung
• Yoon Youngkwon
• Jo Hyeoncheol

Classifications

• H10F39/8063 Primary

  Microlenses · CPC title

• H10F39/8053

  Colour filters · CPC title

• H10F39/811

  Interconnections · CPC title

• H10F39/803 Primary

  Pixels having integrated switching, control, storage or amplification elements · CPC title

• H10F39/18

  Complementary metal-oxide-semiconductor [CMOS] image sensors; Photodiode array image sensors · CPC title