Electronic device for processing images and method for operating same

Patent metadata

Field	Value
Publication number	US-12452546-B2
Application number	US-202318102645-A
Country	US
Kind code	B2
Filing date	Jan 27, 2023
Priority date	Jul 30, 2020
Publication date	Oct 21, 2025
Grant date	Oct 21, 2025

Abstract

Various embodiments of the present invention relate to an apparatus and method for processing images in an electronic device. The electronic device includes: a memory; an image sensor; an image control circuit operatively connected to the image sensor; and an image signal processor operatively coupled to the image control circuit. The image control circuit can store a plurality of frames received through the image sensor in the memory, transmit the plurality of frames stored in the memory to the image signal processor, and, when the number of frames that have not been transmitted to the image signal processor among the plurality of frames obtained from the image sensor exceeds a designated number, remove the frames that have not been transmitted to the image signal processor from the memory.

First claim

What is claimed is:

1. An electronic device comprising:
a memory;
an image sensor;
an image control circuit operatively connected to the image sensor; and
an image signal processor operatively connected to the image control circuit,
wherein the image control circuit is configured to:
store a plurality of frames received via the image sensor in the memory;
transmit at least one of the plurality of frames stored in the memory to the image signal processor; and
identify a difference value between an index of a frame received from the image sensor and an index of the at least one frame transmitted to the image signal processor; and
remove a frame that is not transmitted to the image signal processor among the plurality of frames stored in the memory based on a determination that the identified difference value between the index of the frame received from the image sensor and the index of the at least one frame transmitted to the image signal processor exceeds a designated number.

2. The electronic device of claim 1 , wherein the image control circuit is configured to transmit a first frame corresponding to a first exposure and a second frame corresponding to a second exposure different from the first exposure, which are related to image composition from among the plurality of frames received from the image sensor during a first frame interval, to the image signal processor.

3. The electronic device of claim 2 , wherein the image control circuit is configured to restrict transmission of at least one third frame that corresponds to a third exposure different from the first exposure and the second exposure to the image signal processor from among the plurality of frames received from the image sensor during the first frame interval.

4. The electronic device of claim 1 , wherein the image control circuit is configured to produce an interrupt signal related to storing of a first frame and a second frame based on storing the first frame corresponding to the first exposure and a second frame corresponding to a second exposure different from the first exposure, which are received from the image sensor during the first frame interval, in the memory.

5. The electronic device of claim 4 , wherein the image signal processor is configured to select an address of the memory related to storing of a subsequent frame based on the interrupt signal, and
wherein the image control circuit is configured to store a fourth frame corresponding to the first exposure and a fifth frame corresponding to the second exposure, which are received from the image sensor during a second frame interval, in the memory based on the address selected by the image signal processor.

6. The electronic device of claim 1 , wherein the image control circuit is configured to sequentially transmit the at least one of the plurality of frames received from the image sensor in order of frames received to the image signal processor based on a determination that the identified difference value between the index of the frame received from the image sensor and the index of the at least one frame transmitted to the image signal processor is less than or equal to the designated number.

7. The electronic device of claim 1 , further comprising a display,
wherein the image signal processor is configured to produce a single image by combining the first frame corresponding to the first exposure and the second frame corresponding to the second exposure different from the first exposure, which are provided from the image control circuit, and
wherein the display is configured to display the image produced by the image signal processor.

8. An operation method of an electronic device, the method comprising:
storing a plurality of frames obtained via an image sensor of the electronic device in a memory of the electronic device;
transmitting at least one of the plurality of frames stored in the memory to an image signal processor;
identifying a difference value between an index of a frame received from the image sensor and an index of the at least one frame transmitted to the image signal processor; and
removing the frames that are not transmitted to the image signal processor among the plurality of frames stored in the memory based on a determination that the identified difference value between the index of the frame received from the image sensor and the index of the at least one frame transmitted to the image signal processor exceeds a designated number.

9. The method of claim 8 , wherein the transmitting to the image signal processor comprises transmitting a first frame corresponding to a first exposure and a second frame corresponding to a second exposure different from the first exposure, which are related to image composition among the plurality of frames obtained via the image sensor during a first frame interval, to the image signal processor.

10. The method of claim 9 , further comprising restricting transmission of at least one third frame corresponding to a third exposure different from the first exposure and the second exposure to the image signal processor from among the plurality of frames obtained via the image sensor during the first frame interval.

11. The method of claim 8 , further comprising producing an interrupt signal related to storing of a first frame and a second frame based on storing the first frame corresponding to a first exposure and the second frame corresponding to a second exposure different from the first exposure, which are obtained from the image sensor during a first frame interval, in the memory.

12. The method of claim 11 , further comprising selecting, based on the interrupt signal, an address of the memory related to storing of a subsequent frame, and
storing a fourth frame corresponding to the first exposure and a fifth frame corresponding to the second exposure, which are obtained from the image sensor during a second frame interval, in the memory based on the selected address.

13. The method of claim 8 , further comprising sequentially transmitting at least one of the plurality of frames obtained via the image sensor in order of frames obtained to the image signal processor based on a determination that the identified difference value between the index of the frame received from the image sensor and the index of the at least one frame transmitted to the image signal processor is less than or equal to the designated number.

14. An electronic device comprising:
an image sensor;
an image signal processor; and
at least one processor operatively connected to the image sensor and the image signal processor, wherein the at least one processor is configured to:
obtain frames via an image sensor;
transmit a number of the frames to the image signal processor;
identify a difference value between an index of a frame received from the image sensor and indexes of the number of frames transmitted to the image signal processor and
discard at least one frame that is not transmitted to the image signal processor based on a determination that the difference value between the index of the frame received from the image sensor and the indexes of the number of frames transmitted to the image signal processor exceeds a designated number.

15. The electronic device of claim 14 , wherein the at least one processor is further configured to:
transmit a first frame corresponding to a first exposure and a second frame corresponding to a second exposure different from the first exposure, which are related to image composition during a first frame interval, to the image signal processor; and
restrict transmission of at least one third frame correspondi

Assignees

• Samsung Electronics Co Ltd

Inventors

• Lee Changwoo
• Kim Dohan
• Kim Kwanho
• Cho Jaehun

Classifications

• G06T2207/20221

  Image fusion; Image merging · CPC title

• G06T2207/20208

  High dynamic range [HDR] image processing · CPC title

• G06T2207/10144

  Varying exposure · CPC title

• G06T5/50

  using two or more images, e.g. averaging or subtraction · CPC title

• G06T1/60

  Memory management · CPC title