Electronic device for generating composite image and method thereof

Patent metadata

Field	Value
Publication number	US-11308593-B2
Application number	US-202016823795-A
Country	US
Kind code	B2
Filing date	Mar 19, 2020
Priority date	Mar 19, 2019
Publication date	Apr 19, 2022
Grant date	Apr 19, 2022

Abstract

An electronic device, a method and a storage medium are disclosed. The electronic device includes a processor and a memory operatively coupled to the processor. The processor is configured to receive a user input from an external electronic device. The processor is also configured to synthesize a first region that is a first partial region of a first raw image and a second partial region of a second raw image based on the user input to generate a composite raw image. The processor is further configured to modify at least one of a first attribute of the first raw image and a second attribute of the second raw image to generate a third attribute. Additionally, the processor is configured to calibrate the composite raw image using the third attribute to generate a composite image.

First claim

What is claimed is:

1. An electronic device, comprising:
a processor; and
a memory operatively coupled to the processor,
wherein the processor is configured to:
receive a user input from an external electronic device;
synthesize a first region that is a first partial region of a first raw image and a second partial region of a second raw image based on the user input to generate a composite raw image;
based on at least one of a first attribute of the first raw image and a second attribute of the second raw image, identify a third attribute; and
calibrate the composite raw image using the third attribute to generate a composite image from the composite raw image,
wherein the first attribute includes at least one of a first brightness value, a first exposure time, a first white balance value, and a first depth map of the first region, and
wherein the second attribute includes at least one of a second brightness, a second exposure time, a second white balance value, and a second depth map of the second partial region of the second raw image.

2. The electronic device of claim 1 , wherein the processor is further configured to:
when a first area where the first region is occupied in the composite raw image is greater than or equal to a reference area, modify the second attribute based on the first attribute to identify the third attribute; and
when the first area is less than the reference area, modify the first attribute based on the second attribute to identify the third attribute.

3. The electronic device of claim 2 , wherein
the processor is further configured to:
when the first area is greater than or equal to the reference area, modify the second white balance value of the second partial region of the second raw image to the first white balance value of the first region based on the third attribute to generate the composite image; and
when the first area is less than the reference area, modify the first white balance value of the first region to the second white balance value of the second partial region of the second raw image based on the third attribute to generate the composite image.

4. The electronic device of claim 1 , wherein the processor is further configured to:
compare a first area where the first region is occupied in the composite raw image with a second area where the second partial region of the second raw image is occupied in the composite raw image to identify a large area and a small area between the first area and the second area;
when the identified large area is the first area, modify the second attribute based on the first attribute to identify the third attribute; and
when the identified large area is the second area, modify the first attribute based on the second attribute to identify the third attribute.

5. The electronic device of claim 1 , wherein:
the user input includes first information about a location where the first region is placed in the second partial region of the second raw image and second information about a size of the first region that is occupied in the second partial region of the second raw image, and
the processor is further configured to:
place the first region based on the first information about the location on the second partial region of the second raw image; and
adjust the size of the first region based on the second information about the size to generate the composite raw image.

6. The electronic device of claim 1 , wherein the processor is further configured to:
extract a second region from the first raw image; and
synthesize the first region, the second region, and the second partial region of the second raw image to generate the composite raw image.

7. The electronic device of claim 1 , wherein the processor is further configured to:
when a reference image is the first raw image based on the user input associated with the reference image, modify the second attribute based on the first attribute to identify the third attribute; and
when the reference image is the second raw image, modify the first attribute based on the second attribute to identify the third attribute.

8. The electronic device of claim 7 , wherein
the processor is further configured to:
when the reference image is the first raw image, modify the second white balance value of the second partial region of the second raw image to the first white balance value of the first region based on the third attribute to generate the composite image; and
when the reference image is the second raw image, modify the first white balance value of the first region to the second white balance value of the second partial region of the second raw image based on the third attribute to generate the composite image.

9. The electronic device of claim 1 , wherein the processor is further configured to:
identify the third attribute based on an average value of the first attribute and the second attribute.

10. The electronic device of claim 9 , wherein
the processor is further configured to:
identify the third attribute based on an average value of the first white balance value of the first partial region of the first raw image and the second white balance value of the second partial region of the second raw image.

11. A method for generating a composite image in an electronic device, the method comprising:
receiving a user input;
synthesizing a first region that is a first partial region of a first raw image and a second partial region of a second raw image based on the user input to generate a composite raw image;
based on at least one of a first attribute of the first raw image and a second attribute of the second raw image, identifying a third attribute; and
calibrating the composite raw image using the third attribute to generate the composite image from the composite raw image,
wherein the first attribute includes at least one of a first brightness value, a first exposure time, a first white balance value, and a first depth map of the first region, and
wherein the second attribute includes at least one of a second brightness, a second exposure time, a second white balance value, and a second depth map of the second partial region of the second raw image.

12. The method of claim 11 , wherein identifying the third attribute includes:
when a first area where the first region is occupied in the composite raw image is greater than or equal to a reference area, modifying the second attribute based on the first attribute to identify the third attribute; and
when the first area is less than the reference area, modifying the first attribute based on the second attribute to identify the third attribute.

13. The method of claim 11 , wherein identifying the third attribute includes:
comparing a first area where the first region is occupied in the composite raw image with a second area where the second partial region of the second raw image is occupied in the composite raw image to identify a large area and a small area between the first area and the second area;
when the identified large area is the first area, modifying the second attribute based on the first attribute to identify the third attribute; and
when the identified large area is the second area, modifying the first attribute based on the second attribute to identify the third attribute.

14. The method of claim 11 , wherein:
the user input includes first information about a location where the first region is placed in the second partial region of the second raw image and second information about a size of the first region that is occupied in the second partial region of the second raw image, and
generating the compos

Assignees

• Samsung Electronics Co Ltd

Inventors

• Han Changsu
• Kim Sungoh
• Kim Youngjo
• Park Hyunhee
• Lee Jungeun
• Lim Sungjun
• Chun Hyungju
• Choi Jongbum
• Won Jonghun
• Lee Arang

Classifications

• H04N23/88

  for colour balance, e.g. white-balance circuits or colour temperature control · CPC title

• H04N23/73

  by influencing the exposure time · CPC title

• H04N23/62

  Control of parameters via user interfaces · CPC title

• H04N23/661

  Transmitting camera control signals through networks, e.g. control via the Internet · CPC title

• G06T3/40

  Scaling of whole images or parts thereof, e.g. expanding or contracting · CPC title