Apparatus, method, and storage medium each relating to image composition

Patent metadata

Field	Value
Publication number	US-2021152722-A1
Application number	US-202017092091-A
Country	US
Kind code	A1
Filing date	Nov 6, 2020
Priority date	Nov 15, 2019
Publication date	May 20, 2021
Grant date	—

Abstract

An apparatus includes at least one memory configured to store instructions, and at least one processor in communication with the at least one memory and configured to execute the instructions to perform same area dividing on each of a plurality of images, and create a composite image from the plurality of images. A first area of the composite image is composited from corresponding areas in a first number of image among the plurality of images. A second area of the composite image is composited from corresponding areas in a second number of image among the plurality of images.

First claim

What is claimed is:

1 . An apparatus, comprising:
at least one memory configured to store instructions; and at least one processor in communication with the at least one memory and configured to execute the instructions to: perform same area dividing on each of a plurality of images; and create a composite image from the plurality of images, wherein a first area of the composite image is composited from corresponding areas in a first number of image among the plurality of images, wherein a second area of the composite image is composited from corresponding areas in a second number of image among the plurality of images.

2 . The apparatus according to claim 1 , wherein the corresponding areas are divided areas located at a same position.

3 . The apparatus according to claim 1 , wherein the at least one processor executes the instructions to create the composite image by addition averaging.

4 . The apparatus according to claim 1 , wherein the at least one processor executes the instructions to perform the area dividing based on an instruction from a user.

5 . The apparatus according to claim 4 , wherein the at least one processor executes the instructions to determine at least one of positions of the area dividing and the first number or the second number based on the instruction from the user.

6 . The apparatus according to claim 1 , wherein the at least one processor executes
the instructions to perform determination of an object in each of the plurality of images, and perform the area dividing based on the determination.

7 . The apparatus according to claim 6 , wherein the at least one processor executes the instructions to perform the determination using a neural network.

8 . The apparatus according to claim 1 , wherein the at least one processor executes the instructions to:
detect a motion vector; perform the area dividing by a predetermined method; detect the motion vector of each of divided areas; and create the composite image based on the motion vectors.

9 . The apparatus according to claim 8 , wherein the at least one processor executes the instructions to detect the motion vector from positional shift between corresponding areas among the divided areas.

10 . The apparatus according to claim 9 , wherein the corresponding areas are areas located at a same position in the plurality of images.

11 . The apparatus according to claim 9 , wherein the at least one processor executes the instructions to use the areas each having a motion vector of a magnitude within a predetermined range among the corresponding areas, for creation of the composite image.

12 . The apparatus according to claim 9 , wherein the at least one processor executes the instructions to use the areas each having a difference of the motion vector within a predetermined range among the corresponding areas, for creation of the composite image.

13 . The apparatus according to claim 1 , wherein at least a part of an area of the composite image is simulatively longer in exposure time than the plurality of images.

14 . The apparatus according to claim 1 , wherein the plurality of images has a same field angle.

15 . The apparatus according to claim 1 , wherein the plurality of images is same in exposure time.

16 . An apparatus, comprising:
at least one memory configured to store instructions; and at least one processor in communication with the at least one memory and configured to execute the instructions to: perform area dividing on a standard image; and composite at least one reference image with an area divided by the area dividing to create a composite image in which an exposure time in at least a part of an area is simulatively longer than an exposure time of the at least one reference image, wherein the at least one processor executes the instructions to control a number of reference image composited with the divided area, based on a result of the area dividing.

17 . An apparatus, comprising:
an image sensor configured to pick up a plurality of images; at least one memory configured to store instructions; and at least one processor in communication with the at least one memory and configured to execute the instructions to: perform same area dividing on each of the plurality of images; and create a composite image from the plurality of images, wherein a first area of the composite image is composited from corresponding areas in a first number of image among the plurality of images, wherein a second area of the composite image is composited from corresponding areas in a second number of image among the plurality of images.

18 . An apparatus, comprising:
an image sensor configured to pick up a plurality of images including a standard image and a reference image; at least one memory configured to store instructions; and at least one processor in communication with the at least one memory and configured to execute the instructions to: perform area dividing on the standard image; and composite at least one reference image with an area divided by the area dividing to create a composite image in which an exposure time in at least a part of an area is simulatively longer than an exposure time of the at least one reference image, wherein the at least one processor executes the instructions to control a number of reference image composited with the divided area, based on a result of the area dividing.

19 . A method, comprising:
performing same area dividing on each of a plurality of images; and creating a composite image from the plurality of images, wherein a first area of the composite image is composited from corresponding areas in a first number of image among the plurality of images, wherein a second area of the composite image is composited from corresponding areas in a second number of image among the plurality of images.

20 . A method, comprising:
performing area dividing on a standard image; compositing at least one reference image with an area divided by the area dividing to create a composite image in which an exposure time in at least a part of an area is simulatively longer than an exposure time of the at least one reference image; and controlling a number of the reference image composited with the divided area, based on a result of the area dividing.

21 . A non-transitory computer-readable storage medium storing a program to cause a computer to perform a method comprising:
performing same area dividing on each of a plurality of images; and creating a composite image from the plurality of images, wherein a first area of the composite image is composited from corresponding areas in a first number of image among the plurality of images, wherein a second area of the composite image is composited from corresponding areas in a second number of image among the plurality of images.

22 . A non-transitory computer-readable storage medium storing a program to cause a computer to perform a method comprising:
performing area dividing on a standard image; compositing at least one reference image with an area divided by the area dividing to create a composite image in which an exposure time in at least a part of an area is simulatively longer than an exposure time of the at least one reference image; and controlling a number of the reference image composited with the divided area, based on a result of the area dividing.

Assignees

• Canon Kk

Inventors

• Oota Makoto
• Yamaguchi Shota

Classifications

• H04N23/667

  Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes · CPC title

• H04N23/80

  Camera processing pipelines; Components thereof · CPC title

• H04N23/60

  Control of cameras or camera modules · CPC title

• H04N23/73 Primary

  by influencing the exposure time · CPC title

• H04N25/50

  Control of the SSIS exposure · CPC title