Imaging apparatus for generating a composite image from a plurality of images

Patent metadata

Field	Value
Publication number	US-11595563-B2
Application number	US-202117152004-A
Country	US
Kind code	B2
Filing date	Jan 19, 2021
Priority date	Jul 26, 2018
Publication date	Feb 28, 2023
Grant date	Feb 28, 2023

Abstract

An imaging apparatus according to the present invention includes a first camera and a second camera, and performing photography using the first camera and the second camera, and generating a composite image from a plurality of images acquired by the photography, the imaging apparatus comprising at least one memory and at least one processor which function as: an acquiring unit configured to acquire two images by performing a first photography and a second photography, which is performed after a time lag from the first photography; and a generating unit configured to generate a composite image having a visual field range of 360 degrees by compositing a first image acquired by performing photography for a first range in the first photography and a second image acquired by performing photography for a second range in the second photography.

First claim

The invention claimed is:

1. An imaging apparatus including a first camera and a second camera for performing photography using the first camera and the second camera, and for generating a composite image from a plurality of images acquired by the photography, the imaging apparatus comprising at least one memory and at least one processor which function as:
an acquiring unit configured to acquire two images by performing a first photography and a second photography which is performed after performing the first photography;
a notifying unit configured to perform a predetermined notification to request a user to change a user's position from a front range of the imaging apparatus to a rear range of the imaging apparatus or from the rear range of the imaging apparatus to the front range of the imaging apparatus between performing the first photography and performing the second photography; and
a generating unit configured to generate a composite image having a visual field range of 360 degrees by compositing a first image acquired by performing the first photography and a second image acquired by performing the second photography,
wherein the first camera performs photography for one of the front range of the imaging apparatus and the rear range of the imaging apparatus and the second camera performs photography for another of the front range of the imaging apparatus and the rear range of the imaging apparatus, and
wherein the first image corresponds to one of the front range of the imaging apparatus and the rear range of the imaging apparatus and the second image corresponds to another of the front range of the imaging apparatus and the rear range of the imaging apparatus.

2. The imaging apparatus according to claim 1 , wherein each of the first camera and the second camera performs photography for a range, a horizontal angle of which is at least 180 degrees and a vertical angle of which is at least 180 degrees.

3. The imaging apparatus according to claim 1 , wherein the composite image has a visual field range, a horizontal angle of which is 360 degrees and a vertical angle of which is 360 degrees.

4. The imaging apparatus according to claim 1 , wherein each of the first camera and the second camera includes an imaging element and a photographic lens.

5. The imaging apparatus according to claim 1 , wherein the acquiring unit acquires the second image by the second photography performed within a predetermined time after performing the first photography.

6. The imaging apparatus according to claim 1 , wherein the notifying unit performs the predetermined notification by causing a light-emitting member to emit light.

7. The imaging apparatus according to claim 6 , wherein the notifying unit performs the predetermined notification by causing the light-emitting member to emit light in accordance with at least one of a predetermined light emission pattern and a predetermined light emission color.

8. The imaging apparatus according to claim 1 , wherein the notifying unit is a first notifying unit, and
wherein the at least one memory and the at least one processor further function as a second notifying unit configured to perform notification prompting the imaging apparatus to be fixed and installed before the first photography is performed.

9. The imaging apparatus according to claim 8 , further comprising a fixing portion for fixing and installing the imaging apparatus.

10. The imaging apparatus according to claim 1 , wherein the notifying unit performs the predetermined notification by displaying a message on a display to request the user to change the user's position.

11. The imaging apparatus according to claim 1 , wherein the at least one memory and the at least one processor further function as a recording unit configured to record the composite image in a recording medium.

12. The imaging apparatus according to claim 1 , wherein the generating unit performs processing of correcting a distortion of the image and generates the composite image.

13. The imaging apparatus according to claim 1 , wherein the generating unit generates the composite image in accordance with equirectangular projection.

14. The imaging apparatus according to claim 1 , wherein the first front range of the imaging apparatus and the rear range of the imaging apparatus differ by 180 degrees in a yaw direction.

15. The imaging apparatus according to claim 1 , wherein the first photography is performed in response to an instruction by the user.

16. The imaging apparatus according to claim 1 , wherein the imaging apparatus is fixed in spite of changing the user's position.

17. A control method of an imaging apparatus including a first camera and a second camera for performing photography using the first camera and the second camera, and for generating a composite image from a plurality of images acquired by the photography, the control method comprising:
acquiring two images by performing a first photography and a second photography, which is performed after performing the first photography;
performing a predetermined notification to request a user to change a user's position from a front range of the imaging apparatus to a rear range of the imaging apparatus or from the rear range of the imaging apparatus to the front range of the imaging apparatus between performing the first photography and performing the second photography; and
generating a composite image having a visual field range of 360 degrees by compositing a first image acquired by performing the first photography and a second image acquired by performing the second photography,
wherein the first camera performs photography for one of the front range of the imaging apparatus and the rear range of the imaging apparatus and the second camera performs photography for another of the front range of the imaging apparatus and the rear range of the imaging apparatus, and
wherein the first image corresponds to one of the front range of the imaging apparatus and the rear range of the imaging apparatus and the second image corresponds to another of the front range of the imaging apparatus and the rear range of the imaging apparatus.

18. A non-transitory computer readable medium that stores a program, wherein the program causes a computer to execute a control method of an imaging apparatus including a first camera and a second camera for performing photography using the first camera and the second camera, and for generating a composite image from a plurality of images acquired by the photography, the control method comprising:
acquiring two images by performing a first photography and a second photography, which is performed after performing the first photography;
performing a predetermined notification to request a user to change a user's position from a front range of the imaging apparatus to a rear range of the imaging apparatus or from the rear range of the imaging apparatus to the front range of the imaging apparatus between performing the first photography and performing the second photography; and
generating a composite image having a visual field range of 360 degrees by compositing a first image acquired by performing the first photography and a second image acquired by performing the second photography,
wherein the first camera performs photography for one of the front range of the imaging apparatus and the rear range of the imaging apparatus and the second camera performs photography for another of the front range of the imaging apparatus and the rear range of the imaging apparatus, and
wherein the first image corresponds to one o

Assignees

• Canon Kk

Inventors

• Shibagami Genjiro

Classifications

• H04N23/95

  Computational photography systems, e.g. light-field imaging systems · CPC title

• H04N23/45 Primary

  for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images · CPC title

• H04N23/63

  by using electronic viewfinders · CPC title

• G03B37/00

  Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe · CPC title

• H04N23/90

  Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums · CPC title