Image processing apparatus and control method of the same

Patent metadata

Field	Value
Publication number	US-2016134809-A1
Application number	US-201514926275-A
Country	US
Kind code	A1
Filing date	Oct 29, 2015
Priority date	Nov 7, 2014
Publication date	May 12, 2016
Grant date	—

Abstract

An image processing apparatus comprises an image obtaining unit configured to obtain an omnidirectional image, a traveling direction obtaining unit configured to obtain information on a traveling direction of an image capturing apparatus when the omnidirectional image was shot, and a processing unit configured to perform processing of panoramic expansion on the omnidirectional image obtained by the image obtaining unit, based on the information on the traveling direction obtained with the traveling direction obtaining unit, such that an image portion corresponding to the traveling direction is positioned at a horizontal center in a panoramically expanded image, wherein the processing unit performs processing of panoramic expansion in accordance with change in the traveling direction in a case where the traveling direction changes while shooting the omnidirectional image that is a moving image.

First claim

What is claimed is:

1 . An image processing apparatus comprising:
an image obtaining unit configured to obtain an omnidirectional image; a traveling direction obtaining unit configured to obtain information on a traveling direction of an image capturing apparatus when the omnidirectional image was shot; and a processing unit configured to perform processing of panoramic expansion on the omnidirectional image obtained by the image obtaining unit, based on the information on the traveling direction obtained with the traveling direction obtaining unit, such that an image portion corresponding to the traveling direction is positioned at a horizontal center in a panoramically expanded image, wherein the processing unit performs processing of panoramic expansion in accordance with change in the traveling direction in a case where the traveling direction changes while shooting the omnidirectional image that is a moving image.

2 . The apparatus according to claim 1 ,
wherein the processing unit performs processing of panoramic expansion in accordance with the traveling direction of the image capturing apparatus, also in a case where a front of the image capturing apparatus that shot the omnidirectional image and the traveling direction do not match.

3 . The apparatus according to claim 1 ,
wherein the processing unit sets a divided position in the omnidirectional image such that the traveling direction of the image capturing apparatus is at a center of the panoramically expanded image.

4 . The apparatus according to claim 3 ,
wherein the divided position is in the rear in the traveling direction of the image capturing apparatus.

5 . The apparatus according to claim 3 ,
wherein the divided position is at two places that are equal in horizontal distance from the traveling direction of the image capturing apparatus in the panoramically expanded image.

6 . The apparatus according to claim 1 ,
wherein the traveling direction obtaining unit obtains information on a traveling direction of the image capturing apparatus from attribute information stored in association with the omnidirectional image.

7 . The apparatus according to claim 1 ,
wherein the traveling direction obtaining unit analyzes the omnidirectional image, and obtains information on a traveling direction of the image capturing apparatus based on a movement of an object in the omnidirectional image.

8 . The apparatus according to claim 1 ,
wherein the traveling direction obtaining unit obtains information on a traveling direction of the image capturing apparatus using a detection unit provided in the image capturing apparatus and configured to detect a traveling direction.

9 . The apparatus according to claim 1 , further comprising:
a sound obtaining unit configured to obtain a sound associated with the omnidirectional image; and a sound processing unit configured to perform processing of sound image localization on the sound obtained by the sound processing unit in conformity with a panoramic expansion range of the omnidirectional image.

10 . The apparatus according to claim 9 ,
wherein the sound processing unit performs processing of sound image localization such that a sound image in the traveling direction of the image capturing apparatus is positioned at a center of a display unit configured to display the panoramically expanded image.

11 . The apparatus according to claim 1 , further comprising:
a display control unit configured to perform control such that the image panoramically expanded by the processing unit is displayed on a display unit.

12 . A control method of an image processing apparatus comprising:
obtaining an omnidirectional image; obtaining information on a traveling direction of an image capturing apparatus when the omnidirectional image was shot; and performing processing of panoramic expansion on the obtained omnidirectional image, based on the obtained information on the traveling direction, such that an image portion corresponding to the traveling direction is positioned at a horizontal center in a panoramically expanded image, wherein processing of panoramic expansion is executed in accordance with change in the traveling direction in a case where the traveling direction changes while shooting the omnidirectional image that is a moving image.

13 . A non-transitory computer-readable storage medium storing a program for causing a computer to function as an image obtaining unit, a traveling direction obtaining unit and a processing unit of an image processing apparatus, wherein the image obtaining unit obtains an omnidirectional image, the traveling direction obtaining unit obtains information on a traveling direction of an image capturing apparatus when the omnidirectional image was shot, and the processing unit performs processing of panoramic expansion on the omnidirectional image obtained by the image obtaining unit, based on the information on the traveling direction obtained with the traveling direction obtaining unit, such that an image portion corresponding to the traveling direction is positioned at a horizontal center in a panoramically expanded image, and wherein the processing unit performs processing of panoramic expansion in accordance with change in the traveling direction in a case where the traveling direction changes while shooting the omnidirectional image that is a moving image.

Assignees

• Canon Kk

Inventors

• Ishikuri Ryuichi

Classifications

• H04N23/631 Primary

  Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters · CPC title

• H04N23/698 Primary

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N5/23238 Primary

  Electricity · mapped topic

• H04N5/2259

  Electricity · mapped topic

• H04N5/23293

  Electricity · mapped topic