Image generation apparatus and image generation method

Patent metadata

Field	Value
Publication number	US-9894272-B2
Application number	US-201114354680-A
Country	US
Kind code	B2
Filing date	Nov 7, 2011
Priority date	Nov 7, 2011
Publication date	Feb 13, 2018
Grant date	Feb 13, 2018

Abstract

A posture detection unit detects posture information of three axes of portable equipment using at least one of a three-axis gyro sensor, a three-axis acceleration sensor and a three-axis geomagnetic sensor built in the portable equipment. A pan angle-elevation angle calculation unit calculates a pan angle and an elevation angle of a camera built in the portable equipment based on the posture information detected by the posture detection unit. A component image generation unit generates a component image in which the pan angle and the elevation angle calculated by the pan angle-elevation angle calculation unit are associated with an image picked up using the camera built in the portable equipment. A panoramic image generation unit combines a plurality of component images having pan angles or elevation angles different from each other to generate a synthesis image.

First claim

The invention claimed is:

1. An image generation apparatus, comprising:
a posture detection unit configured to detect posture information of three axes of portable equipment, the posture information including a plurality of three-axis inclinations of the portable equipment during capture of a plurality of sequential images captured using a camera built in the portable equipment;
a pan angle-elevation angle calculation unit configured to calculate a pan angle and an elevation angle of the camera built in the portable equipment based on the posture information detected by the posture detection unit;
a component image generation unit configured to generate a plurality of component images from the plurality of sequential images picked up using the camera built in the portable equipment, where each of the plurality of component images have a different pan angle or elevation angle relating to the respective sequential image, and the component image generation unit facilitating storing the respective posture information and the respective sequential images in association with one another in a recording medium;
a synthesis image generation unit configured to combine the plurality of component images having pan angles or elevation angles different from each other to generate a panoramic image;
a non-image pickup region decision unit configured to decide a non-image pickup region of a synthesis image based on the posture information detected by the posture detection unit; and
an image pickup guide portion configured to guide a user so as to pick up an image of the non-image pickup region decided by the non-image pickup region decision unit.

2. The image generation apparatus according to claim 1 , further comprising
an orientation detection unit configured to detect an orientation vector which is a horizontal component of a geomagnetic vector;
the pan angle-elevation angle calculation unit associating, based on orientation information detected by the orientation detection unit, a pan angle of the camera with an absolute orientation to calculate an orientation angle;
the component image generation unit associating the orientation angle with an image picked up using the camera built in the portable equipment.

3. The image generation apparatus according to claim 1 , wherein the posture detection unit detects the posture information of three axes inclinations of the portable equipment using at least one of a three-axis gyro sensor, a three-axis acceleration sensor and a three-axis geomagnetic sensor built in the portable equipment.

4. The image generation apparatus according to claim 2 , wherein the posture detection unit detects the posture information of three axes inclinations of the portable equipment using at least one of a three-axis gyro sensor and a three-axis acceleration sensor built in the portable equipment; and
the orientation detection unit detects an orientation vector which is a horizontal component of a geomagnetic vector based on a gravity vector detected by at least one of the three-axis gyro sensor and the three-axis acceleration sensor and a geomagnetic vector detected by a three-axis geomagnetic sensor built in the portable equipment.

5. The image generation apparatus according to claim 1 , wherein the image pickup guide portion guides the user so as to pick up a component image changing the elevation angle with the pan angle of the camera kept fixed and then guides, after the pickup of a component image with the elevation angle changed is completed, the user so as to change the pan angle of the camera.

6. The image generation apparatus according to claim 1 , further comprising an image pickup timing decision unit configured to decide an image pickup timing by the camera based on at least one of results of a movement detection of the camera based on the posture information detected by the posture detection unit and moving body detection based on an inter-frame difference of an image picked up by the camera.

7. An image generation method, comprising:
detecting posture information of three axes of portable equipment, the posture information including a plurality of three-axis inclinations of the portable equipment during capture of a plurality of sequential images captured using a camera built in the portable equipment;
calculating a pan angle and an elevation angle of the camera built in the portable equipment based on the posture information detected at the posture detection step;
generating a plurality of component images from the plurality of sequential images picked up using the camera built in the portable equipment, where each of the plurality of component images have a different pan angle or elevation angle relating to the respective sequential image, and the component image generation step includes facilitating storing the respective posture information and the respective sequential images in association with one another in a recording medium;
combining the plurality of component images having pan angles or elevation angles different from each other to generate a panoramic image;
deciding on a non-image pickup region of a synthesis image based on the posture information detected by the posture detection unit; and
guiding a user so as to pick up an image of the non-image pickup region of the deciding step.

8. A non-transitory, computer-readable recording medium storing a program, the program, when executed by a computer, causing the computer to carry out actions, comprising:
detecting posture information of three axes of portable equipment, the posture information including a plurality of three-axis inclinations of the portable equipment during capture of a plurality of sequential images captured using a camera built in the portable equipment;
calculating a pan angle and an elevation angle of the camera built in the portable equipment based on the posture information detected by the posture detection function;
generating a plurality of component images from the plurality of sequential images picked up using the camera built in the portable equipment, where each of the plurality of component images have a different pan angle or elevation angle relating to the respective sequential image, and the component image generation function includes facilitating storing the respective posture information and the respective sequential images in association with one another in a recording medium; and
combining the plurality of component images having pan angles or elevation angles different from each other to generate a panoramic image;
deciding on a non-image pickup region of a synthesis image based on the posture information detected by the posture detection unit; and
guiding a user so as to pick up an image of the non-image pickup region of the deciding action.

Assignees

• Furumura Kyoko
• Hirata Shinichi
• Yamagishi Takeshi
• Sony Interactive Entertainment Inc

Inventors

• Furumura Kyoko
• Hirata Shinichi
• Yamagishi Takeshi

Classifications

• H04N23/698 Primary

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N23/951

  by using two or more images to influence resolution, frame rate or aspect ratio · CPC title

• G03B37/00 Primary

  Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe · CPC title

• G03B17/18

  Signals indicating condition of a camera member or suitability of light (indicating depth of field G03B13/30) · CPC title

• H04N5/23238 Primary

  Electricity · mapped topic