Image processing apparatus and image processing method

Patent metadata

Field	Value
Publication number	US-9697581-B2
Application number	US-201414293190-A
Country	US
Kind code	B2
Filing date	Jun 2, 2014
Priority date	Jun 10, 2013
Publication date	Jul 4, 2017
Grant date	Jul 4, 2017

Abstract

An image processing apparatus includes an image storage unit, a conversion unit, and an output unit. The image storage unit stores therein multiple images with different viewpoint positions. The conversion unit converts each of the images stored in the image storage unit to each of images to be imaged by imaging devices that are arranged such that respective optical axes pass through a dynamically set position in a target object. The output unit outputs the images converted by the conversion unit.

First claim

What is claimed is:

1. An image processing apparatus comprising:
a memory configured to store therein multiple images of a target object with different viewpoint positions, each of the images having an optical axis that passes through a common first three-dimensional position of the object; and
a processor programmed to:
accept an enlargement operation or a reduction operation on a target region in any of the stored images, the target object displayed in the one of the stored images having a first central rotation axis orthogonal to the optical axis, the first central rotation axis passing through the common first three-dimensional position;
estimate a second three-dimensional position of the target object corresponding to a center position of the target region of the accepted enlargement operation or the accepted reduction operation, the estimated second three-dimensional position being different from the first three-dimensional position, a portion of the target object displayed in the display region having a second central rotation axis that passes through the second three-dimensional position of the target object;
respectively convert each of the stored images into each of images that appear to have been imaged by imaging devices that are arranged such that respective optical axes of the converted images pass through the estimated second three-dimensional position, the respective converted images to be displayed sequentially such that the target object displayed in the target region appears to rotate around the second central rotation axis at the second three-dimensional position of the target object; and
output the converted images such that the output converted images are to display the target object on a display in a manner in which the target object appears to rotate around the second central rotation axis at the estimated second three-dimensional position.

2. The image processing apparatus according to claim 1 , wherein the processor is programmed to:
accept an input of the two-dimensional position based on any one of the stored images;
estimate a position of the target object corresponding to the input two-dimensional position; and
perform a conversion process by using the estimated position as the estimated second three-dimensional position.

3. The image processing apparatus according to claim 2 , wherein the processor is programmed to:
accept the enlargement operation of enlarging a target region in any one of the stored images; and
set the estimated center position as the estimated second three-dimensional position.

4. The image processing apparatus according to claim 2 , wherein the processor is programmed to:
accept the reduction operation of reducing a target region in the any of the images; and
set the estimated center position as the estimated second three-dimensional position.

5. The image processing apparatus according to claim 2 , wherein the processor is programmed to:
perform the conversion process by using a projective transformation matrix that is calculated based on the accepted enlargement operation or reduction operation and the estimated second three-dimensional position.

6. The image processing apparatus according to claim 1 , wherein the processor is programmed to:
perform a conversion process, for each of the target objects contained in each of the stored images by using a region of each of the target objects as the accepted enlargement operation or reduction operation.

7. An image processing method implemented by an image processing apparatus, the image processing method comprising:
accessing a memory storing therein multiple images of a target object with different viewpoint positions, each of the images having an optical axis that passes through a common point in space;
accepting an enlargement operation or a reduction operation on a target region in any of the stored images, the target object displayed in the one of the stored images having a first central rotation axis orthogonal to the optical axis, the first central rotation axis passing through the common first three-dimensional position;
estimating a second three-dimensional position of the target object corresponding to a center position of the target region of the accepted enlargement operation or the accepted reduction operation, the estimated second three-dimensional position being different from the first three-dimensional position, a portion of the target object displayed in the display region having a second central rotation axis that passes through the second three-dimensional position of the target object;
respectively converting each of the images into each of images that appear to have been imaged by imaging devices that are arranged such that respective optical axes of the converted images pass through the estimated second three-dimensional position, the respective converted images to be displayed sequentially such that the target object displayed in the target region appears to rotate around the second central rotation axis at the second three-dimensional position of the target object; and
outputting the converted images such that the output converted images are to display the target object on a display in a manner in which the target object appears to rotate around the second central rotation axis at the estimated second three-dimensional position.

8. A non-transitory computer-readable storage medium with an executable program stored thereon, the program causing a computer to perform:
accessing a memory storing therein multiple images of a target object with different viewpoint positions, each of the images having an optical axis that passes through a common first three-dimensional position of the object;
accepting an enlargement operation or a reduction operation on a target region in any of the stored images, the target object displayed in the one of the stored images having a first central rotation axis orthogonal to the optical axis, the first central rotation axis passing through the common first three-dimensional position;
estimating a second three-dimensional position of the target object corresponding to a center position of the target region of the accepted enlargement operation or the accepted reduction operation, the estimated second three-dimensional position being different from the first three-dimensional position, a portion of the target object displayed in the display region having a second central rotation axis that passes through the second three-dimensional position of the target object;
respectively converting each of the images into each of images that appear to have been imaged by imaging devices that are arranged such that respective optical axes of the converted images pass through the estimated second three-dimensional position, the respective converted images to be displayed sequentially such that the target object displayed in the target region appears to rotate around the second central rotation axis at the second three-dimensional position of the target object; and
outputting the converted images such that the output converted images are to display the target object on a display in a manner in which the target object appears to rotate around the second central rotation axis at the estimated second three-dimensional position.

Assignees

• Yahoo Japan Corp

Inventors

• Sakamoto Ryuki

Classifications

• H04N13/117

  the virtual viewpoint locations being selected by the viewers or determined by viewer tracking · CPC title

• H04N21/21805

  enabling multiple viewpoints, e.g. using a plurality of cameras · CPC title

• G06T15/205 Primary

  Image-based rendering · CPC title

• H04N13/0014

  Electricity · mapped topic

• G06T3/0062 Primary

  Physics · mapped topic