Image processing device and method, recording medium and program

Patent metadata

Field	Value
Publication number	US-9224209-B2
Application number	US-201213594382-A
Country	US
Kind code	B2
Filing date	Aug 24, 2012
Priority date	Aug 31, 2011
Publication date	Dec 29, 2015
Grant date	Dec 29, 2015

Abstract

There is provided an image processing device including a motion vector detection portion that performs comparison of a substantially spherical photographic subject such that, among a plurality of captured images including the photographic subject, an image as a processing target and another image as a comparison target are compared using each of the plurality of captured images as the processing target, and which detects a motion vector of a whole three-dimensional spherical model with respect to the processing target, a motion compensation portion that performs motion compensation on the processing target, based on the motion vector of each of the plurality of captured images that is detected by the motion vector detection portion, and a synthesis portion that synthesizes each of the captured images that are obtained as a result of the motion compensation performed by the motion compensation portion.

First claim

What is claimed is:

1. An image processing device comprising:
one or more processors configured to:
compare a substantially spherical photographic subject such that, among a plurality of captured images including the photographic subject, an image as a processing target and another image as a comparison target are compared using each of the plurality of captured images as the processing target, and detect a motion vector of a whole three-dimensional spherical model with respect to the processing target;
perform motion compensation on the processing target, based on the detected motion vector of each of the plurality of captured images; and
synthesize each of the captured images that are obtained as a result of the motion compensation.

2. The image processing device according to claim 1 , wherein the one or more processors are further configured to:
perform block matching with the comparison target:
detect a local motion vector with respect to each of a plurality of blocks that are divided up from the processing target based on the performed block matching with the comparison target; and
detect the motion vector of the whole three-dimensional spherical model with respect to the processing target, based on the detected local motion vector of each of the plurality of blocks.

3. The image processing device according to claim 2 , wherein the one or more processors are further configured to:
convert the local motion vector with respect to each of the plurality of blocks in the processing target into a local spherical motion vector in the three-dimensional spherical model; and
detect the motion vector of the whole three-dimensional spherical model with respect to the processing target, based on the local spherical motion vector of each of the plurality of blocks.

4. The image processing device according to claim 2 , wherein the one or more processors are further configured to:
convert each of the plurality of blocks in the processing target into a plurality of spherical blocks in the three-dimensional spherical model;
detect a local spherical motion vector, as the local motion vector, with respect to each of the plurality of spherical blocks, based on the performed block matching with the comparison target; and
the motion vector of the whole three-dimensional spherical model with respect to the processing target, based on the local spherical motion vector of each of the plurality of spherical blocks.

5. The image processing device according to claim 1 , wherein the one or more processors are further configured to:
convert each of the processing target and the comparison target into a spherical image in the three-dimensional spherical model; and
perform matching between the spherical image of the processing target and the spherical image of the comparison target, and detect the motion vector of the whole three-dimensional spherical model with respect to the processing target.

6. The image processing device according to claim 1 ,
wherein the photographic subject is a fundus oculi.

7. The image processing device according to claim 6 ,
wherein the three-dimensional spherical model is switched and used in accordance with conditions of the photographic subject.

8. An image processing method comprising:
performing comparison of a substantially spherical photographic subject such that, among a plurality of captured images including the photographic subject, an image as a processing target and another image as a comparison target are compared using each of the plurality of captured images as the processing target, and detecting a motion vector of a whole three-dimensional spherical model with respect to the processing target;
performing motion compensation on the processing target, based on the motion vector of each of the plurality of captured images that is detected by processing of the motion vector detecting step; and
synthesizing each of the captured images that are obtained as a result of the motion compensation performed by processing of the motion compensating step.

9. A non-transitory computer-readable storage medium having stored thereon, a set of computer-executable instructions for causing a computer to perform steps comprising:
performing comparison of a substantially spherical photographic subject such that, among a plurality of captured images including the photographic subject, an image as a processing target and another image as a comparison target are compared using each of the plurality of captured images as the processing target, and detecting a motion vector of a whole three-dimensional spherical model with respect to the processing target;
performing motion compensation on the processing target based on the motion vector of each of the plurality of captured images; and
synthesizing each of the captured images that are obtained as a result of the motion compensation.

Assignees

• Aisaka Kazuki
• Ootsuki Tomoyuki
• Kobayashi Seiji
• Sony Corp

Inventors

• Aisaka Kazuki
• Ootsuki Tomoyuki
• Kobayashi Seiji

Classifications

• G06T7/223 Primary

  using block-matching · CPC title

• G06T2207/30041

  Eye; Retina; Ophthalmic · CPC title

• G06T7/20 Primary

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title

• G06K9/00208

  Physics · mapped topic

• G06T7/2013

  Physics · mapped topic