Image processing apparatus, image processing method, and computer-readable recording medium

Patent metadata

Field	Value
Publication number	US-10275917-B2
Application number	US-201715455677-A
Country	US
Kind code	B2
Filing date	Mar 10, 2017
Priority date	Mar 25, 2016
Publication date	Apr 30, 2019
Grant date	Apr 30, 2019

Abstract

An image processing apparatus includes: a change determination unit configured to determine, using data of a plurality of images captured continuously, whether a change in direction of capturing the plurality of images occurs; a change amount calculation unit configured to calculate a change amount of a position of an object shown in the plurality of images, depending on whether the change in direction of capturing the plurality of images occurs; and an auxiliary image creation unit configured to create data of an auxiliary image for displaying information on the object, the information being related to the change amount.

First claim

What is claimed is:

1. An image processing apparatus for tracking motion of an object relative to a moving reference frame, the apparatus comprising:
an imager that acquires a plurality of images of the object continuously;
a sensor that measures a posture of the imager;
a processor that is communicatively coupled to the imager and the sensor, wherein the processor:
receives the plurality of images of the object from the imager,
determines, using the plurality of images, a change in direction of the object,
detects a changing direction of the imager based on the posture measured by the sensor,
calculates a change amount of a position of the object based on the detected changing direction of the imager; and
creates data of an auxiliary image for displaying information on the object based on the calculated change amount, wherein the auxiliary image contains height information on a representative point of the object at a point in time when the changing direction of the imager stops.

2. The image processing apparatus according to claim 1 , wherein the processor further:
inserts the auxiliary image at timing adjacent to one of the plurality of images when playing back the plurality of images on a display unit.

3. The image processing apparatus according to claim 2 , wherein the processor further:
determines the timing of inserting the auxiliary image during playback of the plurality of images, and
displays the auxiliary image on the display unit based on the determined timing.

4. The image processing apparatus according to claim 2 , wherein the processor further:
creates data of a history image indicating a temporal history of the representative point on the plurality of images, and
displays the history image on the display unit at predetermined timing.

5. The image processing apparatus according to claim 4 , wherein
the history image shows a history of reciprocating motion of the object.

6. The image processing apparatus according to claim 1 , wherein the processor further:
determines whether a position of the object within a screen has changed between different images of the plurality of images, and
calculates the change amount depending on whether the change in direction of capturing the plurality of images occurs and whether the position of the object within the screen has changed.

7. An image processing method for tracking motion of an object relative to a moving reference frame, the method comprising:
receiving a plurality of images of the object from an imager, wherein the imager acquires the plurality of images of the object continuously;
determining, using the plurality of images, a change in direction of the object;
detecting a changing direction of the imager based on a posture measured by a sensor;
calculating a change amount of a position of the object based on the detected changing direction of the imager; and
creating data of an auxiliary image for displaying information on the object, based on the calculated change amount, wherein the auxiliary image contains height information on a representative point of the object at a point in time when the changing direction of the imager stops.

8. A non-transitory computer-readable recording medium that stores an executable image processing program for tracking motion of an object relative to a moving reference frame, the program, when executed by a computer, causes the computer to:
receive a plurality of images of the object from an imager, wherein the imager acquires the plurality of images of the object continuously
determine, using the plurality of images captured continuously, a change in direction of the object;
detect a changing direction of the imager based on a posture measured by a sensor;
calculate a change amount of a position of the object based on the detected changing direction of the imager; and
create data of an auxiliary image for displaying on the object, based on the calculated change amount, wherein the auxiliary image contains height information on a representative point of the object at a point in time when the changing direction of the imager stops.

Assignees

• Olympus Corp

Inventors

• Suzuki Tatsuhiko

Classifications

• H04N5/265

  Mixing · CPC title

• G06T7/73

  using feature-based methods · CPC title

• G06T2207/30241

  Trajectory · CPC title

• G06T2207/30244

  Camera pose · CPC title

• G11B27/031

  Electronic editing of digitised analogue information signals, e.g. audio or video signals · CPC title