Image processing device, method, and medium for calculating propagation speed and direction of object pulsations

Patent metadata

Field	Value
Publication number	US-9972097-B2
Application number	US-201414890561-A
Country	US
Kind code	B2
Filing date	Jul 9, 2014
Priority date	Jul 19, 2013
Publication date	May 15, 2018
Grant date	May 15, 2018

Abstract

An image processing device includes a processor to detect motion of objects in an observation area on the basis of a captured image. The processor also calculates amounts of each detected motion, and calculates a propagation speed, a propagation direction, or both, of the motion for pulsations of the objects.

First claim

The invention claimed is:

1. An image processing device comprising:
processor circuitry configured to:
detect motion of objects in an observation area on the basis of a captured image;
calculate amounts of each detected motion;
calculate at least one of a propagation speed and a propagation direction of the motion for pulsations of the objects based on waveform information representing a variation over time of each calculated amount of motion, the propagations speed and the propagation direction for each pulsation being displayed in association with the waveform representing the pulsation; and
calculate a stability of pulsations of the objects based on a weighted sum of at least a distribution value of average propagation speeds, a distribution value of average propagation directions, and a value indicative of a degree to which an average value of the propagation speed is within a predetermined range defined by an upper and a lower threshold, the average propagation speeds and the average propagation directions being determined from the propagation speed and propagation direction of the motion calculated by the processor circuitry.

2. The image processing device according to claim 1 , wherein the object is selected from the group consisting of cultured myocardial cells, non-cultured myocardial cells, or a heart.

3. The image processing device according to claim 1 , wherein the processor circuitry is configured to detect the motion for each of a plurality of partial areas in each frame of a moving image in the observation area, and to generate waveform information representing pulsations of the objects in the respective partial areas on the basis of the amounts of motion for each partial area in a plurality of frames of the moving image.

4. The image processing device according to claim 3 , wherein the processor circuitry is configured to calculate at least one of the propagation speed and the propagation direction for each pulsation by comparing a time corresponding to a feature point set in advance in a waveform of the waveform information in a predetermined partial area with a time corresponding to a feature point set in advance in a waveform of the waveform information in another partial area.

5. The image processing device according to claim 1 , wherein the processor circuitry calculates the stability of pulsations over a plurality of pulsations of the objects in an entire observation area.

6. The image processing device according to claim 5 , wherein at least one of the following is also used in the weighted sum to determine the stability of pulsations:
a smallness of a difference between a maximum value and a minimum value of the propagation direction and the propagation speed of the pulsation.

7. The image processing device according to claim 1 , wherein the processor circuitry is configured to cause a state of the propagation of the pulsation to be displayed on a display.

8. The image processing device according to claim 7 , wherein the processor circuitry is configured to cause the propagation of the pulsation to be displayed as isochrones.

9. The image processing device according to claim 7 , wherein the processor circuitry is configured to cause the propagation of the pulsation to be displayed as a histogram.

10. The image processing device according to claim 7 , wherein the processor circuitry is configured to cause the propagation speed and the propagation direction for each pulsation to be displayed in association with a waveform representing the pulsation.

11. The image processing device according to claim 7 , wherein the processor circuitry is configured to cause a transition over time of an evaluation value evaluating stability of the pulsation to be displayed.

12. The image processing device according to claim 1 , wherein a pulsation of the object includes a contraction and an expansion of said object.

13. An image processing method comprising:
detecting, with circuitry, motion of objects in an observation area on the basis of a captured image;
calculating, with the circuitry, amounts of each detected motion;
calculating, with the circuitry, at least one of a propagation speed and a propagation direction of the motion for pulsations of the objects based on waveform information representing a variation over time of each calculated amount of motion, the propagations speed and the propagation direction for each pulsation being displayed in association with the waveform representing the pulsation; and
calculating, with the circuitry, a stability of pulsations of the objects based on a weighted sum of at least a distribution value of average propagation speeds, a distribution value of average propagation directions, and a value indicative of a degree to which an average value of the propagation speed is within a predetermined range defined by an upper and a lower threshold, the average propagation speeds and the average propagation directions being determined from the propagation speed and propagation direction of the motion calculated.

14. The image processing method according to claim 13 , wherein a pulsation of the object includes a contraction and an expansion of said object.

15. A non-transitory computer readable storage medium storing a computer program for causing a computer to function as an image processing device, the image processing device comprising:
processor circuitry configured to:
detect motion of objects in an observation area on the basis of a captured image;
calculate amounts of each detected motion;
calculate at least one of a propagation speed and a propagation direction of the motion for pulsations of the objects based on waveform information representing a variation over time of each calculated amount of motion, the propagations speed and the propagation direction for each pulsation being displayed in association with the waveform representing the pulsation; and
calculating a stability of pulsations of the objects based on a weighted sum of at least a distribution value of average propagation speeds, a distribution value of average propagation directions, and a value indicative of a degree to which an average value of the propagation speed is within a predetermined range defined by an upper and a lower threshold, the average propagation speeds and the average propagation directions being determined from the propagation speed and propagation direction of the motion calculated.

16. The non-transitory computer readable storage medium according to claim 15 , wherein a pulsation of the object includes a contraction and an expansion of said object.

Assignees

• Sony Corp

Inventors

• Kunihiro Takeshi
• Hayakawa Tomohiro
• Matsui Eriko
• Kobayashi Seiji

Classifications

• G06T2207/30024

  Cell structures in vitro; Tissue sections in vitro · CPC title

• G06T2207/10056

  Microscopic image · CPC title

• G06T7/20 Primary

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title

• G06T2207/20021

  Dividing image into blocks, subimages or windows · CPC title

• G06K9/00127

  Physics · mapped topic