Image processing apparatus and method for evaluating objects in an image

Patent metadata

Field	Value
Publication number	US-10311582-B2
Application number	US-201715669169-A
Country	US
Kind code	B2
Filing date	Aug 4, 2017
Priority date	Mar 29, 2010
Publication date	Jun 4, 2019
Grant date	Jun 4, 2019

Abstract

The present disclosure relates to a data processing apparatus and a data processing method capable of generating evaluation index data for performing accurate and detailed evaluation of cultured cardiomyocytes.
A motion detecting unit divides frame image data obtained by photographing the cultured cardiomyocytes for a predetermined time into blocks and obtains motion detection data in units of blocks per each frame period. A feature amount calculating unit calculates a feature amount for each block at the same position in a frame image using the motion detection data. A classification processing unit classifies each of the blocks into any one of a plurality of classification categories using the calculated feature amount. On the basis of the classification result, evaluation index data made of individual classification result data that represent correspondences between the blocks and the classification categories is generated.

First claim

The invention claimed is:

1. A cardiomyocyte evaluation system:
a processor configured to:
detect, from image data of cardiomyocytes obtained over a duration of time, motion corresponding to the cardiomyocytes;
determine, based on the detected motion, a motion amount absolute value at different times within the duration of time; and
control, based on the determined motion amount absolute value at different times, display of a graph representing a temporal change of motion amount absolute value during contraction and relaxation of the cardiomyocytes.

2. The cardiomyocyte evaluation system according to claim 1 , wherein the graph includes a peak in motion amount absolute value associated with contraction or relaxation of a cardiomyocyte.

3. The cardiomyocyte evaluation system according to claim 1 , wherein the graph is indicative of motion of a cardiomyocyte before drug administration and motion of the cardiomyocyte after drug administration.

4. The cardiomyocyte evaluation system according to claim 3 , wherein the graph includes a time series corresponding to contraction and relaxation of the cardiomyocyte before drug administration and a time series corresponding to contraction and relaxation of the cardiomyocyte after drug administration.

5. The cardiomyocyte evaluation system according to claim 3 , wherein the processor is further configured to superimpose on the graph information of the cardiomyocyte before drug administration and information of the cardiomyocyte after drug administration.

6. The cardiomyocyte evaluation system according to claim 1 , wherein the processor is further configured to output information identifying quality of a cardiomyocyte included in the image data.

7. The cardiomyocyte evaluation system according to claim 6 , wherein the processor is further configured to output the information identifying quality of the cardiomyocyte based on a peak in motion amount absolute value associated with contraction or relaxation of the cardiomyocyte.

8. The cardiomyocyte evaluation system according to claim 1 , wherein the processor is further configured to output evaluation information identifying QT elongation associated with the cardiomyocytes.

9. The cardiomyocyte evaluation system according to claim 8 , wherein the processor is further configured to:
determine a first peak in motion amount absolute value associated with contraction or relaxation of a cardiomyocyte before administration of a drug;
determine a second peak in motion amount absolute value associated with contraction or relaxation of the cardiomyocyte after administration of the drug; and
determine the evaluation information identifying QT elongation based on the first peak and the second peak.

10. The cardiomyocyte evaluation system according to claim 1 , wherein the image data comprises phase difference images.

11. The cardiomyocyte evaluation system according to claim 1 , wherein the cardiomyocytes comprise cultured cardiomyocytes.

12. The cardiomyocyte evaluation system according to claim 1 , wherein the motion amount absolute value represents an absolute value of a length of a motion vector associated with motion of a cardiomyocyte.

13. The cardiomyocyte evaluation system according to claim 1 , wherein determining the motion amount absolute value at different times further comprises determining a motion amount absolute value at different times for individual subregions of the image data.

14. The cardiomyocyte evaluation system according to claim 1 , wherein the graph is at least one of a bar chart, a distribution chart, and a schematic chart.

15. The cardiomyocyte evaluation system according to claim 1 , wherein the processor is further configured to:
identify, based on the detected motion, a first peak corresponding to contraction or relaxation of a cardiomyocyte during a first time period;
identify, based on the detected motion, a second peak corresponding to contraction or relaxation of a cardiomyocyte during a second time period different than the first time period; and
determine evaluation information of the cardiomyocytes based on comparing the first peak and the second peak.

16. The cardiomyocyte evaluation system according to claim 15 , wherein identifying the first peak further comprises identifying a first motion amount absolute value for the first peak, identifying the second peak further comprises identifying a second motion amount absolute value for the second peak, and determining evaluation information further comprises comparing the first motion amount absolute value and the second motion amount absolute value.

17. The cardiomyocyte evaluation system according to claim 16 , wherein comparing the first motion amount absolute value and the second motion amount absolute value further comprises determining a difference between the first motion amount absolute value and the second motion amount absolute value.

18. The cardiomyocyte evaluation system according to claim 15 , wherein identifying the first peak further comprises identifying a first time point for the first peak, identifying the second peak further comprises identifying a second time point for the second peak, and determining evaluation information further comprises comparing the first time point and the second time point.

19. A cardiomyocyte evaluation method comprising:
detecting, from image data of cardiomyocytes obtained over a duration of time, motion corresponding to the cardiomyocytes;
determining, based on the detected motion, a motion amount absolute value at different times within the duration of time; and
controlling, based on the determined motion amount absolute value at different times, display of a graph representing a temporal change of motion amount absolute value during contraction and relaxation of the cardiomyocytes.

20. A non-transitory computer-readable storage medium having stored thereon instructions which, when executed by a processor, implement a method comprising:
detecting, from image data of cardiomyocytes obtained over a duration of time, motion corresponding to the cardiomyocytes;
determining, based on the detected motion, a motion amount absolute value at different times within the duration of time; and
controlling, based on the determined motion amount absolute value at different times, display of a graph representing a temporal change of motion amount absolute value during contraction and relaxation of the cardiomyocytes.

Assignees

• Sony Corp

Inventors

• Kunihiro Takeshi
• Uchida Masashi
• Matsui Eriko
• Hayakawa Tomohiro

Classifications

• G06V10/50

  by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis · CPC title

• G06T2207/10056

  Microscopic image · CPC title

• G06T2207/30048

  Heart; Cardiac · CPC title

• G06T2207/20021

  Dividing image into blocks, subimages or windows · CPC title

• G06T7/223 Primary

  using block-matching · CPC title