Image processing apparatus and method for evaluating objects in an image

Patent metadata

Field	Value
Publication number	US-10692223-B2
Application number	US-201916401494-A
Country	US
Kind code	B2
Filing date	May 2, 2019
Priority date	Mar 29, 2010
Publication date	Jun 23, 2020
Grant date	Jun 23, 2020

Abstract

The present disclosure relates to a data processing apparatus and a data processing method capable of generating evaluation index data for performing accurate and detailed evaluation of cultured cardiomyocytes.
A motion detecting unit divides frame image data obtained by photographing the cultured cardiomyocytes for a predetermined time into blocks and obtains motion detection data in units of blocks per each frame period. A feature amount calculating unit calculates a feature amount for each block at the same position in a frame image using the motion detection data. A classification processing unit classifies each of the blocks into any one of a plurality of classification categories using the calculated feature amount. On the basis of the classification result, evaluation index data made of individual classification result data that represent correspondences between the blocks and the classification categories is generated.

First claim

The invention claimed is:

1. A cardiomyocyte evaluation system comprising:
an imager configured to obtain image data of cardiomyocytes; and
at least one non-transitory computer-readable storage medium having stored thereon instructions which, when executed by a processor, implement a method comprising:
detecting, from the image data of cardiomyocytes, motion corresponding to the cardiomyocytes over a duration of time;
determining, based on the detected motion, a motion amount absolute value for different times within the duration of time; and
controlling, based on a temporal change of the determined motion amount absolute values during contraction and relaxation of the cardiomyocytes, display of information associated with motion of at least one cardiomyocyte before and after drug administration.

2. The cardiomyocyte evaluation system of claim 1 , wherein the information associated with motion of at least one cardiomyocyte indicates a temporal change of at least one feature of the detected motion before and after drug administration.

3. The cardiomyocyte evaluation system of claim 2 , wherein the at least one feature includes a magnitude of at least one pulsation peak of the at least one cardiomyocyte, a time of appearance of the at least one pulsation peak of the at least one cardiomyocyte, a number of pulsation peaks of the at least one cardiomyocyte, and/or a QT elongation associated with the cardiomyocytes.

4. The cardiomyocyte evaluation system of claim 1 , wherein the method further comprises:
identifying, based on the detected motion, a first peak corresponding to contraction or relaxation of one or more cardiomyocytes during a first time period before administration of a drug;
identifying, based on the detected motion, a second peak corresponding to contraction or relaxation of one or more cardiomyocytes during a second time period after administration of the drug; and
determining, based on comparing the first peak and the second peak, at least one feature amount to include in the information associated with motion of at least one cardiomyocyte.

5. The cardiomyocyte evaluation system of claim 4 , wherein identifying the first peak further comprises identifying a first motion absolute value for the first peak, identifying the second peak further comprises identifying a second motion absolute value for the second peak, and determining the at least one feature amount further comprises comparing the first motion absolute value and the second motion absolute value.

6. The cardiomyocyte evaluation system of claim 4 , wherein identifying the first peak further comprises identifying a first time point for the first peak, identifying the second peak further comprises identifying a second time point for the second peak, and determining the at least one feature amount further comprises comparing the first time point and the second time point.

7. The cardiomyocyte evaluation system of claim 6 , wherein comparing the first time point and the second time point further comprises determining a difference between the first time point and the second time point to determine presence of QT elongation.

8. The cardiomyocyte evaluation system of claim 1 , wherein the method further comprises:
identifying a first duration of time prior to a peak corresponding to contraction or relaxation of one or more cardiomyocytes before administration of a drug;
identifying a second duration of time prior to a peak corresponding to contraction or relaxation of one or more cardiomyocytes after administration of the drug; and
determining, based on comparing the first duration of time and the second duration of time, at least one feature amount to include in the information associated with motion of at least one cardiomyocyte.

9. The cardiomyocyte evaluation system of claim 1 , wherein the method further comprises:
identifying, based on the detected motion, a first set of time intervals between successive peaks corresponding to contraction or relaxation of one or more cardiomyocytes before administration of a drug;
identifying, based on the detected motion, a second set of time intervals between successive peaks corresponding to contraction or relaxation of one or more cardiomyocytes after administration of the drug; and
determining, based on comparing the first set of time intervals to the second set of time intervals, at least one feature amount to include in the information associated with motion of at least one cardiomyocyte.

10. The cardiomyocyte evaluation system of claim 1 , wherein the method further comprises determining, based on the detected motion, variation in pulsation time intervals of one or more cardiomyocytes, and wherein the information associated with motion of at least one cardiomyocyte indicates instability of cardiomyocyte pulsations.

11. The cardiomyocyte evaluation system of claim 1 , wherein the method further comprises determining, based on the detected motion, variation in pulsation width of one or more cardiomyocytes, and wherein the information associated with motion of at least one cardiomyocyte indicates instability of cardiomyocyte pulsations.

12. The cardiomyocyte evaluation system of claim 1 , wherein the method further comprises evaluating, based on the information associated with motion of at least one cardiomyocyte, an effect of the drug administration on the cardiomyocytes.

13. The cardiomyocyte evaluation system of claim 1 , wherein the method further comprises outputting information identifying toxicity of a drug administered to the cardiomyocytes.

14. A cardiomyocyte evaluation method comprising:
detecting, from image data of cardiomyocytes, motion corresponding to the cardiomyocytes over a duration of time;
determining, based on the detected motion, a motion amount absolute value for different times within the duration of time; and
controlling, based on a temporal change of the determined motion amount absolute values during contraction and relaxation of the cardiomyocytes, display of information associated with motion of the cardiomyocytes before and after drug administration.

15. The cardiomyocyte evaluation method of claim 14 , wherein the method further comprises evaluating, based on the information associated with motion of at least one cardiomyocyte, an effect of the drug administration on the cardiomyocytes.

16. The cardiomyocyte evaluation method of claim 14 , wherein the method further comprises outputting information identifying toxicity of a drug administered to the cardiomyocytes.

17. A non-transitory computer-readable storage medium having stored thereon instructions which, when executed by a processor, implement a method comprising:
detecting, from image data of cardiomyocytes, motion corresponding to the cardiomyocytes over a duration of time;
determining, based on the detected motion, a motion amount absolute value for different times within the duration of time; and
controlling, based on a temporal change of the determined motion amount absolute values during contraction and relaxation of the cardiomyocytes, display of information associated with motion of at least one cardiomyocyte before and after drug administration.

18. The non-transitory computer-readable storage medium of claim 17 , wherein the method further comprises:
identifying, based on the detected motion, a first peak corresponding to contraction or relaxation of one or more cardiomyocytes before administration of a drug;
identifying, based on the detected motion, a second peak corresponding to contraction or relaxation of one or more cardiomyocyt

Assignees

• Sony Corp

Inventors

• Kunihiro Takeshi
• Uchida Masashi
• Matsui Eriko
• Hayakawa Tomohiro

Classifications

• G06V10/50

  by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis · CPC title

• G06V20/695

  Preprocessing, e.g. image segmentation · CPC title

• G06V40/20

  Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) · CPC title

• G06T7/0016

  involving temporal comparison · CPC title

• G06T2207/10056

  Microscopic image · CPC title