Image processing apparatus and method for evaluating objects in an image

Patent metadata

Field	Value
Publication number	US-9786052-B2
Application number	US-201113637233-A
Country	US
Kind code	B2
Filing date	Feb 28, 2011
Priority date	Mar 29, 2010
Publication date	Oct 10, 2017
Grant date	Oct 10, 2017

Abstract

Apparatus and methods for image processing capable of generating evaluation index data for performing accurate and detailed evaluation of cultured cardiomyocytes are described. A motion detecting unit divides frame image data obtained by photographing the cultured cardiomyocytes for a predetermined time into blocks and obtains motion detection data in units of blocks per each frame period. A feature amount calculating unit calculates a feature amount for each block at the same position in a frame image using the motion detection data. A classification processing unit classifies each of the blocks into any one of a plurality of classification categories using the calculated feature amount. On the basis of the classification result, evaluation index data made of individual classification result data that represent correspondences between the blocks and the classification categories is generated.

First claim

The invention claimed is:

1. A data processing apparatus comprising:
a processor configured to:
receive an image of biological cells having a plurality of blocks, wherein a block of the plurality of blocks includes a group of pixels in the image;
determine an average motion amount of at least one biological cell in a first block of the plurality of blocks;
determine an average motion direction of at least on biological cell in the first block;
assign a category to the first block based on the determined average motion amount and the determined average motion direction, wherein the category is one of a plurality of categories individually associated with different combinations of numerical ranges for average motion amounts and average motion directions;
determine a distribution of the plurality of blocks among the plurality of categories, wherein the distribution provides an indication of a quality level of the biological cells and the quality level is based on a number of blocks of the plurality of blocks assigned to individual categories of the plurality of categories; and
control display of an image representing which category of the plurality of categories is assigned to individual blocks of the plurality of blocks, wherein the image illustrates a degree of uniformity of the motion amount and motion direction of the biological cells in the image.

2. The data processing apparatus according to claim 1 ,
wherein determining the average motion amount of at least one biological cell in the first block is based on analyzing motion of the at least one biological cell in the first block for two or more images.

3. The data processing apparatus according to claim 1 , wherein the average motion direction is an average value of motion directions per unit time within a predetermined time.

4. The data processing apparatus according to claim 1 ,
wherein the average motion amount of the at least one biological cell in the first block is an average value of motion amounts per unit time within a predetermined time.

5. The data processing apparatus according to claim 1 ,
wherein the processor is further configured to determine an average amplitude of the at least one biological cell in the first block, wherein the average amplitude is an average value of amplitudes with a predetermined motion amount or higher motion amount obtained within a predetermined time.

6. The data processing apparatus according to claim 1 ,
wherein the processor is further configured to determine an average acceleration of the at least one biological cell in the first block, wherein the average acceleration is an average value of accelerations of motions per unit time within a predetermined time.

7. The data processing apparatus according to claim 1 ,
wherein the processor is further configured to determine an average motion interval of the at least one biological cell in the first block, wherein the average motion interval is an average value of time intervals at which an amplitude with a predetermined motion amount or higher motion amount is obtained within a predetermined time.

8. The data processing apparatus according to claim 1 ,
wherein the processor is further configured to determine a motion starting time of the at least one biological cell in the first block, wherein the motion starting time is a time from a predetermined timing to a timing at which an amplitude with a predetermined motion amount or higher motion amount is obtained.

9. The data processing apparatus according to claim 1 , wherein the average motion amount of at least one biological cell in the first block is calculated based on a motion vector for the first block.

10. The data processing apparatus according to claim 1 , wherein the image is a frame image obtained from a moving image.

11. The data processing apparatus according to claim 1 , wherein the at least one biological cell comprises a cell that moves spontaneously.

12. The data processing apparatus according to claim 11 , wherein the at least one biological cell comprises a cultured cell generated by culturing the cell collected from a living body.

13. The data processing apparatus according to claim 12 , wherein the at least one biological cell comprises at least one cardiomyocyte.

14. The data processing apparatus according to claim 1 , wherein controlling display of the image includes displaying classification data for the first block.

15. A data processing method comprising:
receiving an image of biological cells having a plurality of blocks, wherein a block of the plurality of blocks includes a group of pixels in the image;
determining an average motion amount of at least one biological cell in a first block of the plurality of blocks;
determining an average motion direction of at least one biological cell in the first block;
assigning a category to the first block based on the determined average motion amount and the determined average motion direction, wherein the category is one of a plurality of categories individually associated with different combinations of numerical ranges for average motion amounts and average motion directions;
determining a distribution of the plurality of blocks among the plurality of categories, wherein the distribution provides an indication of a quality level of the biological cells and the quality level is based on a number of blocks of the plurality of blocks assigned to individual categories of the plurality of categories; and
controlling display of an image representing which category of the plurality of categories is assigned to individual blocks of the plurality of blocks, wherein the image illustrates a degree of uniformity of the motion amount and motion direction of the biological cells in the image.

16. A data processing system comprising:
an imager that images an image of biological cells;
a processor configured to:
receive the image of biological cells having a plurality of blocks, wherein a block of the plurality of blocks includes a group of pixels in the image;
determine an average motion amount of at least one biological cell in a first block of the plurality of blocks;
determine an average motion direction of at least one biological cell in the first block;
assign a category to the first block based on the determined average motion amount and the determined average motion direction, wherein the category is one of a plurality of categories individually associated with different combinations of numerical ranges for average motion amounts and average motion direction;
determine a distribution of the plurality of blocks among the plurality of categories, wherein the distribution provides an indication of a quality level of the biological cells and the quality level is based on a number of blocks of the plurality of blocks assigned to individual categories of the plurality of categories; and
control display of an image representing which category of the plurality of categories is assigned to individual blocks of the plurality of blocks, wherein the image illustrates a degree of uniformity of the motion amount and motion direction of the biological cells in the image.

Assignees

• Kunihiro Takeshi
• Uchida Masashi
• Matsui Eriko
• Hayakawa Tomohiro
• Sony Corp

Inventors

• Kunihiro Takeshi
• Uchida Masashi
• Matsui Eriko
• Hayakawa Tomohiro

Classifications

• G06V10/50

  by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis · CPC title

• G06T2207/10056

  Microscopic image · CPC title

• G06T2207/20021

  Dividing image into blocks, subimages or windows · CPC title

• G06T2207/30048

  Heart; Cardiac · CPC title

• G06T2207/30024

  Cell structures in vitro; Tissue sections in vitro · CPC title