Display control and image processing of a cell image

Patent metadata

Field	Value
Publication number	US-10311581-B2
Application number	US-201213984672-A
Country	US
Kind code	B2
Filing date	Feb 28, 2012
Priority date	Feb 28, 2011
Publication date	Jun 4, 2019
Grant date	Jun 4, 2019

Abstract

Apparatus and methods for display control and image processing that enable easy and noninvasive observation of an object are described. Display control of a cell image may include generating a motion amount for subregions of the cell image and displaying the motion amount superimposed on the cell image. Image processing of a cell image may include generating a motion amount for subregions of a cell image and evaluating a state of propagation of the motion of the cells.

First claim

The invention claimed is:

1. An image processing apparatus comprising:
a processor configured to:
generate a motion amount absolute value for each subregion of a plurality of non-overlapping subregions for a first image and a second image of a plurality of images, wherein the first image and the second image are images of cells and individual subregions of the plurality of subregions include a portion of the cells, and wherein generating a motion amount absolute value comprises detecting a motion vector for each subregion and determining a magnitude of the motion vector;
identify a first one or more subregions of the plurality of subregions in the first image as having a first motion amount absolute value by analyzing a distribution of the motion amount absolute values for the first image and a second one or more subregions of the plurality of subregions in the second image as having the first motion amount absolute value;
identify a third one or more subregions of the plurality of subregions in the first image as having a second motion amount absolute value by analyzing the distribution of the motion amount absolute values for the first image and a fourth one or more subregions of the plurality of subregions in the second image as having the second motion amount absolute value, wherein the first motion amount absolute value is different than the second motion amount absolute value;
determine a temporal change of a feature of a region having the first motion amount absolute value by comparing the first one or more subregions of the plurality of subregions in the first image to the second one or more subregions of the plurality of subregions in the second image;
determine a temporal change of a feature of a region having the second motion amount absolute value by comparing the third one or more subregions of the plurality of subregions in the first image to the fourth one or more subregions of the plurality of subregions in the second image; and
evaluate a state of propagation of pulsation among at least a portion of the cells based, at least in part, on the temporal change of the feature of the region having the first motion amount absolute value and/or the temporal change of the feature of the region having the second motion amount absolute value.

2. The image processing apparatus according to claim 1 , further comprising a display configured to display an image of a comparison result of the state of propagation of pulsation among at least a portion of the cells with a case where it is certain that the motion of the cells is normal.

3. The image processing apparatus according to claim 1 , wherein determining the temporal change of a feature of a region having the first motion amount absolute value further comprises comparing a size of the first one or more subregions of the plurality of subregions in the first image to a size of the second one or more subregions of the plurality of subregions in the second image.

4. The image processing apparatus according to claim 1 , wherein determining the temporal change of a feature of a region having the first motion amount absolute value further comprises comparing a shape of the first one or more subregions of the plurality of subregions in the first image to a shape of the second one or more subregions of the plurality of subregions in the second image.

5. The image processing apparatus according to claim 1 , wherein determining the temporal change of a feature of a region having the first motion amount absolute value further comprises comparing a position of the first one or more subregions of the plurality of subregions in the first image to a position of the second one or more subregions of the plurality of subregions in the second image.

6. The image processing apparatus according to claim 1 , wherein the processor is configured to evaluate a state of propagation of pulsation by quantitatively evaluating a change of the state of propagation of pulsation among at least a portion of the cells by obtaining a difference of the temporal change of the feature of the region having the first motion amount absolute value and/or the temporal change of the feature of the region having the second motion amount absolute value with the case where it is certain that the motion of the cells is normal, and by evaluating the difference.

7. The image processing apparatus according to claim 6 , wherein the processor is configured to evaluate a state of propagation of pulsation by evaluating a change of a motionless region that does not have motion in the first image and the second image.

8. The image processing apparatus according to claim 6 , wherein the processor is configured to evaluate a state of propagation of pulsation by evaluating a change of a speed of displacement of the region having the first motion amount absolute value and/or the region having the second motion amount absolute value.

9. The image processing apparatus according to claim 6 , wherein the processor is configured to evaluate a state of propagation of pulsation by evaluating a change of a locus of a center of gravity of the region having the first motion amount absolute value and/or the region having the second motion amount absolute value.

10. The image processing apparatus according to claim 6 , wherein the processor is configured to evaluate a state of propagation of pulsation by evaluating a histogram regarding a speed and a direction of motion of the cells in the first image and the second image.

11. An image processing method of an image processing apparatus, the method comprising the steps of:
generating a motion amount absolute value for each subregion of a plurality of non-overlapping subregions for a first image and a second image of a plurality of images, wherein the first image and the second image are images of cells and individual subregions of the plurality of subregions include a portion of the cells, and wherein generating a motion amount absolute value comprises detecting a motion vector for each subregion and determining a magnitude of the motion vector;
identifying a first one or more subregions of the plurality of subregions in the first image as having a first motion amount absolute value by analyzing a distribution of the motion amount absolute values for the first image and a second one or more subregions of the plurality of subregions in the second image as having the first motion amount absolute value;
identifying a third one or more subregions of the plurality of subregions in the first image as having a second motion amount absolute value by analyzing the distribution of the motion amount absolute values for the first image and a fourth one or more subregions of the plurality of subregions in the second image as having the second motion amount absolute value, wherein the first motion amount absolute value is different than the second motion amount absolute value;
determining a temporal change of a feature of a region having the first motion amount absolute value by comparing the first one or more subregions of the plurality of subregions in the first image to the second one or more subregions of the plurality of subregions in the second image;
determining a temporal change of a feature of a region having the second motion amount absolute value by comparing the third one or more subregions of the plurality of subregions in the first image to the fourth one or more subregions of the plurality of subregions in the second image; and
evaluating a state of propagation of pulsation among at least a portion of the cells based, at least in part, on the temporal change of the feature of the region having the first motion amount absolute value and/or the temporal change of the featur

Assignees

• Hayakawa Tomohiro
• Kunihiro Takeshi
• Matsui Eriko
• Sony Corp

Inventors

• Hayakawa Tomohiro
• Kunihiro Takeshi
• Matsui Eriko

Classifications

• G06T7/0016

  involving temporal comparison · CPC title

• G01N33/5014

  for testing toxicity · CPC title

• G06T2207/30024

  Cell structures in vitro; Tissue sections in vitro · CPC title

• G01B11/00

  Measuring arrangements characterised by the use of optical techniques · CPC title

• G01N21/84

  Systems specially adapted for particular applications · CPC title