Information processing device, information processing method, and information processing system

Patent metadata

Field	Value
Publication number	US-10845186-B2
Application number	US-201616080508-A
Country	US
Kind code	B2
Filing date	Dec 29, 2016
Priority date	Mar 9, 2016
Publication date	Nov 24, 2020
Grant date	Nov 24, 2020

Abstract

[Object] To analyze a strain of a biological sample more accurately. [Solution] Provided is an information processing device including: a setting unit configured to set at least one region of interest from one captured image constituting a dynamic image for a biological sample; an analysis object specifying unit configured to specify an analysis object for the at least one region of interest; a detection unit configured to detect a motion of the analysis object in the dynamic image; and an analysis unit configured to analyze a strain of the biological sample related to the at least one region of interest on a basis of the detected motion of the analysis object.

First claim

The invention claimed is:

1. An information processing device, comprising:
a processor configured to:
set at least one region of interest from a first captured image of a dynamic image of a biological sample;
specify an analysis object for the at least one region of interest;
detect a motion of the analysis object in the dynamic image based on the at least one region of interest from the first captured image as a reference for a second captured image of the dynamic image;
analyze a strain of the biological sample related to the at least one region of interest based on the detected motion of the analysis object; and
control display of information related to the strain across a plurality of regions of the biological sample, such that a strength of the strain in a first region of the plurality of regions is visually distinguishable from the strength of the strain in a second region of the plurality of regions.

2. The information processing device according to claim 1 , wherein the processor is further configured to:
specify two measurement points on a contour line of the at least one region of interest, as the analysis object;
detect motions of the two measurement points in the dynamic image; and
analyze the strain based on the motions of the two measurement points.

3. The information processing device according to claim 2 , wherein the processor is further configured to specify arrangement positions of the two measurement points based on a shape of the contour line.

4. The information processing device according to claim 2 , wherein the processor is further configured to specify arrangement positions of the two measurement points based on a change in a shape of the contour line in the dynamic image.

5. The information processing device according to claim 1 , wherein the processor is further configured to:
specify an inside of the at least one region of interest as the analysis object;
detect a motion of the inside of the at least one region of interest in the dynamic image; and
analyze the strain based on the motion of the inside of the at least one region of interest.

6. The information processing device according to claim 5 , wherein the processor is further configured to:
calculate an affine parameter of the motion of the inside of the at least one region of interest; and
analyze the strain based on the affine parameter.

7. The information processing device according to claim 1 , wherein
the processor is further configured to detect a motion of the at least one region of interest, and
a motion detector used for the detection of the motion of the analysis object is different from a motion detector used for detection of the motion of the at least one region of interest.

8. The information processing device according to claim 1 , wherein the processor is configured to analyze the strain based on a temporal change in the motion of the analysis object.

9. The information processing device according to claim 1 , further comprising a display device configured to display the information related to the strain.

10. The information processing device according to claim 9 , wherein the processor is further configured to control a display form of the information related to the strain in accordance with the motion of the analysis object.

11. The information processing device according to claim 10 , wherein the processor is further configured to control the display form of the information related to the strain based on a beat center estimated for the at least one region of interest.

12. The information processing device according to claim 10 , wherein the processor is further configured to control the display form of the information related to the strain in accordance with a change in a shape of a contour line of the at least one region of interest in the dynamic image.

13. The information processing device according to claim 10 , wherein the processor is further configured to control the display form of the information related to the strain based on a magnitude of the motion of the analysis object.

14. The information processing device according to claim 1 , wherein the strain indicates a dynamic characteristic related to contraction or relaxation of the biological sample.

15. The information processing device according to claim 1 , wherein the strain indicates a local dynamic characteristic inside the biological sample.

16. The information processing device according to claim 1 , wherein the processor is further configured to set a region corresponding to the biological sample included in the first captured image as the at least one region of interest.

17. The information processing device according to claim 1 , wherein the biological sample is a biological sample that performs periodic movement.

18. An information processing method, comprising:
setting, by a processor, at least one region of interest from a first captured image of a dynamic image of a biological sample;
specifying, by the processor, an analysis object for the at least one region of interest;
detecting, by the processor, a motion of the analysis object in the dynamic image based on the at least one region of interest from the first captured image as a reference for a second captured image of the dynamic image;
analyzing, by the processor, a strain of the biological sample related to the at least one region of interest based on the detected motion of the analysis object; and
controlling, by the processor, display of information related to the strain across a plurality of regions of the biological sample, such that a strength of the strain in a first region of the plurality of regions is visually distinguishable from the strength of the strain in a second region of the plurality of regions.

19. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:
setting at least one region of interest from a first captured image of a dynamic image of a biological sample;
specifying an analysis object for the at least one region of interest;
detecting a motion of the analysis object in the dynamic image based on the at least one region of interest from the first captured image as a reference for a second captured image of the dynamic image;
analyzing a strain of the biological sample related to the at least one region of interest based on the detected motion of the analysis object; and
controlling display of information related to the strain across a plurality of regions of the biological sample, such that a strength of the strain in a first region of the plurality of regions is visually distinguishable from the strength of the strain in a second region of the plurality of regions.

20. An information processing system, comprising:
an imaging device configured to generate a dynamic image of a biological sample; and
an information processing device configured to:
set at least one region of interest from a first captured image of the dynamic image;
specify an analysis object for the at least one region of interests;
detect a motion of the analysis object in the dynamic image based on the at least one region of interest from the first captured image as a reference for a second captured image of the dynamic image; and
analyze a strain of the biological sample related to the at least one region of interest based on the detected motion of the analysis object; and
control display of information relate

Assignees

• Sony Corp

Inventors

• Watanabe Shinji
• Hayakawa Tomohiro

Classifications

• G01N33/4833 Primary

  of solid biological material, e.g. tissue samples, cell cultures (tissue in vivo A61B5/00; cell suspensions G01N33/48735) · CPC title

• C12M1/34

  Measuring or testing with condition measuring or sensing means, e.g. colony counters · CPC title

• G06T7/20

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title

• G06T7/248

  involving reference images or patches · CPC title

• C12Q1/02

  involving viable microorganisms · CPC title