Microscope device, image acquisition system, and image acquisition method

Patent metadata

Field	Value
Publication number	US-2023095577-A1
Application number	US-202117905189-A
Country	US
Kind code	A1
Filing date	Feb 15, 2021
Priority date	Mar 5, 2020
Publication date	Mar 30, 2023
Grant date	—

Abstract

To provide a microscope device capable of efficiently or appropriately acquiring an image of a specific region of a living tissue.The present technology provides a microscope device including: a first imaging element that images a target including a body tissue and acquires image data; and a second imaging element that images the target at a magnification different from a magnification of the first imaging element and acquires image data, in which the first imaging element includes a determination unit that determines a feature related to the target on the basis of the image data, and the second imaging element is controlled on the basis of a result of the determination. Furthermore, the present technology also provides an image acquisition system including the microscope device. Furthermore, the present technology also provides an image acquisition method performed in the microscope device.

First claim

1 . A microscope device comprising:
a first imaging element that images a target including a living tissue and acquires image data; and a second imaging element that images the target at a magnification different from a magnification of the first imaging element and acquires image data, wherein the first imaging element includes a determination unit that determines a feature related to the target on a basis of the image data, and the second imaging element is controlled on a basis of a result of the determination.

2 . The microscope device according to claim 1 , wherein the second imaging element further divides the imaged region into a plurality of regions, images at least one of the plurality of regions, and acquires image data.

3 . The microscope device according to claim 1 , wherein the first imaging element is an imaging element in which the determination unit and an imaging section that performs imaging are arranged in a single chip.

4 . The microscope device according to claim 1 , wherein the second imaging element images each of the plurality of regions at a higher magnification than the first imaging element.

5 . The microscope device according to claim 1 , wherein the image data is bright-field image data and/or fluorescence image data.

6 . The microscope device according to claim 1 , wherein the image data is an image signal including a luminance value and/or a frequency.

7 . The microscope device according to claim 1 , wherein the feature related to the target includes a feature related to an attribute of the target.

8 . The microscope device according to claim 7 , wherein the feature related to the attribute of the target includes one or more selected from a feature related to an attribute of the living tissue, a feature related to an autofluorescence component, and a feature related to a lesion in the living tissue.

9 . The microscope device according to claim 1 , wherein the feature related to the target includes a feature related to a region of the target.

10 . The microscope device according to claim 9 , wherein the feature related to the region of the target includes one or more selected from a feature related to a lesion region in the living tissue and a feature related to a foreign substance in the target.

11 . The microscope device according to claim 1 , wherein the determination unit performs the determination using a learned model.

12 . The microscope device according to claim 1 , further comprising: a control unit that performs imaging control of the target by the second imaging element or control of processing of an image obtained by the second imaging element, on a basis of a result of determination by the determination unit.

13 . The microscope device according to claim 12 , wherein the control unit further includes an imaging sequence control unit that controls an imaging order on a basis of a feature related to a region of the target.

14 . The microscope device according to claim 13 , wherein
the imaging sequence control unit performs imaging control such that a joint of a plurality of regions does not overlap a region of interest in the target, or performs imaging control such that the region of interest in the target is imaged a plurality of times.

15 . The microscope device according to claim 12 , wherein the control unit further includes an exposure control unit that controls a gain and/or an exposure time.

16 . The microscope device according to claim 15 , wherein the exposure control unit controls the gain and/or the exposure time in units of pixels and/or in units of wavelengths.

17 . The microscope device according to claim 12 , wherein the control unit further includes a light amount control unit that controls a light amount of a light source.

18 . The microscope device according to claim 12 , wherein processing of the image includes fluorescence separation processing.

19 . An image acquisition system comprising:
a microscope device including a first imaging element that images a target including a living tissue and acquires image data, and a second imaging element that images the target at a magnification different from a magnification of the first imaging element and acquires image data, the first imaging element further including a determination unit that determines a feature related to the target on a basis of the image data, the second imaging element being controlled on a basis of a result of the determination; and a control unit that performs imaging control of the target by the second imaging element or control of processing of an image obtained by the second imaging element on a basis of a result of the determination.

20 . An image acquisition method comprising:
a first imaging process of imaging a target including a living tissue and acquiring image data by a first imaging element; a determination process of determining a feature related to the target based on the image data, performed by a determination unit included in the first imaging element; and a second imaging process of imaging the target at a magnification different from a magnification of the first imaging element and acquiring image data, wherein the second imaging element is controlled on a basis of a result of the determination.

Assignees

• Sony Group Corp

Inventors

• Tatsuta Hirokazu
• Nakamura Tomohiko
• Watanabe Shinji
• Yamane Kenji
• Soma Yoshio

Classifications

• G01N2021/6439

  with indicators, stains, dyes, tags, labels, marks · CPC title

• G01N2021/6421

  Measuring at two or more wavelengths · CPC title

• G01N21/6458

  Fluorescence microscopy (fluorescence microscopes per se G02B21/0076 and G02B21/16) · CPC title

• G01N2021/6419

  Excitation at two or more wavelengths · CPC title

• G06V10/44 Primary

  Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components · CPC title