Information processing device, information processing method, information processing system, and conversion model

Patent metadata

Field	Value
Publication number	US-2024152692-A1
Application number	US-202218548925-A
Country	US
Kind code	A1
Filing date	Mar 4, 2022
Priority date	Mar 23, 2021
Publication date	May 9, 2024
Grant date	—

Abstract

There is provided an information processing device including a storage unit that stores first annotation data generated from image data of a biological specimen and conversion processing information, a conversion unit that converts, using the conversion processing information, the first annotation data into a plurality of second annotation data incidental to the first annotation data, and an output unit that outputs the first annotation data or the second annotation data.

First claim

1 . An information processing device comprising:
a storage unit that stores first annotation data generated from image data of a biological specimen and conversion processing information; a conversion unit that converts, using the conversion processing information, the first annotation data into a plurality of second annotation data incidental to the first annotation data; and an output unit that outputs the first annotation data or the second annotation data.

2 . The information processing device according to claim 1 , further comprising:
an input unit that receives editing operation on the first annotation data or the second annotation data; and an editing unit that, when the first annotation data or the second annotation data is edited, reflects the editing on remaining annotation data.

3 . The information processing device according to claim 2 , wherein
the storage unit further stores editing processing information concerning the editing, and the editing unit reflects the editing on the remaining annotation data based on the editing processing information.

4 . The information processing device according to claim 1 , wherein
the first annotation data includes point cloud coordinate data, and the conversion unit executes conversion based on a conversion formula for converting the point cloud coordinate data.

5 . The information processing device according to claim 1 , wherein the first annotation data and the second annotation data have different display magnifications.

6 . The information processing device according to claim 5 , wherein the first annotation data has the display magnification lower than the display magnification of the second annotation data.

7 . The information processing device according to claim 6 , wherein the conversion unit performs the conversion into the second annotation data by performing linear expansion processing on the first annotation data using the conversion processing information.

8 . The information processing device according to claim 6 , wherein the conversion unit performs the conversion into each of the second annotation data by performing fitting processing on the first annotation data using the conversion processing information.

9 . The information processing device according to claim 8 , wherein the conversion unit executes, on a predetermined region extracted from the first annotation data, fitting based on a boundary between a foreground and a background, fitting based on a cell membrane, or fitting based on a cell nucleus.

10 . The information processing device according to claim 5 , wherein the storage unit further stores one or a plurality of third annotation data having the display magnification different from the display magnifications of the first and second annotation data.

11 . The information processing device according to claim 1 , wherein the first annotation data and the second annotation data have different display forms.

12 . The information processing device according to claim 11 , wherein one of the first and second annotation data is nucleus segmentation display and another of the first and second annotation data is point cloud display or heat map display.

13 . The information processing device according to claim 1 , wherein the output unit outputs the first annotation data or at least one of the plurality of second annotation data to a display device.

14 . The information processing device according to claim 13 , wherein
the storage unit stores a plurality of the first annotation data, and the output unit connects and outputs a plurality of data among the plurality of first annotation data and the plurality of second annotation data according to a user's operation.

15 . The information processing device according to claim 1 , further comprising a generation unit that generates the first annotation data from the image data.

16 . An information processing device comprising:
a storage unit that stores first annotation data generated from image data and conversion processing information; a conversion unit that converts, using the conversion processing information, the first annotation data into a plurality of second annotation data incidental to the first annotation data; and an output unit that outputs the first annotation data or the second annotation data.

17 . An information processing method comprising:
storing first annotation data generated from image data of a biological specimen and conversion processing information in a storage unit; converting, using the conversion processing information, the first annotation data into a plurality of second annotation data incidental to the first annotation data; and outputting the first annotation data or the second annotation data.

18 . An information processing system comprising:
an information processing device that performs output processing for annotation data generated from image data of a biological specimen; and a program for causing the information processing device to execute the output processing, wherein the information processing device includes: a storage unit that stores first annotation data and conversion processing information; a conversion unit that converts, using the conversion processing information, the first annotation data into a plurality of second annotation data incidental to the first annotation data; and an output unit that outputs the first annotation data or the second annotation data.

19 . A conversion model for causing a computer to function to convert first annotation data generated from image data of a biological specimen into a plurality of second annotation data incidental to the first annotation data,
the computer performing fitting processing on the first annotation data using the conversion model and generating the second annotation data having higher display magnification compared with display magnification of the first annotation data.

Assignees

• Sony Group Corp

Inventors

• Teramoto Toya
• Aisaka Kazuki
• Kunihiro Takeshi
• Danjo Hiroki
• Yamane Kenji

Classifications

• G16H30/40

  for processing medical images, e.g. editing · CPC title

• G06F40/169 Primary

  Annotation, e.g. comment data or footnotes · CPC title

• G06V20/70

  Labelling scene content, e.g. deriving syntactic or semantic representations · CPC title

• G06T11/00 Primary

  Two-dimensional [2D] image generation · CPC title

• G02B21/365

  Control or image processing arrangements for digital or video microscopes (G02B21/361, G02B21/362 take precedence) · CPC title