Medical display system, control device, and control method

Patent metadata

Field	Value
Publication number	US-2022265384-A1
Application number	US-202017597120-A
Country	US
Kind code	A1
Filing date	Jul 3, 2020
Priority date	Jul 5, 2019
Publication date	Aug 25, 2022
Grant date	—

Abstract

The present technology relates to a medical display system, a control device, and a control method to make it possible to present necessary information without disturbing concentration of an operator.
A medical display system according to the present technology includes a control device including an acquisition unit that acquires an operative field image signal generated by a medical imaging device that images an operative field of a patient and a presented information signal generated by a device that includes an external device excluding the medical imaging device and a control unit that generates a display image on the basis of the operative field image signal and the presented information signal, in which the control unit generates the display image by arranging and displaying presented information generated from the presented information signal in an upper region of a display region of the display image, arranging and displaying an operative field image generated on the basis of the operative field image signal in a middle region that has a length equivalent to the upper region in a horizontal direction, and arranging and displaying user interface information used to control the control device in a region on a lower side of the upper region. The present technology is applied to a control device that controls display on a display.

First claim

1 . A medical display system comprising:
a control device including an acquisition unit that acquires an operative field image signal generated by a medical imaging device that images an operative field of a patient and a presented information signal generated by a device that includes an external device excluding the medical imaging device, and a control unit that generates a display image on a basis of the operative field image signal and the presented information signal, wherein the control unit generates the display image by arranging and displaying presented information generated from the presented information signal in an upper region of a display region of the display image, arranging and displaying an operative field image generated on a basis of the operative field image signal in a middle region that has a length equivalent to the upper region in a horizontal direction, and arranging and displaying user interface information used to control the control device in a region on a lower side of the upper region.

2 . The medical display system according to claim 1 , wherein
the presented information includes at least monitoring information generated from a monitoring information signal acquired from a monitoring device that monitors biological information of the patient.

3 . The medical display system according to claim 2 , wherein
the control unit arranges the presented information in a predetermined display form including a text or a graph.

4 . The medical display system according to claim 2 , wherein
the presented information includes information regarding surgical instruments.

5 . The medical display system according to claim 2 , wherein
the presented information includes information regarding a time.

6 . The medical display system according to claim 2 , wherein
the presented information includes information that changes in real time.

7 . The medical display system according to claim 1 , wherein
the operative field image includes an image that changes in real time.

8 . The medical display system according to claim 1 , wherein
the region on the lower side of the upper region includes a lower region that has a length equivalent to the upper region in the horizontal direction, and the control unit arranges the user interface information in the lower region.

9 . The medical display system according to claim 1 , wherein
the region on the lower side of the upper region includes a region that has a length different from the upper region in the horizontal direction and includes a left and right portion region corresponding to at least one of regions at a left end or a right end of the middle region, and the control unit arranges the user interface information in the left and right portion region.

10 . The medical display system according to claim 2 , wherein
the control unit changes a method for displaying the presented information arranged in the upper region on a basis of information regarding a user.

11 . The medical display system according to claim 10 , wherein
the information regarding the user includes information regarding a user's line-of-sight or information according to an operation or a behavior by the user.

12 . The medical display system according to claim 1 , wherein
the control unit arranges one or a plurality of captured images generated by another medical imaging device different from the medical imaging device in the region on the lower side of the upper region.

13 . The medical display system according to claim 12 , wherein
the control unit arranges a thumbnail image corresponding to a reference image that is a captured image for reference, aligns and arranges a plurality of reference images corresponding to the selected thumbnail image in a predetermined direction in a case where the thumbnail image is selected, and arranges a reference image obtained by enlarging the selected reference image in a case where a desired reference image is selected from among the plurality of reference images.

14 . The medical display system according to claim 1 , wherein
the control unit arranges a direction indicator used to change a display range of the operative field image in the region on the lower side of the upper region.

15 . The medical display system according to claim 1 , wherein
the control unit specifies a work concentration region in the operative field image on which a user's line-of-sight is concentrated, and determines an arrangement position of information to be superimposed on the operative field image on a basis of the specified work concentration region.

16 . The medical display system according to claim 15 , wherein
the control unit determines the arrangement position so that an alert or information for reference is arranged in a region excluding the work concentration region.

17 . The medical display system according to claim 1 , wherein
the control unit detects a user's line-of-sight with respect to the middle region, and executes line-of-sight region corresponding processing regarding a line-of-sight region according to the detected line-of-sight.

18 . The medical display system according to claim 17 , wherein
in a case where a selection target exists in the line-of-sight region, the line-of-sight region corresponding processing includes processing for selecting the selection target according to voice of the user, processing for marking at a position indicated by the line-of-sight region according to the voice of the user, and processing for focusing on the selection target in the line-of-sight region.

19 . A control device comprising:
an acquisition unit configured to acquire an operative field image signal generated by a medical imaging device that images an operative field of a patient and a presented information signal generated by a device that includes an external device excluding the medical imaging device; and a control unit configured to generate a display image on a basis of the operative field image signal and the presented information signal, wherein the control unit generates the display image by arranging and displaying presented information generated from the presented information signal in an upper region of a display region of the display image, arranging and displaying an operative field image generated on a basis of the operative field image signal in a middle region that has a length equivalent to the upper region in a horizontal direction, and arranging and displaying user interface information used to control a control device in a region on a lower side of the upper region.

20 . A control method by a control device, comprising:
acquiring an operative field image signal generated by a medical imaging device that images an operative field of a patient and a presented information signal generated by a device that includes an external device excluding the medical imaging device; generating a display image on the basis of the operative field image signal and the presented information signal; and generating the display image by arranging and displaying presented information generated from the presented information signal in an upper region of a display region of the display image, arranging and displaying an operative field image generated on the basis of the operative field image signal in a middle region that has a length equivalent to the upper region in a horizontal direction, and arranging and displaying user interface information used to control a control device in a region on a lower

Assignees

• Sony Group Corp

Inventors

• Matsuura Kana
• Yoshioka Keiichi
• Takahashi Kazuma
• Watanabe Shoji

Classifications

• H04N23/60

  Control of cameras or camera modules · CPC title

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G06F2203/04806

  Zoom, i.e. interaction techniques or interactors for controlling the zooming operation · CPC title

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• G06F2203/04803

  Split screen, i.e. subdividing the display area or the window area into separate subareas · CPC title