Risk based prioritization of display aspects in surgical field view

Patent metadata

Field	Value
Publication number	US-12462439-B2
Application number	US-202217688615-A
Country	US
Kind code	B2
Filing date	Mar 7, 2022
Priority date	Apr 14, 2021
Publication date	Nov 4, 2025
Grant date	Nov 4, 2025

Abstract

A surgical system is for use in a surgical procedure. The surgical system includes a surgical instrument configured to treat tissue in the surgical procedure; an imaging device; a display configured to show a livestream of a surgical field of the surgical procedure, wherein the livestream is captured by the imaging device; and a control module. The control module is configured to detect a surgical risk; assign a display priority to the surgical risk; and determine a display arrangement of the surgical risk based on the display priority, wherein the display arrangement comprises overlaying an alert feature on the livestream.

First claim

What is claimed is:

1 . A surgical device configured to increase a situational awareness of a user during a surgical procedure, the surgical device comprising:
a processor configured to:
obtain a livestream comprising a target tissue in a surgical field;
detect a surgical risk based on a determination that an energy delivery source of the surgical device is activated before a parameter of the target tissue is obtained;
assign a severity level to the surgical risk based on a change associated with the parameter of the target tissue;
generate an alert feature based on the severity level;
based on a condition that the severity level satisfies a threshold, position the alert feature at a location in the livestream that corresponds to a location of the target tissue in the surgical field; and
overlay the alert feature at the location in the livestream that corresponds to the location of the target tissue in the surgical field.

2 . The surgical device of claim 1 , wherein the processor is further configured to:
detect, based on the livestream, a portion of the surgical device proximate to the target tissue in the surgical field; and overlay the alert feature at a second location in the livestream based on the detected portion of the surgical device.

3 . The surgical device of claim 2 , wherein the alert feature positioned at the second location in the livestream does not obstruct a view of the portion of the surgical device.

4 . The surgical device of claim 2 , wherein the alert feature positioned at the second location in the livestream does not obstruct a view of the target tissue.

5 . The surgical device of claim 2 , wherein the processor is further configured to:
detect a user input based on the livestream; and
overlay the alert feature at the second location of the livestream further in response to the user input.

6 . The surgical device of claim 5 , wherein the portion of the surgical device comprises a set of jaws, and wherein the user input comprises:
manipulating the jaws to a closed configuration proximate to the target tissue; and manipulating the jaws to an opened configuration proximate to the second location.

7 . The surgical device of claim 1 , wherein the alert feature positioned at the location in the livestream obstructs a view of the target tissue in the livestream.

8 . The surgical device of claim 1 , wherein the processor is further configured to:
detect a user input based on the livestream; and in response to the user input, remove the alert feature and overlay information associated with the alert feature in the livestream, wherein the information associated with the alert feature comprises an indication of the surgical risk.

9 . The surgical device of claim 1 , wherein the processor is further configured to:
determine a distance between the surgical device and the target tissue, wherein the severity level satisfies the threshold if the distance is less than a threshold distance.

10 . A method for increasing a situational awareness of a user during a surgical procedure, the method comprising:
obtaining a livestream comprising a target tissue in a surgical field; detecting a surgical risk based on a determination that an energy delivery source of a surgical device is activated before a parameter of the target tissue is obtained; assigning a severity level to the surgical risk based on a change associated with the parameter of the target tissue; generating an alert feature based on the severity level; based on a condition that the severity level satisfies a threshold, positioning the alert feature at a location in the livestream that corresponds to a location of the target tissue in the surgical field; and overlaying the alert feature at the location in the livestream that corresponds to the location of the target tissue in the surgical field.

11 . The method of claim 10 , wherein the method further comprises:
detecting, based on the livestream, a portion of the surgical device proximate to the target tissue in the surgical field; and overlaying the alert feature at a second location in the livestream based on the detected portion of the surgical device.

12 . The method of claim 11 , wherein the alert feature positioned at the second location in the livestream does not obstruct a view of the portion of the surgical device.

13 . The method of claim 11 , wherein the alert feature positioned at the second location in the livestream does not obstruct a view of the target tissue.

14 . The method of claim 11 , wherein the method further comprises:
detecting a user input based on the livestream; and overlaying the alert feature at the second location of the livestream further in response to the user input.

15 . The method of claim 14 , wherein the portion of the surgical device comprises a set of jaws, and wherein the user input comprises:
manipulating the jaws to a closed configuration proximate to the target tissue; and manipulating the jaws to an opened configuration proximate to the second location.

16 . The method of claim 10 , wherein the alert feature positioned at the location in the livestream obstructs a view of the target tissue in the livestream.

17 . The method of claim 10 , wherein the method further comprises:
detecting a user input based on the livestream; and in response to the user input, removing the alert feature and overlaying information associated with the alert feature in the livestream, wherein the information associated with the alert feature comprises an indication of the surgical risk.

18 . The method of claim 10 , wherein the method further comprises: determining a distance between the surgical device and the target tissue, wherein the severity level satisfies the threshold if the distance is less than a threshold distance.

Assignees

• Cilag Gmbh Int

Inventors

• Shelton Iv Frederick E
• Worthington Sarah A
• Seow Christopher Q
• Wise Austin E
• Adams Shane R
• Jenkins Scott A
• Schweizer Melissa
• Harris Jason L
• Kimball Cory G
• Rivard Monica L Z
• Rossoni Leonardo N
• Cowperthwait Matthew D
• Kojcev Risto
• Bork Felix J

Classifications

• A61B2034/254

  being adapted depending on the stage of the surgical procedure · CPC title

• A61B2034/252

  indicating steps of a surgical procedure · CPC title

• G06F3/14

  Digital output to display device {; Cooperation and interconnection of the display device with other functional units} · CPC title

• H04W24/10

  Scheduling measurement reports {; Arrangements for measurement reports} · CPC title

• H04W76/14

  Direct-mode setup · CPC title