Virtual checklists for orthopedic surgery

Patent metadata

Field	Value
Publication number	US-12170139-B2
Application number	US-202017117648-A
Country	US
Kind code	B2
Filing date	Dec 10, 2020
Priority date	Jun 19, 2018
Publication date	Dec 17, 2024
Grant date	Dec 17, 2024

Abstract

An extended reality (XR) visualization device worn by an orthopedic surgeon outputs a XR visualization for display. The XR visualization includes a set of one or more virtual checklist items. Each of the one or more virtual checklist items corresponds to an item in a checklist of steps of an orthopedic surgery. Additionally, the XR visualization device detects a command of the orthopedic surgeon to select a virtual checklist item in the set of virtual checklist items. In response to detecting the command, the XR visualization device updates the XR visualization to include additional information regarding a step of the orthopedic surgery corresponding to the selected virtual checklist item.

First claim

What is claimed is:

1. A method comprising:
outputting, by an extended reality (XR) visualization device worn by a first person, an XR visualization for display, the XR visualization including a first virtual checklist item in a checklist of steps of an intraoperative phase of an orthopedic surgery, the first virtual checklist item comprising text describing a first step of the intraoperative phase of the orthopedic surgery;
detecting, by the XR visualization device, a command of the first person to mark the first step of the orthopedic surgery complete; and
based on the command:
storing data indicating that the first step is complete;
receiving, by the XR visualization device, a confirmation that a computing device associated with a second person has received an input from the second person to confirm that the first step is actually complete, wherein the computing device associated with the second person is configured to, in response to the command of the first person to mark the first step complete, prompt the second person to confirm that the first step is actually complete; and
in response to receiving the confirmation, updating, by the XR visualization device, the XR visualization to include a second virtual checklist item in the checklist, the second virtual checklist item comprising text describing a next step of the intraoperative phase of the orthopedic surgery.

2. The method of claim 1 , wherein the command is a second command and the method further comprises:
prior to detecting the second command, detecting, by the XR visualization device, a first command to select the first virtual checklist item; and
based on the first command, updating, by the XR visualization device, the XR visualization to include additional information regarding the first step.

3. The method of claim 1 , wherein the computing device associated with the second person is communicatively coupled to the XR visualization device.

4. The method of claim 1 , wherein the method further comprises updating, by the XR visualization device, the XR visualization to include one or more virtual 3-dimensional objects associated with the first step.

5. The method of claim 4 , wherein the one or more virtual 3-dimensional objects include one or more virtual 3-dimensional models of bones involved with the first step.

6. The method of claim 1 , wherein the first step is specific to a patient.

7. The method of claim 1 , wherein the XR visualization device is a mixed reality (MR) visualization device and the XR visualization is an MR visualization.

8. The method of claim 1 , wherein the orthopedic surgery comprises one of an anatomic total shoulder arthroplasty or a reverse shoulder arthroplasty.

9. The method of claim 1 , wherein the command is a contactless command and the command is performed without the first person touching any solid object.

10. The method of claim 1 , wherein a virtual surgical plan includes information defining the steps of the orthopedic surgery, and the steps of the orthopedic surgery include at least one of preparation of an anatomy of a patient for attachment of a prosthetic to the anatomy of the patient or attachment of the prosthetic to the anatomy of the patient.

11. A system comprising:
an extended reality (XR) visualization device comprising:
a display device configured to output an XR visualization for display to a first person, the XR visualization including a first virtual checklist item in a checklist of steps of an intraoperative phase of an orthopedic surgery, the first virtual checklist item comprising text describing a first step of the intraoperative phase of the orthopedic surgery;
one or more sensors configured to detect a command of the first person to mark the first step complete; and
one or more processing circuits configured to, in response to detecting the command:
store data indicating that the first step is complete;
receive a confirmation that a computing device associated with a second person has received an input from the second person to confirm that the first step is actually complete, wherein the computing device associated with the second person is configured to, in response to the command of the first person to mark the first step complete, prompt the second person to confirm that the first step is actually complete; and
in response to receiving the confirmation, update the XR visualization to include a second virtual checklist item in the checklist, the second virtual checklist item comprising text describing a next step of the intraoperative phase of the orthopedic surgery.

12. The system of claim 11 , wherein:
the command is a second command and the one or more sensors are further configured to detect, prior to detecting the second command, a first command to select the first virtual checklist item, and
the one or more processing circuits are configured to update, based on the first command, the XR visualization to include additional information regarding the first step.

13. The system of claim 11 , wherein the computing device associated with the second person is communicatively coupled to the XR visualization device.

14. The system of claim 11 , wherein the one or more processing circuits of the XR visualization device are configured to update the XR visualization to include one or more virtual 3-dimensional objects associated with the first step.

15. The system of claim 14 , wherein the one or more virtual 3-dimensional objects include one or more virtual 3-dimensional models of bones involved with the first step.

16. The system of claim 11 , wherein the first step is specific to a patient.

17. The system of claim 11 , wherein the XR visualization device is a mixed reality (MR) visualization device and the XR visualization is an MR visualization.

18. The system of claim 11 , wherein the orthopedic surgery comprises one of an anatomic total shoulder arthroplasty or a reverse shoulder arthroplasty.

19. The system of claim 11 , wherein the command is a contactless command and the command is performed without the first person touching any solid object.

20. The system of claim 11 , wherein a virtual surgical plan includes information defining the steps of the orthopedic surgery, and the steps of the orthopedic surgery include at least one of preparation of an anatomy of a patient for attachment of a prosthetic to the anatomy of the patient or attachment of the prosthetic to the anatomy of the patient.

21. A non-transitory computer-readable storage medium having instructions stored thereon that, when executed, cause an extended reality (XR) visualization device worn by a first person to:
output an XR visualization for display, the XR visualization including a first virtual checklist item in a checklist of steps of an intraoperative phase of an orthopedic surgery, the first virtual checklist item comprising text describing a first step of the intraoperative phase of the orthopedic surgery;
detect a command of the first person to mark the first step complete; and
based on the command:
store data indicating that the first step is complete;
receive a confirmation that a computing device associated with a second person has received an input from the second person to confirm that the first step is actually complete, wherein the computing device associated with the second person is configured to, in response to the command of the first person to mark the first step complete, prompt the second person to confirm that the first step is actually complete; and
in resp

Assignees

• Howmedica Osteonics Corp

Inventors

• Chaoui Jean
• Poltaretskyi Sergii
• Morvan Yannick
• Cariou Damien
• Simoes Vincent Abel Maurice

Classifications

• G06N3/09

  Supervised learning · CPC title

• G06N3/0464

  Convolutional networks [CNN, ConvNet] · CPC title

• G06F18/2163

  Partitioning the feature space · CPC title

• A61B34/76

  Manipulators having means for providing feel, e.g. force or tactile feedback · CPC title

• G06F30/20

  Design optimisation, verification or simulation (optimisation, verification or simulation of circuit designs G06F30/30) · CPC title