Methods for arthroscopic video analysis and devices therefor

Patent metadata

Field	Value
Publication number	US-12488588-B2
Application number	US-202418754972-A
Country	US
Kind code	B2
Filing date	Jun 26, 2024
Priority date	Feb 20, 2020
Publication date	Dec 2, 2025
Grant date	Dec 2, 2025

Abstract

Methods, non-transitory computer readable media, and arthroscopic video analysis apparatuses and systems that facilitate improved analysis of videos of arthroscopic procedures are disclosed. With this technology, analytical data related to the video feed of an arthroscopic surgery can be obtained using machine learning models and associated with the video feed. The generated videos can be output in real-time to provide contextual information related to the surgical procedure, or can be saved for playback for training or informational purposes.

First claim

What is claimed is:

1 . A method for analyzing surgical video data, the method comprising:
receiving, by one or more processor, arthroscopic video data for a surgical procedure from a camera, wherein the arthroscopic video data comprises a field of view of an anatomical region; generating and providing, by the one or more processor using the arthroscopic video data, a first video data stream and a second video data stream; and during the providing, by the one or more processor, of the first video data stream and the second video data stream:
generating, by the one or more processor, analytical information related to the anatomical region based at least on an application of one or more machine learning models to the second video data stream;
generating, by the one or more processor using the analytical information, at least one bitmask corresponding to a respective anatomical structure, pathology, defect, or measurement, at a respective anatomical position; and
processing, by the one or more processor, content of the first video data stream using the at least one bitmask to produce a processed first video data stream.

2 . The method of claim 1 , wherein processing, by the one or more processor, content of the first video data stream using the at least one bitmask comprises:
applying at least one enhancement to the first video data stream based on the at least one bitmask.

3 . The method of claim 2 , wherein applying the at least one enhancement to the first video data stream comprises highlighting or emphasizing the respective anatomical structure, pathology, or defect in the first video data stream.

4 . The method of claim 3 , wherein the respective anatomical structure, pathology, or defect is selected from the group consisting of: a joint, a vasculature, and cartilage damage.

5 . The method of claim 1 , further comprising:
displaying, by the one or more processor on a video display device, the processed first video data stream.

6 . The method of claim 1 , further comprising:
during the providing, by the one or more processor, of the first video data stream and the second video data stream:
displaying, by the one or more processor on a video display device, the processed first video data stream.

7 . The method of claim 1 , wherein the arthroscopic video data is received during the surgical procedure.

8 . The method of claim 1 , wherein the analytical information comprises an identification, in the field of view, of the respective anatomical structure, pathology, or defect.

9 . The method of claim 1 , wherein processing, by the one or more processor, content of the first video data stream using the at least one bitmask comprises:
applying, to the first video data stream, at least one overlay based on the at least one bitmask, wherein the at least one overlay is registered with the first video data stream at the respective anatomical position.

10 . The method of claim 9 , wherein the at least one overlay reflects or mimics one or more preoperative and/or intraoperative images of the anatomical region.

11 . The method of claim 10 , wherein the one or more preoperative and/or intraoperative images of the anatomical region are of a modality selected from the group consisting of: MRI, X-ray, fluorescent, ultrasound, and CT.

12 . A video data analysis system comprising:
one or more processor operable to:
receive arthroscopic video data for a surgical procedure from a camera, wherein the arthroscopic video data comprises a field of view of an anatomical region;
generate and provide, using the arthroscopic video data, a first video data stream and a second video data stream; and
during the providing of the first video data stream and the second video data stream:
generate analytical information related to the anatomical region based at least on an application of one or more machine learning models to the second video data stream;
generate, using the analytical information, at least one bitmask corresponding to a respective anatomical structure, pathology, defect, or measurement, at a respective anatomical position; and
process content of the first video data stream using the at least one bitmask to produce a processed first video data stream.

13 . The video data analysis system of claim 12 , wherein to process content of the first video data stream using the at least one bitmask, the one or more processor is operable to:
apply at least one enhancement to the first video data stream based on the at least one bitmask.

14 . The video data analysis system of claim 13 , wherein to apply the at least one enhancement to the first video data stream, the one or more processor is operable to:
highlight or emphasize the respective anatomical structure, pathology, or defect in the first video data stream.

15 . The video data analysis system of claim 14 , wherein the respective anatomical structure, pathology, or defect is selected from the group consisting of: a joint, a vasculature, and cartilage damage.

16 . The video data analysis system of claim 12 , wherein the one or more processor is operable to:
display, on a video display device, the processed first video data stream.

17 . The video data analysis system of claim 12 , wherein the one or more processor is operable to:
during the providing of the first video data stream and the second video data stream: display, on a video display device, the processed first video data stream.

18 . The video data analysis system of claim 12 , wherein one or more processor is operable to receive the arthroscopic video data during the surgical procedure.

19 . The video data analysis system of claim 12 , wherein the analytical information comprises an identification, in the field of view, of the respective anatomical structure, pathology, or defect.

20 . The video data analysis system of claim 12 , wherein to process content of the first video data stream using the at least one bitmask, the one or more processor is operable to:
apply, to the first video data stream, at least one overlay based on the at least one bitmask, wherein the at least one overlay is registered with the first video data stream at the respective anatomical position.

21 . The video data analysis system of claim 20 , wherein the at least one overlay reflects or mimics one or more preoperative and/or intraoperative images of the anatomical region.

22 . The video data analysis system of claim 21 , wherein the one or more preoperative and/or intraoperative images of the anatomical region are of a modality selected from the group consisting of: MRI, X-ray, fluorescent, ultrasound, and CT.

Assignees

• Smith & Nephew Inc
• Smith & Nephew Orthopaedics Ag
• Smith & Nephew Asia Pacific Pte Ltd

Inventors

• Quist Brian William
• Jayakumar Vishal
• Rodriguez Carlos A

Classifications

• G16H50/20

  for computer-aided diagnosis, e.g. based on medical expert systems · CPC title

• G16H10/60

  for patient-specific data, e.g. for electronic patient records · CPC title

• G16H30/40

  for processing medical images, e.g. editing · CPC title

• G16H40/67

  for remote operation · CPC title

• G16H40/63

  for local operation · CPC title