Tracking surgical items with prediction of duplicate imaging of items

Patent metadata

Field	Value
Publication number	US-11922646-B2
Application number	US-202117387686-A
Country	US
Kind code	B2
Filing date	Jul 28, 2021
Priority date	Jan 2, 2017
Publication date	Mar 5, 2024
Grant date	Mar 5, 2024

Abstract

A computer-implemented method for tracking surgical textiles includes receiving a first image comprising a first textile-depicting image region, receiving a second image comprising a second textile-depicting image region, measuring a likelihood that the first and second image regions depict at least a portion of the same textile, and incrementing an index counter if the measure of likelihood does not meet a predetermined threshold. The measure of likelihood may be based on at least one classification feature at least partially based on aspects or other features of the first and second images.

First claim

What is claimed is:

1. A computer-implemented method for tracking surgical textiles for collecting extracorporeal fluid lost by a patient, comprising:
receiving a first image comprising a first textile-depicting image region including a first fluid pattern;
receiving a second image comprising a second textile-depicting image region including a second fluid pattern;
measuring a likelihood that the first and second image regions depict at least a portion of the same textile by comparing an area of the first fluid pattern based on a number of pixels in the first image region having a color component value above a predetermined threshold, with an area of the second fluid pattern based on a number of pixels in the second image region having a color component value above the predetermined threshold;
determining an image transformation between the first and second image regions;
adjusting the second image region relative to the first image region based on the image transformation; and
based on the likelihood exceeding a predetermined threshold, displaying the first image region, the adjusted second image region, and the measured likelihood of potential duplicity on a display device.

2. The method of claim 1 , further comprising:
defining at least one classification feature at least partially based on at least one of a first aspect of the first image region and a second aspect of the second image region,
wherein the measure of likelihood is based at least in part on the classification feature, wherein the first aspect comprises a plurality of first keypoints characterizing the first image region and the second aspect comprises a plurality of second keypoints characterizing the second image region, and wherein each of the first and second keypoints is associated with a respective feature descriptor.

3. The method of claim 2 , wherein defining at least one classification feature comprises fitting a homography transform relating the plurality of first keypoints and the plurality of second keypoints, and wherein the adjusting of the second image region relative to the first image region comprises applying the homography transform to one of the first image region or the second image region.

4. The method of claim 2 , wherein at least one of the first and second aspects characterizes a fluid pattern.

5. The method of claim 1 , wherein the image transformation flips the first image and the second image relative to each other.

6. The method of claim 1 , wherein the image transformation rotates the first and second images relative to each other.

7. The method of claim 1 , wherein the image transformation deskews the first and second images relative to each other.

8. The method of claim 1 , further comprising:
receiving user input relating to whether or not the first image region and second image region depict the same textile; and
based on the user input indicating that the first image region and second image region do not depict the same textile and on the likelihood being below a second threshold, changing a textile count.

9. A computer system for tracking surgical textiles for collecting extracorporeal fluid lost by a patient comprising:
one or more processors; and
a memory storing instructions that, when executed by the one or more processors, configure the computer system to perform operations comprising:
receiving a first image comprising a first textile-depicting image region including a first fluid pattern;
receiving a second image comprising a second textile-depicting image region including a second fluid pattern;
measuring a likelihood that the first and second image regions depict at least a portion of the same textile by comparing an area of the first fluid pattern based on a number of pixels in the first image region having a color component value above a predetermined threshold, with an area of the second fluid pattern based on a number of pixels in the second image region having a color component value above the predetermined threshold;
determining an image transformation between the first and second image regions;
adjusting the second image region relative to the first image region based on the image transformation; and
based on the likelihood exceeding a predetermined threshold, displaying the first image region, the adjusted second image region, and the measured likelihood of potential duplicity on a display device.

10. The computer system of claim 9 , wherein the operations further comprise:
defining at least one classification feature at least partially based on at least one of a first aspect of the first image region and a second aspect of the second image region,
wherein the measure of likelihood is based at least in part on the classification feature, wherein the first aspect comprises a plurality of first keypoints characterizing the first image region and the second aspect comprises a plurality of second keypoints characterizing the second image region, and wherein each of the first and second keypoints is associated with a respective feature descriptor.

11. The computer system of claim 10 , wherein at least one of the first and second aspects characterizes a fluid pattern.

12. The computer system of claim 9 , wherein the image transformation flips the first image and the second image relative to each other.

13. The computer system of claim 9 , wherein the image transformation rotates the first and second images relative to each other.

14. The computer system of claim 9 , wherein the image transformation deskews the first and second images relative to each other.

15. The computer system of claim 9 , wherein the operations further comprise:
receiving user input relating to whether or not the first image region and second image region depict the same textile; and
based on the user input indicating that the first image region and second image region do not depict the same textile and on the likelihood being below a second threshold, changing a textile count.

16. A non-transitory computer-readable storage medium for tracking surgical textiles for collecting extracorporeal fluid lost by a patient, the computer-readable storage medium including instructions that, when executed by a computer system, cause the computer system to perform operations comprising:
receiving a first image comprising a first textile-depicting image region including a first fluid pattern;
receiving a second image comprising a second textile-depicting image region including a second fluid pattern;
measuring a likelihood that the first and second image regions depict at least a portion of the same textile by comparing an area of the first fluid pattern based on a number of pixels in the first image region having a color component value above a predetermined threshold, with an area of the second fluid pattern based on a number of pixels in the second image region having a color component value above the predetermined threshold;
determining an image transformation between the first and second image regions;
adjusting the second image region relative to the first image region based on the image transformation; and
based on the likelihood exceeding a predetermined threshold, displaying the first image region, the adjusted second image region, and the measured likelihood of potential duplicity on a display device.

17. The computer-readable storage medium of claim 16 , wherein the image transformation flips the first image and the second image relative to each other.

18. The computer-readable storage medium of claim 16 , wherein the image transformation rot

Assignees

• Gauss Surgical Inc

Inventors

• Kumar Mayank
• Miller Kevin J
• Satish Siddarth

Classifications

• G06T7/33 Primary

  using feature-based methods · CPC title

• A61B90/92

  coded with colour · CPC title

• A61B90/96

  using barcodes · CPC title

• G06T7/337

  involving reference images or patches · CPC title

• G06V10/462

  Salient features, e.g. scale invariant feature transforms [SIFT] · CPC title