Systems and methods for processing electronic medical images to determine enhanced electronic medical images

Patent metadata

Field	Value
Publication number	US-11501433-B2
Application number	US-202016951030-A
Country	US
Kind code	B2
Filing date	Nov 18, 2020
Priority date	Nov 18, 2019
Publication date	Nov 15, 2022
Grant date	Nov 15, 2022

Abstract

Systems and methods for processing electronic images from a medical device comprise receiving an image frame from the medical device, and determining a first color channel and a second color channel in the image frame. A location of an electromagnetic beam halo may be identified by comparing the first color channel and second color channel. Edges of an electromagnetic beam may be determined based on the electromagnetic beam halo, and size metrics of the electromagnetic beam may be determined based on the edges of the electromagnetic beam. A visual indicator on the image frame may be displayed based on the size metrics of the electromagnetic beam.

First claim

We claim:

1. A system for processing electronic images from a medical device, comprising:
at least one data storage device storing instructions for processing electronic images; and
at least one processor configured to execute the instructions to perform operations for processing electronic images, the operations comprising:
receiving an image frame from the medical device;
determining a first color channel and a second color channel in the image frame;
identifying a location of an electromagnetic beam halo by comparing the first color channel and second color channel;
determining edges of an electromagnetic beam based on the electromagnetic beam halo;
determining size metrics of the electromagnetic beam based on the edges of the electromagnetic beam; and
displaying a visual indicator on the image frame based on the size metrics of the electromagnetic beam.

2. The system of claim 1 , the operations further comprising:
extracting features from the image frame within a predetermined distance of the electromagnetic beam and/or electromagnetic beam halo; and
determining a size of the visual indicator on the image frame based on the extracted features.

3. The system of claim 2 , wherein the size of the visual indicator on the image is determined based on a weighting of each of the extracted features.

4. The system of claim 1 , wherein the visual indicator on the image frame corresponds to a size of an exit channel through which objects are passed.

5. The system of claim 1 , wherein comparing the first color channel and the second color channel further comprises:
determining that the first color channel depicts the electromagnetic beam and the electromagnetic beam halo;
determining that the second color channel depicts the electromagnetic beam; and
subtracting, or adding the inverse of, the second color channel and the first color channel to identify the location of an electromagnetic beam halo.

6. The system of claim 1 , wherein determining the edges of the electromagnetic beam comprises:
determining an approximated electromagnetic beam based on the electromagnetic beam halo;
distinguishing the approximated electromagnetic beam from image artifacts based on the size of the approximated electromagnetic beam relative to the image artifacts; and
fitting a circle or an ellipse to the approximated electromagnetic beam.

7. The system of claim 1 , wherein the first color channel is determined so as to match a predetermined color of the electromagnetic beam, and wherein the second color channel is determined so as to not match the predetermined color of the electromagnetic beam.

8. The system of claim 1 , wherein the electromagnetic beam is a laser.

9. The system of claim 1 , wherein the size metrics correspond to a diameter or radius of the electromagnetic beam.

10. A method for processing electronic images from a medical device, comprising:
receiving an image frame from the medical device;
determining a first color channel and a second color channel in the image frame;
identifying a location of an electromagnetic beam halo by comparing the first color channel and second color channel;
determining edges of an electromagnetic beam based on the electromagnetic beam halo;
determining size metrics of the electromagnetic beam based on the edges of the electromagnetic beam; and
displaying a visual indicator on the image frame based on the size metrics of the electromagnetic beam.

11. The method of claim 10 , further comprising:
extracting features from the image frame within a predetermined distance of the electromagnetic beam and/or electromagnetic beam halo; and
determining a size of the visual indicator on the image frame based on the extracted features.

12. The method of claim 11 , wherein the size of the visual indicator on the image is determined based on a weighting of each of the extracted features.

13. The method of claim 10 , wherein the visual indicator on the image frame corresponds to a size of an exit channel through which objects are passed.

14. The method of claim 10 , wherein comparing the first color channel and the second color channel further comprises:
determining that the first color channel depicts the electromagnetic beam and the electromagnetic beam halo;
determining that the second color channel depicts the electromagnetic beam; and
subtracting, or adding the inverse of, the second color channel and the first color channel to identify the location of an electromagnetic beam halo.

15. The method of claim 10 , wherein determining the edges of the electromagnetic beam comprises:
determining an approximated electromagnetic beam based on the electromagnetic beam halo;
distinguishing the approximated electromagnetic beam from image artifacts based on the size of the approximated electromagnetic beam relative to the image artifacts; and
fitting a circle or an ellipse to the approximated electromagnetic beam.

16. The method of claim 10 , wherein the first color channel is determined so as to match a predetermined color of the electromagnetic beam, and wherein the second color channel is determined so as to not match the predetermined color of the electromagnetic beam.

17. The method of claim 10 , wherein the electromagnetic beam is a laser.

18. The method of claim 10 , wherein the size metrics correspond to a diameter or radius of the electromagnetic beam.

19. A non-transitory computer-readable medium storing instructions that, when executed by a computer, cause the computer to perform operations for processing electronic images from a medical device, the operations including:
receiving an image frame from the medical device;
identifying a location of an electromagnetic beam shined upon a surface in the image frame;
analyzing the electromagnetic beam to determine size metrics of the surface upon which the electromagnetic beam is shined; and
displaying a visual indicator on the image frame based on the size metrics of the electromagnetic beam,
wherein analyzing the electromagnetic beam to determine size metrics further comprises:
determining a first color channel and a second color channel in the image frame;
identifying a location of an electromagnetic beam halo by comparing the first color channel and second color channel;
determining edges of an electromagnetic beam based on the electromagnetic beam halo; and
determining size metrics of the electromagnetic beam based on the edges of the electromagnetic beam.

Assignees

• Boston Scient Scimed Inc

Inventors

• Chen Longquan
• Demisse Mussie Teshome
• Fusman Judith
• Silva Aaron
• Cahill Andrea
• Gyllenhaal Evan

Classifications

• G06T11/23

  using straight lines or curves · CPC title

• A61B1/307

  for the urinary organs, e.g. urethroscopes, cystoscopes · CPC title

• G06T2207/10024

  Color image · CPC title

• G06T7/0012 Primary

  Biomedical image inspection · CPC title

• G06T2207/10068

  Endoscopic image · CPC title