Systems and methods for processing electronic medical images to determine enhanced electronic medical images

Patent metadata

Field	Value
Publication number	US-11776122-B2
Application number	US-202218045989-A
Country	US
Kind code	B2
Filing date	Oct 12, 2022
Priority date	Nov 18, 2019
Publication date	Oct 3, 2023
Grant date	Oct 3, 2023

Abstract

Systems and methods for processing electronic images from a medical device comprise receiving an image frame from the medical device, and determining a first color channel and a second color channel in the image frame. A location of an electromagnetic beam halo may be identified by comparing the first color channel and second color channel. Edges of an electromagnetic beam may be determined based on the electromagnetic beam halo, and size metrics of the electromagnetic beam may be determined based on the edges of the electromagnetic beam. A visual indicator on the image frame may be displayed based on the size metrics of the electromagnetic beam.

First claim

We claim:

1. A system for processing electronic images from a medical device, comprising:
at least one processor configured to execute instructions to perform operations for processing electronic images, the operations comprising:
receiving an image frame from the medical device;
identifying a location of an electromagnetic beam halo;
determining edges of an electromagnetic beam based on the electromagnetic beam halo; and
determining size metrics of the electromagnetic beam based on the edges of the electromagnetic beam.

2. The system of claim 1 , the operations further comprising:
generating a visual indicator for display on the image frame based on the size metrics of the electromagnetic beam.

3. The system of claim 2 , the operations further comprising:
extracting features from the image frame within a predetermined distance of the electromagnetic beam and/or electromagnetic beam halo; and
determining a size of the visual indicator based on the extracted features.

4. The system of claim 3 , wherein the size of the visual indicator on the image is determined based on a weighting of each of the extracted features.

5. The system of claim 2 , wherein the visual indicator corresponds to a size of an exit channel through which objects are passed.

6. The system of claim 1 , wherein determining edges of an electromagnetic beam comprises defining a bounding box around the electromagnetic beam halo.

7. The system of claim 6 , wherein determining the edges of the electromagnetic beam further comprises:
determining an approximated electromagnetic beam based on the electromagnetic beam halo;
distinguishing the approximated electromagnetic beam from image artifacts based on the size of the approximated electromagnetic beam relative to the image artifacts; and
applying an algorithm to determine the edges of the electromagnetic beam.

8. The system of claim 1 , wherein determining size metrics of the electromagnetic beam includes:
fitting a plurality of circle candidates or ellipse candidates over the determined edges of the electromagnetic beam; and
determining the best-fitting circle candidate or ellipse candidate.

9. The system of claim 1 , wherein the electromagnetic beam is a laser.

10. The system of claim 1 , wherein the size metrics correspond to a diameter or radius of the electromagnetic beam.

11. A method for processing electronic images from a medical device, comprising:
receiving an image frame from the medical device;
identifying a location of an electromagnetic beam halo;
determining edges of an electromagnetic beam based on the electromagnetic beam halo; and
determining size metrics of the electromagnetic beam based on the edges of the electromagnetic beam.

12. The method of claim 11 , further comprising:
generating a visual indicator for display on the image frame based on the size metrics of the electromagnetic beam.

13. The method of claim 12 , further comprising:
extracting features from the image frame within a predetermined distance of the electromagnetic beam and/or electromagnetic beam halo; and
determining a size of the visual indicator on the image frame based on the extracted features.

14. The method of claim 13 , wherein the size of the visual indicator on the image is determined based on a weighting of each of the extracted features.

15. The method of claim 12 , wherein the visual indicator on the image frame corresponds to a size of an exit channel through which objects are passed.

16. The method of claim 11 , wherein determining the edges of the electromagnetic beam comprises:
determining an approximated electromagnetic beam based on the electromagnetic beam halo;
distinguishing the approximated electromagnetic beam from image artifacts based on the size of the approximated electromagnetic beam relative to the image artifacts; and
applying an algorithm to determine the edges of the electromagnetic beam.

17. The method of claim 11 , wherein determining size metrics of the electromagnetic beam includes:
fitting a plurality of circle candidates or ellipse candidates over the determined edges of the electromagnetic beam; and
determining the best-fitting circle candidate or ellipse candidate.

18. The method of claim 11 , wherein the electromagnetic beam is a laser.

19. The method of claim 11 , wherein the size metrics correspond to a diameter or radius of the electromagnetic beam.

20. A non-transitory computer-readable medium storing instructions that, when executed by a computer, cause the computer to perform operations for processing electronic images from a medical device, the operations including:
receiving an image frame from the medical device;
identifying a location of an electromagnetic beam shined upon a surface in the image frame;
analyzing the electromagnetic beam to determine size metrics of the surface upon which the electromagnetic beam is shined; and
generating a visual indicator for display on the image frame based on the size metrics of the electromagnetic beam,
wherein analyzing the electromagnetic beam to determine size metrics further comprises:
determining edges of the electromagnetic beam based on the electromagnetic beam halo; and
determining size metrics of the electromagnetic beam based on the edges of the electromagnetic beam.

Assignees

• Boston Scient Scimed Inc

Inventors

• Chen Longquan
• Demisse Mussie Teshome
• Fusman Judith
• Silva Aaron
• Cahill Andrea
• Gyllenhaal Evan

Classifications

• G06T11/23

  using straight lines or curves · CPC title

• G06T7/0012 Primary

  Biomedical image inspection · CPC title

• G06T7/13

  Edge detection · CPC title

• G06T7/62

  of area, perimeter, diameter or volume · CPC title

• G06T7/70

  Determining position or orientation of objects or cameras (camera calibration G06T7/80) · CPC title