Systems and methods for processing electronic medical images to determine enhanced electronic medical images

Patent metadata

Field	Value
Publication number	US-2023394664-A1
Application number	US-202318455060-A
Country	US
Kind code	A1
Filing date	Aug 24, 2023
Priority date	Nov 18, 2019
Publication date	Dec 7, 2023
Grant date	—

Abstract

Systems and methods for processing electronic images from a medical device comprise receiving an image frame from the medical device, and determining a first color channel and a second color channel in the image frame. A location of an electromagnetic beam halo may be identified by comparing the first color channel and second color channel. Edges of an electromagnetic beam may be determined based on the electromagnetic beam halo, and size metrics of the electromagnetic beam may be determined based on the edges of the electromagnetic beam. A visual indicator on the image frame may be displayed based on the size metrics of the electromagnetic beam.

First claim

1 - 20 . (canceled)

21 . A method for processing electronic medical images, comprising:
receiving an image frame of an object from a medical imaging device; identifying, within the image frame, a halo associated with an electromagnetic beam projected onto the object while the image frame was captured by the medical imaging device; determining size metrics of the electromagnetic beam based on the halo; and determining size metrics of the object based on the size metrics of the electromagnetic beam.

22 . The method of claim 21 , further comprising determining size metrics of an exit channel through which the object is to be passed based on the size metrics of the electromagnetic beam.

23 . The method of claim 22 , further comprising generating a visual indicator for display on the image frame, wherein the visual indicator represents the size metrics of the exit channel to visually indicate whether the object is able to be passed through the exit channel.

24 . The method of claim 22 , further comprising providing one or more rulers for display on the image frame based on the size metrics determined for one or more of the electromagnetic beam, the object, or the exit channel.

25 . The method of claim 21 , wherein determining the size metrics of the electromagnetic beam based on the halo comprises:
determining edges of the electromagnetic beam based on the halo; and determining the size metrics of the electromagnetic beam based on the edges.

26 . The method of claim 25 , further comprising:
determining an approximated electromagnetic beam based on the halo; distinguishing the approximated electromagnetic beam from image artifacts based on a size of the approximated electromagnetic beam relative to the image artifacts; fitting a shape to the approximated electromagnetic beam; and determining approximated size metrics for the shape fitted to the approximated electromagnetic beam.

27 . The method of claim 26 , further comprising:
extracting features from the image frame within a predetermined distance of one or more of the electromagnetic beam or the halo; providing, as input to a trained machine learning system, the extracted features and the approximated size metrics for the shape fitted to the approximated electromagnetic beam; and receiving, as output of the trained machine learning system, the size metrics of the electromagnetic beam, wherein the size metrics of the electromagnetic beam are altered from the approximated size metrics based on weights applied by the trained machine learning system.

28 . The method of claim 21 , wherein identifying the halo comprises:
determining a first color channel and a second color channel in the image frame; and comparing the first color channel to the second color channel to identify the halo.

29 . The method of claim 28 , wherein comparing the first color channel to the second color channel comprises:
determining that the first color channel depicts the electromagnetic beam and the halo; determining that the second color channel depicts the electromagnetic beam; and subtracting the second color channel from the first color channel, or adding an inverse of the first color channel to the second color channel to identify the halo.

30 . The method of claim 29 , wherein the first color channel is determined so as to match a predetermined color of the electromagnetic beam, and wherein the second color channel is determined so as to not match the predetermined color of the electromagnetic beam.

31 . A method for processing electronic medical images, comprising:
receiving an image frame from a medical imaging device, the image frame including an object onto which an electromagnetic beam is projected by the medical imaging device, the projection causing a halo to be formed in association with the electromagnetic beam; distinguishing the electromagnetic beam from the halo within the image frame; determining size metrics of the electromagnetic beam; and determining relative size metrics of the object based on the size metrics of the electromagnetic beam.

32 . The method of claim 31 , further comprising determining relative size metrics of an exit channel associated with the medical imaging device through which the object is to be passed based on the size metrics of the electromagnetic beam.

33 . The method of claim 32 , further comprising generating a visual indicator for display on the image frame, wherein the visual indicator represents the relative size metrics of the exit channel to visually indicate whether the object is able to be passed through the exit channel.

34 . The method of claim 31 , wherein distinguishing the electromagnetic beam from the halo within the image frame comprises:
identifying a location of the halo within the image frame; and determining edges of the electromagnetic beam based on the halo.

35 . The method of claim 34 , wherein determining the size metrics of the electromagnetic beam comprises:
fitting a shape to an approximated electromagnetic beam based on the edges; and determining approximated size metrics for the shape fitted to the approximated electromagnetic beam.

36 . The method of claim 35 , further comprising:
extracting features from the image frame within a predetermined distance of one or more of the electromagnetic beam or the halo; providing, as input to a trained machine learning system, the extracted features and the approximated size metrics for the shape fitted to the approximated electromagnetic beam; and receiving, as output of the trained machine learning system, the size metrics of the electromagnetic beam, wherein the size metrics of the electromagnetic beam are altered from the approximated size metrics based on weights applied by the trained machine learning system.

37 . The method of claim 34 , wherein identifying the location of the halo within the image frame comprises:
determining a first color channel in the image frame that depicts the electromagnetic beam and the halo; determining a second color channel in the image frame that depicts the electromagnetic beam; and comparing the first color channel to the second color channel to identify the location of the halo.

38 . A method for processing electronic medical images, comprising:
receiving, from a medical imaging device positioned in a body lumen, an image frame of an object to be removed from the body lumen, wherein the image frame is captured by the medical imaging device while an electromagnetic beam is being projected by the medical imaging device onto the object; identifying a halo associated with the electromagnetic beam within the image frame; determining size metrics of the electromagnetic beam using the halo; and based on the size metrics of the electromagnetic beam, determining size metrics of the object relative to size metrics of an exit channel associated with the medical imaging device through which the object is to be removed from the body lumen.

39 . The method of claim 38 , further comprising:
generating a visual indicator for display on the image frame, wherein the visual indicator represents the size metrics of the exit channel to visually indicate whether the object is able to be removed from the body lumen through the exit channel.

40 . The method of claim 39 , wherein the medical imaging device is a ureteroscope, and the object to be removed is a kidney stone.

Assignees

• Boston Scient Scimed Inc

Inventors

• Chen Longquan
• Demisse Mussie Teshome
• Fusman Judith
• Silva Aaron
• Cahill Andrea
• Gyllenhaal Evan

Classifications

• G06T11/23

  using straight lines or curves · CPC title

• G06T7/0012 Primary

  Biomedical image inspection · CPC title

• G06T7/62

  of area, perimeter, diameter or volume · CPC title

• G06T7/13

  Edge detection · CPC title

• A61B1/307

  for the urinary organs, e.g. urethroscopes, cystoscopes · CPC title