User-interface for visualization of endoscopy procedures

Patent metadata

Field	Value
Publication number	US-11957302-B2
Application number	US-202117499748-A
Country	US
Kind code	B2
Filing date	Oct 12, 2021
Priority date	May 24, 2021
Publication date	Apr 16, 2024
Grant date	Apr 16, 2024

Abstract

A user-interface for visualizing a colonoscopy procedure includes a video region and a navigational map upon which coverage annotations are displayed. A live video feed received from a colonoscope is displayed in the video region. The navigational map depicts longitudinal sections of a colon. The coverage annotations are presented on the navigation map and indicate whether one or more of the longitudinal sections is deemed adequately inspected or inadequately inspected during the colonoscopy procedure.

First claim

What is claimed is:

1. At least one machine-accessible storage medium that provides instructions that, when executed by a machine, will cause the machine to perform operations comprising:
generating a colonoscopy user-interface for display on a screen;
outputting a live video feed received from a colonoscope for display within a video region of the colonoscopy user-interface;
generating a navigational map that depicts longitudinal sections of a colon for display within the colonoscopy user-interface;
annotating one of the longitudinal sections on the navigational map to visually indicate an inspection status of the one of the longitudinal sections, wherein the inspection status indicates whether the one of the longitudinal sections is deemed adequately or inadequately inspected by the colonoscope; and
determining the inspection status based upon at least a loitering time of a camera of the colonoscope in the one of the longitudinal sections.

2. The at least one machine-accessible storage medium of claim 1 , wherein the live video feed and the navigational map are both contemporaneously presented within the colonoscopy user-interface.

3. The at least one machine-accessible storage medium of claim 1 , wherein the annotating is updated during a withdrawal phase of a colonoscopy procedure.

4. The at least one machine-accessible storage medium of claim 1 , further providing instructions that, when executed by the machine, will cause the machine to perform further operations, comprising:
moving a position marker along the navigational map as the colonoscope moves within the colon, wherein the position marker indicates a real-time position of a field of view of the live video feed acquired by the colonoscope within the colon.

5. The at least one machine-accessible storage medium of claim 4 , further providing instructions that, when executed by the machine, will cause the machine to perform further operations, comprising:
annotating each of the longitudinal sections with a corresponding inspection status as the position marker passes through a corresponding one of the longitudinal sections while the colonoscope is withdrawn from the colon.

6. The at least one machine-accessible storage medium of claim 1 , wherein presenting the navigational map further comprises:
either, initially presenting the navigational map or transitioning the navigational map from a first shade to a second shade, once a distal tip of the colonoscope reaches a cecum of the colon at an end of an insertion phase of a colonoscopy procedure.

7. The at least one machine-accessible storage medium of claim 1 , wherein determining the inspection status is further based upon at least one of:
a determination of whether all surface patches of the colon within the one of the longitudinal sections is observed by the camera;
a distance between each of the surface patches and the camera when each of the surface patches is observed by the camera; or
an angle of viewing incidence between the camera and each of the surface patches when each of the surface patches is observed by the camera.

8. The at least one machine-accessible storage medium of claim 1 , wherein the navigational map is an anatomical atlas representative of the colon.

9. The at least one machine-accessible storage medium of claim 1 , wherein the navigational map comprises a 3D model of the colon constructed during an insertion phase of a colonoscopy procedure.

10. The at least one machine-accessible storage medium of claim 1 , further providing instructions that, when executed by the machine, will cause the machine to perform further operations, comprising:
presenting a cross-sectional coverage map indicating whether angular portions of a cross-section of the one of the longitudinal sections of the colon are deemed adequately or inadequately inspected by the colonoscope.

11. The at least one machine-accessible storage medium of claim 1 , further providing instructions that, when executed by the machine, will cause the machine to perform further operations, comprising:
displaying an estimated withdrawal time to complete a withdrawal phase of a colonoscopy procedure; and
updating the estimated withdrawal time during the withdrawal phase.

12. The at least one machine-accessible storage medium of claim 1 , further providing instructions that, when executed by the machine, will cause the machine to perform further operations, comprising:
overlaying a guidance arrow on the live video feed guiding an operator of the colonoscope back to the one of the longitudinal sections when the colonoscope has been withdrawn past the one of the longitudinal sections that is deemed inadequately inspected.

13. The at least one machine-accessible storage medium of claim 1 , further providing instructions that, when executed by the machine, will cause the machine to perform further operations, comprising:
collecting coverage data from a multitude of colonoscopy procedures indicating colon portions most likely to be inadequately observed during the multitude of colonoscopy procedures.

14. The at least one machine-accessible storage medium of claim 1 , further providing instructions that, when executed by the machine, will cause the machine to perform further operations, comprising:
annotating a detected polyp in the live video feed.

15. The at least one machine-accessible storage medium of claim 14 , further providing instructions that, when executed by the machine, will cause the machine to perform further operations, comprising:
classifying the detected polyp based upon image analysis of the detected polyp; and
presenting, within the colonoscopy user-interface, one or more reference images of polyps based upon the classifying for visual comparison against the detected polyp currently displayed in the live video feed.

16. At least one machine-accessible storage medium that provides instructions that, when executed by a machine, will cause the machine to output a signal for rendering a user-interface to a display, the user-interface adapted for visualizing an endoscopy procedure, the user-interface comprising:
a video region in which a live video feed received from an endoscope is displayed;
a navigational map that depicts longitudinal sections of an anatomical structure;
one or more coverage annotations presented on the navigation map that indicate whether one or more of the longitudinal sections is deemed adequately inspected or inadequately inspected during the endoscopy procedure; and
a cross-sectional coverage map indicating an estimated inspection coverage of a given longitudinal section of the anatomical structure, wherein the estimated inspection coverage for the given longitudinal section increases as a camera of the endoscope loiters within the given longitudinal section inspecting different angular portions of the given longitudinal section.

17. The least one machine-accessible storage medium of claim 16 , wherein the user-interface further comprises:
a position marker displayed on the navigational map indicating a real-time position of a field of view of the live video feed acquired by the endoscope within the anatomical structure, wherein the position marker moves along the navigation map as the endoscope moves within the anatomical structure.

18. The least one machine-accessible storage medium of claim 16 , wherein the cross-sectional coverage map indicates which angular portions of the given longitudinal section of the anatomical structure are deemed adequately inspected or inadequately inspected by the endoscope.

Assignees

• Verily Life Sciences Llc

Inventors

• Lack Erik
• Goldenberg Roman
• Freedman Daniel
• Rivlin Ehud

Classifications

• A61B1/0004 Primary

  for electronic operation · CPC title

• A61B1/0005

  combining images e.g. side-by-side, superimposed or tiled · CPC title

• A61B1/31 Primary

  for the rectum, e.g. proctoscopes, sigmoidoscopes {, colonoscopes} · CPC title

• A61B90/39

  Markers, e.g. radio-opaque or breast lesions markers · CPC title

• G06T7/0012

  Biomedical image inspection · CPC title