Systems and methods for generating and displaying a study of a stream of in-vivo images

Patent metadata

Field	Value
Publication number	US-12059125-B2
Application number	US-201917286641-A
Country	US
Kind code	B2
Filing date	Oct 19, 2019
Priority date	Oct 19, 2018
Publication date	Aug 13, 2024
Grant date	Aug 13, 2024

Abstract

Systems and methods may display and/or provide analysis of a number of selected images of a patients gastrointestinal tract collected in-vivo by a swallowable capsule. Images may be displayed for review (e.g., as a study) and/or for further analysis by a user. A subset of images representing the stream of images and automatically selected according to a first selection method may be displayed. On user input, additional images corresponding to a currently displayed image may be displayed, where the additional images are automatically selected according to a second selection method. The second selection method may be based on a relation between images of the stream of in-vivo images and the currently displayed image.

First claim

The invention claimed is:

1. A method for displaying a study of a capsule endoscopy procedure for a user's review, wherein the capsule endoscopy procedure comprises capturing a stream of in vivo images of at least a portion of interest of a subject's gastrointestinal tract (GIT), the method comprising using one or more hardware processors for:
displaying on a display device a subset of images of the stream of in vivo images for the user's review, wherein the subset of images represents the captured stream of in vivo images, and wherein the subset of images is automatically selected from the stream of in vivo images according to a first selection method;
in response to receiving user input selecting a currently displayed image of the subset of images, displaying on the display device one or more additional images corresponding to the currently displayed image of the subset of images, wherein the one or more additional images are automatically selected from the stream of in vivo images according to a second selection method, and wherein the second selection method is based on a relation between images of the stream of in vivo images and the currently displayed image, wherein the relation on which the second selection method is based comprises images which are identified to include at least a portion of a same feature; and
generating a report, the report comprising images from the displayed images selected by the user.

2. The method of claim 1 , wherein the subset of images is displayed in a still manner in a default display of the study.

3. The method of claim 1 , wherein the displaying of the subset of images comprises simultaneously displaying multiple images of the subset, wherein the multiple images were captured by a single imaging device of a capsule device used in the capsule endoscopy procedure.

4. The method of claim 3 , wherein the simultaneously displayed multiple images of the subset are displayed in a layout of a carousel or a matrix.

5. The method of claim 1 , wherein the relation on which the second selection method is based is further selected from the group consisting of: images which are identified to include at least a portion of a same type of feature, images which were captured in time proximity, images which are localized adjacently along the at least portion of interest of the subject's GIT, and combinations thereof.

6. The method of claim 1 , further comprising using the one or more hardware processor for:
selecting the subset of images according to the first selection method; and
for each image of at least a portion of the subset of images, selecting the one or more corresponding additional images from the stream of in vivo images according to the second selection method.

7. The method of claim 1 , wherein the one or more additional images comprises at least one image of the stream of images which is not included in the selected subset of images.

8. The method of claim 1 , wherein the one or more additional images comprises only images of the stream of images which are not included in the selected subset of images.

9. The method of claim 1 , wherein the one or more additional images are displayed simultaneously with at least a portion of the currently displayed image on the display device.

10. The method of claim 1 , further comprising using the one or more hardware processors for displaying a map representing at least the portion of interest of the subject's GIT and corresponding at least to the selected subset of images, wherein the map includes localized image indications representing the images in the subset of images according to their estimated location along the at least portion of interest of the subject's GIT.

11. The method of claim 1 , wherein the subset of images is displayed in a matrix layout in a default display of the study.

12. The method of claim 1 , wherein at least the first selection method is based on deep learning techniques.

13. The method of claim 1 , further comprising using the one or more hardware processors for displaying an indication of a location in a displayed image suspected to include at least a portion of a feature of interest.

14. The method of claim 1 , wherein:
the at least portion of interest of the subject's GIT is divided into segments; and
images of the subset of images are localized along at least the portion of interest of the subject's GIT according to the segments, and
the method further comprises using the one or more hardware processors for displaying an indication to the segments in which the currently displayed images of the subset of images are located.

15. The method of claim 14 , further comprising using the one or more hardware processors for displaying the subset of images according to the segments.

16. The method of claim 1 , further comprising using the one or more hardware processors for displaying an indication of an estimated cleansing level of images of the captured stream of images.

17. The method of claim 1 , further comprising using the one or more hardware processor for:
estimating a size of a feature identified in a displayed image; and
displaying an indication of the estimated size.

18. The method of claim 1 , further comprising using the one or more hardware processor for displaying, upon user input, a plurality of images selected from the stream of in vivo images representing a transition from one anatomical section to another anatomical section of the at least portion of interest of the GIT.

19. The method of claim 1 , comprising displaying the study, wherein the study does not comprise any images of the captured stream of in vivo images, other than the subset of images and the additional images corresponding to images in the subset.

20. The method of claim 1 , further comprising using the one or more hardware processors for filtering the display of the subset of images based on user input.

21. The method of claim 1 , wherein according to the first selection method, images identified to include a feature of interest are selected.

22. The method of claim 21 , wherein the feature of interest is selected from the group consisting of: a pathology, a foreign body, an anomaly, an anatomical feature and a combination thereof.

23. A method comprising using at least one hardware processor for:
receiving a subset of images automatically selected from a stream of in vivo images of at least a portion of interest of a subject's gastrointestinal tract (GIT) captured via a capsule endoscopy procedure, wherein the images of the subset of images are selected based on a first selection method;
displaying on a display device the subset of automatically selected images in a still manner;
in response to receiving user input selecting a currently displayed image of the subset of images, displaying, on the display device, additional information corresponding to the currently displayed image, wherein the additional information comprises one or more additional images automatically selected from the stream of in vivo images and according to a second selection method, wherein the one or more additional images are displayed simultaneously with at least a portion of the currently displayed image on the display device; and
generating a report, the report comprising images from the displayed images selected by the user.

24. The method of claim 23 , wherein the one or more additional images are displayed in the same window as the corresponding currently displayed image

Assignees

• Given Imaging Ltd

Inventors

• Spillinger Avishag
• Peleg Dori
• Elkayam Orit
• Niv Eva
• Ambor Iddo
• Fox Sherry L
• Sohlden Ryan S

Classifications

• G16H30/20

  for handling medical images, e.g. DICOM, HL7 or PACS · CPC title

• A61B1/041 Primary

  Capsule endoscopes for imaging · CPC title

• A61B1/00045 Primary

  Display arrangement · CPC title

• G06T2207/10068

  Endoscopic image · CPC title

• G06T2207/10016

  Video; Image sequence · CPC title