Overlay of wounds based on image analysis

Patent metadata

Field	Value
Publication number	US-2022217287-A1
Application number	US-202217647009-A
Country	US
Kind code	A1
Filing date	Jan 4, 2022
Priority date	Jan 4, 2021
Publication date	Jul 7, 2022
Grant date	—

Abstract

Embodiments consistent with the present disclosure provide systems, methods, and devices for displaying an overlay on wounds. In one example, consistent with the disclosed embodiments, an example system may: receive a real time video feed; receive image-based information associated with at least one previously captured image of a wound; generate, using the video feed and the image-based information, an overlay including an indication of a condition of the wound in the at least one previously captured image; and display, on at least one user interface, the overlay, wherein the at least one user interface is configured to display the overlay in a position associated with a position of the wound in the video feed.

First claim

What is claimed is:

1 . A non-transitory computer readable medium storing data and computer implementable instructions that, when executed by at least one processor, cause the at least one processor to perform operations for displaying an overlay on wounds, the operations comprising:
receiving a real time video feed; receiving image-based information associated with at least one previously captured image of a wound; generating, using the video feed and the image-based information, an overlay including an indication of a condition of the wound in the at least one previously captured image; and displaying, on at least one user interface, the overlay, wherein the at least one user interface is configured to display the overlay in a position associated with a position of the wound in the video feed.

2 . The non-transitory computer readable medium of claim Error! Reference source not found., wherein the at least one previously captured image is captured at least one day before the video feed is captured.

3 . The non-transitory computer readable medium of claim Error! Reference source not found., wherein the video feed includes a plurality of wounds, and the operations further comprise selecting the wound from the plurality of wounds.

4 . The non-transitory computer readable medium of claim Error! Reference source not found., wherein receiving the image-based information comprises:
accessing a plurality of records, each record of the plurality of records corresponding to a different wound; selecting a record corresponding to the wound of the plurality of records based on the video feed; and obtaining the image-based information from the selected record.

5 . The non-transitory computer readable medium of claim Error! Reference source not found., wherein the overlay is displayed on the user interface feed in real time.

6 . The non-transitory computer readable medium of claim Error! Reference source not found., wherein the overlay is displayed in real time using a transparent optical system included in a wearable device, the real time video feed being a real time video feed captured using an image sensor included in the wearable device, the wound being visible to a user wearing the wearable device through the transparent optical system, and the display of the overlay being configured to make the overlay appear to the user wearing the wearable device at least partly over the wound.

7 . The non-transitory computer readable medium of claim Error! Reference source not found., wherein the at least one user interface is associated with a mobile device.

8 . The non-transitory computer readable medium of claim 7 , wherein the at least one user interface is configured to automatically adjust the position of the displayed overlay based on detected movement of the mobile device.

9 . The non-transitory computer readable medium of claim Error! Reference source not found., wherein the operations further comprise:
receiving second image-based information associated with a second at least one previously captured image of the wound; and including a second indication in the overlay, the second indication being an indication of a condition of the wound in the second at least one previously captured image, the condition of the wound in the second at least one previously captured image differing from the condition of the wound in the at least one previously captured image.

10 . The non-transitory computer readable medium of claim 8 , wherein the overlay further includes an indication of a capturing time associated with the at least one previously captured image and an indication of a capturing time associated with the second at least one previously captured image.

11 . The non-transitory computer readable medium of claim 8 , wherein the condition of the wound in the at least one previously captured image corresponds to a first point in time, the condition of the wound in the second at least one previously captured image corresponds to a second point in time, and the operations further comprise:
using the image-based information and the second image-based information to determine a condition of the wound corresponding to a third point in time, the third point in time differing from the first point in time and the second point in time; and including a third indication in the overlay, the third indication being an indication of a condition of the wound corresponding to the third point in time.

12 . The non-transitory computer readable medium of claim Error! Reference source not found., wherein the operations further comprise:
calculating a convolution of at least part of the at least one previously captured image to derive a result value; in response to a first result value, including in the overlay a first indication of the condition of the wound in the at least one previously captured image; and in response to a second result value, including in the overlay a second indication of the condition of the wound in the at least one previously captured image, the second indication differing from the first indication.

13 . The non-transitory computer readable medium of claim Error! Reference source not found., wherein the indication of the condition of the wound includes a visual indication of a contour of the wound in the at least one previously captured image.

14 . The non-transitory computer readable medium of claim Error! Reference source not found., wherein the indication of the condition of the wound includes an indication of at least one measurement of the wound in the at least one previously captured image.

15 . The non-transitory computer readable medium of claim 14 , wherein the at least one measurement includes at least one of a length, an area, a volume, or a depth of the wound.

16 . The non-transitory computer readable medium of claim Error! Reference source not found., wherein the indication of the condition of the wound includes a visual indication of a segment of the wound in the at least one previously captured image corresponding to a tissue type.

17 . The non-transitory computer readable medium of claim Error! Reference source not found., wherein the indication of the condition of the wound includes a visual indication of a color of a portion of the wound in the at least one previously captured image.

18 . The non-transitory computer readable medium of claim Error! Reference source not found., wherein the indication of the condition of the wound includes a visual indication of a severity of the wound in the at least one previously captured image.

19 . A system for displaying an overlay on a wound, the system comprising at least one processing unit configured to:
receive a real time video feed; receive image-based information associated with at least one previously captured image of a wound; generate, using the video feed and the image-based information, an overlay including an indication of a condition of the wound in the at least one previously captured image; and display, on at least one user interface, the overlay, wherein the at least one user interface is configured to display the overlay in a position associated with a position of the wound in the video feed.

20 . A method for displaying an overlay on a wound in, the method comprising:
receiving a real time video feed; receiving image-based information associated with at least one previously captured image of a wound; generating, using the video feed and the image-based information, an overlay including an indication of a condition of t

Assignees

• Healthy Io Ltd

Inventors

• Adiri Yonatan
• Zohar Ron
• Omer Ido
• Bubis Nathaniel

Classifications

• G06T11/23

  using straight lines or curves · CPC title

• G06T11/10

  Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) · CPC title

• H04N23/635

  Region indicators; Field of view indicators · CPC title

• H04N23/64

  Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image · CPC title

• H04N23/55

  Optical parts specially adapted for electronic image sensors; Mounting thereof · CPC title