Image processing systems and methods for caring for skin features

Patent metadata

Field	Value
Publication number	US-11961608-B2
Application number	US-202017086800-A
Country	US
Kind code	B2
Filing date	Nov 2, 2020
Priority date	Nov 11, 2019
Publication date	Apr 16, 2024
Grant date	Apr 16, 2024

Abstract

Systems and methods for image processing of a skin feature may include receiving from at least one image sensor associated with a mobile communications device a first and a second images of a skin feature. The skin feature has multiple segments of differing colors and differing sizes, and the second image is captured at least a day after the first image is captured. The method may further include analyzing data associated with the first and second images to determine a condition of the skin feature based on changes over time of the multiple segments. The method may also include determining, based on the determined condition of the skin feature, a medical action for treating the skin feature during a time period. Then, the method may include causing a mobile communications device to display information indicative of the determined medical action.

First claim

We claim:

1. A non-transitory computer readable medium for conducting image processing of skin features, the computer readable medium containing instructions that, when executed by a processor, cause the processor to perform a method, the method comprising:
receiving from at least one image sensor associated with a mobile communications device a first image of the skin feature, the skin feature having multiple segments of differing colors and differing sizes;
storing in at least one memory device data associated with the first image for later processing;
receiving from the at least one image sensor associated with the mobile communications device a second image of the skin feature, wherein the second image is captured at least a day after the first image is captured;
retrieving from the at least one memory device data associated with the first image;
analyzing the retrieved data and data associated with the second image to determine a condition of the skin feature based on changes over time of the multiple segments;
determining, based on the determined condition of the skin feature, at least one medical action for treating the skin feature during a time period; and
causing the mobile communications device to display information indicative of the determined at least one medical action.

2. The non-transitory computer readable medium of claim 1 , wherein the skin feature includes a wound including the multiple segments, and determining the condition of the skin feature includes determining a healing progress of the wound by identifying changes over time of geometrical parameters and colors of the multiple segments of the wound.

3. The non-transitory computer readable medium of claim 1 , wherein the at least one medical action includes treating the skin feature by applying a medicine to the skin feature, the method further including:
causing the mobile communications device to issue a plurality of reminders to apply the medicine to the skin feature over a treatment period extending at least three days after capture of the second image.

4. The non-transitory computer readable medium of claim 1 , wherein the method further includes determining the time period based on the determined condition of the skin feature.

5. The non-transitory computer readable medium of claim 1 , wherein the at least one medical action includes monitoring the condition of the skin feature by capturing a third image of the skin feature at least one day after the second image was captured.

6. The non-transitory computer readable medium of claim 5 , wherein the method further includes analyzing the first image and the second image to determine recommended image capturing parameters for capturing the third image of the skin feature using the at least one image sensor.

7. The non-transitory computer readable medium of claim 6 , wherein the method further includes causing a configuration of the at least one image sensor according to the determined capturing parameters.

8. The non-transitory computer readable medium of claim 5 , wherein causing the mobile communications device to display the information indicative of the determined at least one medical action includes sending a notification to a user, the notification including a link for opening an application for capturing the third image of the skin feature.

9. The non-transitory computer readable medium of claim 5 , wherein the method further includes:
determining a time for capturing the third image;
predicting an appearance of the skin feature at the determined time for capturing the third image;
receiving from the at least one image sensor associated with the mobile communications device the third image of the skin feature; and
based on the predicted appearance of the skin feature and an actual appearance of the skin feature as depicted in the third image, determining an additional medical action for treating the skin feature and an additional time period for completing the additional medical action.

10. The non-transitory computer readable medium of claim 1 , wherein the method further includes:
determining that the at least one medical action was not completed during the time period;
determining an additional medical action for treating the skin feature; and
determining an additional time period for completing the additional medical action.

11. The non-transitory computer readable medium of claim 1 , wherein the method further includes:
determining a plurality of medical actions to be completed during the time period;
identify a most urgent medical action out of the plurality of medical actions based on the determined condition of the skin feature; and
causing the mobile communications device to display information indicative of the most urgent medical action.

12. The non-transitory computer readable medium of claim 1 , wherein determining the at least one medical action is based on the changes over time of the multiple segments as reflected in the first and second images and further based on at least one of: a patient's personal medical record, demographic information associated with the patient, and treatment data associated with the skin feature.

13. The non-transitory computer readable medium of claim 1 , wherein the method further includes accessing a scheduling system associated with a medical practitioner of a patient having the skin feature to schedule an appointment with the medical practitioner.

14. The non-transitory computer readable medium of claim 1 , wherein causing the mobile communications device to display the information indicative of the determined at least one medical action includes causing the mobile communications device to issue a first notification at an outset of the time period and to issue a second notification at a later time during the time period.

15. The non-transitory computer readable medium of claim 1 , wherein each of the first image and the second image depicts the skin feature in proximity to at least one form of colorized surface having colored reference elements, and wherein the method further includes:
using the at least one form of colorized surface to determine local illumination conditions at a time of capture of the first image and at a time of capture of the second image; and
using the first image, the second image and the determined local illumination conditions for determining the changes over time of the multiple segments.

16. The non-transitory computer readable medium of claim 15 , wherein the at least one form of colorized surface includes a printed form and wherein a same copy of the printed form appears in both the first image and the second image.

17. The non-transitory computer readable medium of claim 15 , wherein the at least one form of colorized surface includes a printed form and wherein differing copies of the printed form appears in both the first image and the second image.

18. The non-transitory computer readable medium of claim 1 , wherein the first image of the skin feature is captured before applying a medical treatment to the skin feature, and the second image of the skin feature is captured at least a day after applying the medical treatment to the skin feature, and wherein the method further includes:
determining an effectiveness level of the medical treatment by comparing image data associated with changes between the first image and the second image; and
when effectiveness level is below a threshold, determining at least one additional medical action to be taken.

19. A method of conducting image processing of skin featur

Assignees

• Healthy Io Ltd

Inventors

• Adiri Yonatan
• Zohar Ron
• Omer Ido
• Ronen Matan
• Bubis Nathaniel
• Fine Nitai

Classifications

• G16H30/40 Primary

  for processing medical images, e.g. editing · CPC title

• G06T7/0016

  involving temporal comparison · CPC title

• G16H15/00

  ICT specially adapted for medical reports, e.g. generation or transmission thereof · CPC title

• G16H20/00

  ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance · CPC title

• G16H40/67

  for remote operation · CPC title