Method and apparatus for determining health status

Patent metadata

Field	Value
Publication number	US-10918331-B2
Application number	US-201816134516-A
Country	US
Kind code	B2
Filing date	Sep 18, 2018
Priority date	Sep 19, 2017
Publication date	Feb 16, 2021
Grant date	Feb 16, 2021

Abstract

Systems and methods for determining a heath status of a patient through an automated interview. One of the systems include one or more computers in one or more locations and one or more storage devices storing instructions that, when executed by one or more computers, cause the one or more computers to perform operations including: providing, to a user interface of a user device, questions for a user to respond to in an interactive manner, in which each of the questions following the first questions is adaptive based on the user's response to one or more of the previous questions; capturing motion and appearance of the user in a video sequence while the user is responding to the questions; and analyzing the motion of the user in the video sequence to determine one or more indications of a disease or of a change in a disease progression.

First claim

The invention claimed is:

1. A system comprising one or more computers in one or more locations and one or more storage devices storing instructions that, when executed by the one or more computers, cause the one or more computers to perform operations comprising: providing, to a user interface displayed on a display of a user device, a sequence of questions for a user to respond to in an interactive manner, wherein each of the questions following a first question of the sequence of questions is adaptive based on the user's response to one or more previous questions in the sequence; capturing, by an audio sensor of the user device, one or more verbal answers to the sequence of questions; capturing, by a camera of the user device, motion and appearance of the user in a video sequence while the user provides the one or more verbal answers to the sequence of questions, the motion and appearance of the user being depicted in the video sequence; and analyzing the motion of the user in the video sequence and the one or more verbal answers to determine one or more indications of a disease or of a change in a disease progression.

2. The system of claim 1 , wherein capturing the motion of the user comprises capturing one or more of the following: body motion, eye motion, emotions, heart rate, breathing patterns, skin tone, or speech tone of the user.

3. The system of claim 1 , wherein the operations comprising:
based on responses of the user to the sequence of questions, selectively requesting the user to perform one or more actions to complete a medical test.

4. The system of claim 3 , wherein capturing the motion and appearance of the user in the video sequence further comprises:
capturing further motion and appearance of the user while the user is performing the one or more actions to complete the medical test; and
wherein analyzing the motion of the user in the video sequence comprises analyzing the motion and appearance of the user while the user provides the one or more verbal answers to the sequence of questions and analyzing the further motion and appearance of the user while the user is performing the one or more actions to complete the medical test.

5. The system of claim 3 , wherein requesting the user to perform one or more actions comprises asking the user to hold the user device such that the camera of the user device focuses on a static object.

6. The system of claim 5 , comprising capturing camera motion of the user device with respect to the static object.

7. The system of claim 6 , wherein analyzing the motion of the user in the video sequence to determine the one or more indications of the disease or of the change in the disease progression comprises:
measuring the user's hand stability or tremor based on the captured camera motion; and
determining the one or more indications of the disease or of the change in the disease progression based on the measured hand stability or tremor.

8. The system of claim 3 , wherein requesting the user to perform one or more actions comprises asking the user to look at a moving object displayed on the user interface.

9. The system of claim 8 , wherein capturing the motion and appearance of the user comprise capturing eye movement of the user while the user is looking at the moving object.

10. The system of claim 9 , wherein analyzing the motion of the user comprises:
measuring the user's ability to focus on the moving object; and
determining the one or more indications of the disease or of the change in the disease progression based on the user's ability to focus on the moving object.

11. A computer-implemented method comprising:
providing, to a user interface displayed on a display of a user device, a sequence of questions for a user to respond to in an interactive manner, wherein each of the questions following a first question of the sequence of questions is adaptive based on the user's response to one or more previous questions in the sequence;
capturing, by an audio sensor of the user device, one or more verbal answers to the sequence of questions;
capturing, by a camera of the user device, motion and appearance of the user in a video sequence while the user provides the one or more verbal answers to the sequence of questions, the motion and appearance of the user being depicted in the video sequence; and
analyzing the motion of the user in the video sequence and the one or more verbal answers to determine one or more indications of a disease or of a change in a disease progression.

12. The method of claim 11 , wherein capturing the motion of the user comprises capturing one or more of the following: body motion, eye motion, emotions, heart rate, breathing patterns, skin tone, or speech tone of the user.

13. The method of claim 11 , further comprising:
based on responses of the user to the sequence of questions, selectively requesting the user to perform one or more actions to complete a medical test.

14. The method of claim 13 , wherein capturing the motion and appearance of the user in the video sequence further comprises:
capturing further motion and appearance of the user while the user is performing the one or more actions to complete the medical test; and
wherein analyzing the motion of the user in the video sequence comprises analyzing the motion and appearance of the user while the user provides the one or more verbal answers to the sequence of questions and analyzing the further motion and appearance of the user while the user is performing the one or more actions to complete the medical test.

15. The method of claim 14 , wherein selectively requesting the user to perform one or more actions comprises asking the user to hold the user device such that the camera of the user device focuses on a static object.

16. The method of claim 15 , comprising capturing camera motion of the user device with respect to the static object.

17. The method of claim 16 , wherein analyzing the motion of the user in the video sequence to determine the one or more indications of the disease or of the change in the disease progression comprises:
measuring the user's hand stability or tremor based on the captured camera motion; and
determining the one or more indications of the disease or of the change in the disease progression based on the measured hand stability or tremor.

18. The method of claim 13 , wherein selectively requesting the user to perform one or more actions comprises asking the user to look at a moving object displayed on the user interface.

19. The method of claim 18 , wherein capturing the motion and appearance of the user comprise capturing eye movement of the user while the user is looking at the moving object.

20. The method of claim 19 , wherein analyzing the motion of the user comprises:
measuring the user's ability to focus on the moving object; and
determining the one or more indications of the disease or of the change in the disease progression based on the user's ability to focus on the moving object.

21. One or more non-transitory computer-readable storage media storing instructions that, when executed by one or more computers, cause the one or more computers to perform operations comprising:
providing, to a user interface displayed on a display of a user device, a sequence of questions for a user to respond to in an interactive manner, wherein each of the questions following a first question of the sequence of questions is adaptive based on the user's response to one or more previous questions in the sequence;
captur

Assignees

• Aic Innovations Group Inc

Inventors

• Hanina Adam
• Glasner Daniel
• Zhang Li

Classifications

• G06T2207/30004

  Biomedical image processing · CPC title

• G06T2207/20081

  Training; Learning · CPC title

• G06T2207/30204

  Marker · CPC title

• G16H20/00

  ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance · CPC title

• G06T2207/30196

  Human being; Person · CPC title