Automated therapy compliance video with avatar explaining compliance data

Patent metadata

Field	Value
Publication number	US-2024070952-A1
Application number	US-202318237492-A
Country	US
Kind code	A1
Filing date	Aug 24, 2023
Priority date	Aug 26, 2022
Publication date	Feb 29, 2024
Grant date	—

Abstract

Systems, apparatuses and methods provide technology for generating a video presentation, including determining a plurality of insights, each insight associated with a data presentation and, based on at least a portion of therapy compliance data for a patient, determining, for each insight, an insight location on a reporting dashboard and an avatar position for an avatar on the reporting dashboard, formulating a feedback message for each of the insights, and generating a video presentation based on the reporting dashboard, the video presentation including a display of the data presentations and a display of an animation sequence for the avatar, the animation sequence including, for each insight, a display of the avatar at the respective avatar position, the avatar pointing to the insight location for the insight, and a synchronized audio signal representing the feedback message for the insight.

First claim

We claim:

1 . A computer-implemented method of generating a video presentation, comprising:
determining a plurality of insights, each insight associated with a respective one of a plurality of data presentations and based on at least a portion of therapy compliance data for a patient; determining, for each of the plurality of insights:
an insight location for the respective insight on a reporting dashboard; and
an avatar position for an avatar on the reporting dashboard;
formulating a feedback message for each of the plurality of insights; and generating a video presentation based on the reporting dashboard, the video presentation including a display of the plurality of data presentations and a display of an animation sequence for the avatar, the animation sequence including, for each of the plurality of insights:
a display of the avatar at the respective avatar position, the avatar pointing to the insight location for the respective insight, and
a synchronized audio signal representing the feedback message for the respective insight.

2 . The method of claim 1 , wherein the respective avatar position is determined based on one or more of an avatar size, a type of the respective one of the plurality of data presentations, the insight location for the respective insight, an amount of free space in the reporting dashboard, or a location of free space in the reporting dashboard.

3 . The method of claim 1 , wherein determining each of the plurality of insights comprises:
retrieving a plurality of predetermined statements based on a type of the respective one of the plurality of data presentations; determining, for each of the plurality of predetermined statements, a confidence score representing a probability that the respective statement is true based on the therapy compliance data; and selecting the respective statement having the highest confidence score.

4 . The method of claim 1 , further comprising:
assigning a weight to each respective insight of the plurality of insights; and determining an order of presentation in the animation sequence for the plurality of insights based on the weight assigned to each respective insight.

5 . The method of claim 1 , wherein the weight assigned to each respective insight of the plurality of insights is based on one or more of a condition of the patient, a change in the therapy compliance data for the patient, a relevance of the insight to the behavior or overall therapy compliance data for the patient, whether the insight reflects a positive, neutral or negative report, or a confidence score for the insight.

6 . The method of claim 1 , wherein each respective feedback message is formulated based on one or more of a predetermined feedback message or natural language modeling applied to the insight.

7 . The method of claim 1 , wherein the video presentation further includes an interactive dialog portion including:
providing a prompt to a user; and receiving a user response to the prompt, wherein the video presentation is modified based on the user response to the prompt.

8 . A computing system comprising:
a processor; and a memory coupled to the processor, the memory comprising instructions which, when executed by the processor, cause the computing system to perform operations comprising:
determining a plurality of insights, each insight associated with a respective one of a plurality of data presentations and based on at least a portion of therapy compliance data for a patient;
determining, for each of the plurality of insights:
an insight location for the respective insight on a reporting dashboard; and
an avatar position for an avatar on the reporting dashboard;

formulating a feedback message for each of the plurality of insights; and
generating a video presentation based on the reporting dashboard, the video presentation including a display of the plurality of data presentations and a display of an animation sequence for the avatar, the animation sequence including, for each of the plurality of insights:
a display of the avatar at the respective avatar position, the avatar pointing to the insight location for the respective insight, and
a synchronized audio signal representing the feedback message for the respective insight.

9 . The system of claim 8 , wherein the respective avatar position is determined based on one or more of an avatar size, a type of the respective one of the plurality of data presentations, the insight location for the respective insight, an amount of free space in the reporting dashboard, or a location of free space in the reporting dashboard.

10 . The system of claim 8 , wherein determining each of the plurality of insights comprises:
retrieving a plurality of predetermined statements based on a type of the respective one of the plurality of data presentations; determining, for each of the plurality of predetermined statements, a confidence score representing a probability that the respective statement is true based on the therapy compliance data; and selecting the respective statement having the highest confidence score.

11 . The system of claim 8 , wherein the instructions, when executed by the processor, cause the computing system to perform further operations comprising:
assigning a weight to each respective insight of the plurality of insights; and determining an order of presentation in the animation sequence for the plurality of insights based on the weight assigned to each respective insight, wherein the weight assigned to each respective insight of the plurality of insights is based on one or more of a condition of the patient, a change in the therapy compliance data for the patient, a relevance of the insight to the behavior or overall therapy compliance data for the patient, whether the insight reflects a positive, neutral or negative report, or a confidence score for the insight, wherein each respective feedback message is formulated based on one or more of a predetermined feedback message or natural language modeling applied to the insight, and wherein the video presentation further includes an interactive dialog portion including:
providing a prompt to a user; and
receiving a user response to the prompt,
wherein the video presentation is modified based on the user response to the prompt.

12 . At least one non-transitory computer readable storage medium comprising instructions which, when executed by a computing system, cause the computing system to perform operations comprising:
determining a plurality of insights, each insight associated with a respective one of a plurality of data presentations and based on at least a portion of therapy compliance data for a patient; determining, for each of the plurality of insights:
an insight location for the respective insight on a reporting dashboard; and
an avatar position for an avatar on the reporting dashboard;
formulating a feedback message for each of the plurality of insights; and generating a video presentation based on the reporting dashboard, the video presentation including a display of the plurality of data presentations and a display of an animation sequence for the avatar, the animation sequence including, for each of the plurality of insights:
a display of the avatar at the respective avatar position, the avatar pointing to the insight location for the respective insight, and
a synchronized audio signal representing the feedback message for the respective insight.

13 . The at least one non-transitory computer readable storage medium of claim 12 , wherein the respective avatar position is determined based on one or more of an avata

Assignees

• Koninklijke Philips Nv

Inventors

• Krans Jan Martijn
• Shim Heereen
• Luksenburg Bas
• De Ruyter Boris Emmanuel Rachmund

Classifications

• G06T13/40 Primary

  of characters, e.g. humans, animals or virtual beings · CPC title

• G16H40/67 Primary

  for remote operation · CPC title

• G16H20/00

  ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance · CPC title