Augmented reality information system for use with a medical device

Patent metadata

Field	Value
Publication number	US-10969583-B2
Application number	US-201715442280-A
Country	US
Kind code	B2
Filing date	Feb 24, 2017
Priority date	Feb 24, 2017
Publication date	Apr 6, 2021
Grant date	Apr 6, 2021

Abstract

An augmented-reality system for providing information relating to a wearable medical device and/or a patient wearing a medical device. An augmented-reality enabled computing device includes an image acquisition device, a user interface operatively coupled to the image acquisition device, the user interface configured to receive streaming images of a scene having one or more predetermined recognizable features, and a processor operably connected to the user interface. The processor is configured receive the streaming images, analyze the one or more predetermined recognizable features to determine a context of the scene, retrieve information relating to at least one of the medical device and the patient wearing the medical device, the information corresponding to the determined context of the scene, and augment the received streaming images with contextual information relating to at least one of the medical device and the patient wearing the medical device.

First claim

The invention claimed is:

1. An augmented-reality system for providing information, the system comprising:
a wearable medical device configured to be worn by a patient on a body of the patient, the wearable medical device comprising
at least one electrocardiogram (ECG) sensor coupled to the patient and configured to sense at least one ECG signal for the patient,
a controller operably coupled to the at least one ECG sensor and configured to
receive the at least one ECG signal from the at least one ECG sensor, and
produce one or more cardiac parameters for the patient based upon the at least one ECG signal,

at least one therapy electrode configured to couple to the patient and operably coupled to the controller, the at least one therapy electrode configured to produce, based upon the one or more cardiac parameters, a therapy shock,
an electrode belt, and
a garment comprising the electrode belt, the at least one ECG sensor, and the at least one therapy electrode; and

an augmented-reality enabled computing device comprising
an image acquisition device,
a display operatively coupled to the image acquisition device, the display configured to receive and display a video of a scene having one or more predetermined recognizable features, and
a processor operably connected to the display, the processor configured to execute one or more computer-readable instructions to cause the processor to
receive the video of the scene, the video comprising the wearable medical device,
process the video to analyze the one or more predetermined recognizable features to detect a presence of the wearable medical device within the scene, wherein the recognizable features define at least one of a plurality of components of the wearable medical device, the plurality of components comprising the at least one ECG sensor, the controller, the at least one therapy electrode, the electrode belt, and the garment,
process the video to determine a context of the scene comprising an environment of the wearable medical device and at least one of the plurality of components of the wearable medical device,
retrieve contextual information relating to the wearable medical device and the at least one of the plurality of components of the wearable medical device based on the context of the scene, the contextual information comprising at least
operational information relating to the at least one of the plurality of components of the wearable medical device, and
activity information related to a walk test the patient is performing, wherein the processor is configured to query the patient wearing the wearable medical device to answer one or more questions upon completion of the walk test, the one or more questions comprising questions related to shortness of breath, overall fatigue, and pain or numbness in extremities of the patient, and

based on the retrieved contextual information relating to the wearable medical device and the at least one of the plurality of components of the wearable medical device, augment the received video with at least a portion of the contextual information relating to the wearable medical device and the at least one of the plurality of components of the wearable medical device such that at least a portion of the operational information related to the at least one of the plurality of components of the wearable medical device and at least a portion of the activity information is overlaid on the video of the scene and displayed on the display.

2. The system of claim 1 , wherein the processor is configured to process the video to analyze the one or more predetermined recognizable features to detect the presence of the wearable medical device within the scene by:
scanning the video for a shape having one or more identified distinguishing features;
comparing the one or more identified distinguishing features against a library of the one or more predetermined recognizable features;
identifying a match between the one or more identified distinguishing features and at least one predetermined recognizable feature; and
identifying the at least one of the plurality of components of the wearable medical device based upon the match.

3. The system of claim 2 , wherein the one or more identified distinguishing features comprises at least one of a barcode, a serial number, a QR code, and an identified physical shape of at least one component of the wearable medical device.

4. The system of claim 1 , wherein the contextual information further comprises diagnostic component information for the at least one of the plurality of components of the wearable medical device.

5. The system of claim 1 , wherein the contextual information further comprises instructions for a user of the augmented-reality enabled computing device to orient the augmented-reality enabled computing device such that the image acquisition device is directed to the at least one of the plurality of components of the wearable medical device.

6. The system of claim 5 , wherein the processor is further configured to:
retrieve component information related to the at least one of the plurality of components of the wearable medical device; and
augment the received video with the component information.

7. The system of claim 1 , wherein the augmented-reality enabled computing device is configured to provide, via the display, an interactive experience simulating operation of the wearable medical device.

8. The system of claim 7 , wherein the interactive experience comprises simulating a fibrillation and treatment event.

9. The system of claim 1 , wherein the one or more predetermined recognizable features comprises an outline of at least a portion of the body of the patient and the processor is further configured to detect a presence of the patient based on the one or more predetermined recognizable features.

10. The system of claim 1 , wherein the contextual information further comprises operating instructions for the wearable medical device, and wherein the operating instructions are overlaid on the video of the scene and displayed on the display.

11. The system of claim 10 , wherein the operating instructions comprise assembly instructions for assembling the wearable medical device.

12. The system of claim 1 , wherein the augmented-reality enabled computing device further comprises a personal computing device used by at least one of the patient wearing the wearable medical device and a person other than the patient wearing the wearable medical device.

13. The system of claim 12 , wherein the personal computing device comprises a wearable computing device configured to provide at least one of audio, video, and haptic feedback to the at least one of the patient and the person other than the patient via the display.

14. The system of claim 1 , wherein the processor is further configured to:
establish a communication session with a remote communications device;
receive the contextual information relating to the wearable medical device from the remote communication device; and
augment the received video with the contextual information relating to the wearable medical device.

15. The system of claim 14 , wherein the contextual information relating to the wearable medical device comprises troubleshooting information related to operation of the wearable medical device.

16. The system of claim 15 , wherein the troubleshooting information comprises a set of instructions for a user of the wearable medical device to perform.

17. The system of claim 1 , wherein the display is configured to display the video of the scene as a real-tim

Assignees

• Zoll Medical Corp

Inventors

• Hresko Patrick
• Kaib Thomas E
• Volpe Shane S
• Owens Grace
• Pavel Trisha A
• Clark John G

Classifications

• A61B5/282 Primary

  Holders for multiple electrodes (for introduction into the body A61B5/287) · CPC title

• G06V20/41

  Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49) · CPC title

• G06V20/20

  in augmented reality scenes · CPC title

• A61B5/0006

  ECG or EEG signals · CPC title

• G02B27/017

  Head mounted · CPC title