Augmented-reality systems and methods for guided installation of medical devices

Patent metadata

Field	Value
Publication number	US-12579767-B2
Application number	US-202418623451-A
Country	US
Kind code	B2
Filing date	Apr 1, 2024
Priority date	Apr 4, 2023
Publication date	Mar 17, 2026
Grant date	Mar 17, 2026

Abstract

The present disclosure relates to augmented-reality systems and methods, and more specifically to systems and methods of providing automated support instructions to patients during medical device unboxing and installation via an augmented reality-enabled device. While adoption of remote patient monitoring and remote patient care (e.g., telehealth) has greatly accelerated, most medical devices are not designed for usage by laypersons. Thus, the systems and methods of the present disclosure provide easy and accessible guidance to patients now tasked with unboxing and installation complex medical devices without the support of a trained healthcare professional.

First claim

What is claimed is:

1 . A system for providing automated support instructions to a subject during assembly and installation of a medical device configured to be coupled to a subject in an outpatient setting, the medical device comprising at least one physiological sensor configured to measure at least one physiological parameter associated with the subject when the medical device is coupled to the subject, the system comprising:
an augmented reality-enabled device comprising a display, at least a first camera, and one or more processors in communication with the display and at least the first camera, wherein the one or more processors are configured to:
receive, via at least the first camera, video data comprising images of the medical device and/or a packaging of the medical device;
communicate with a remote content server to transmit the images of the medical device and/or the packaging of the medical device and to receive setup information associated with the medical device, wherein the setup information comprises three-dimensional model data associated with the medical device and/or the packaging of the medical device;
create a first composite visual feed from the three-dimensional model data and the video data received via at least the first camera; and
display, via the display of the augmented reality-enabled device, the first composite visual feed.

2 . The system of claim 1 , wherein the setup information further comprises instructions having one or more steps for unpackaging and/or assembling the medical device.

3 . The system of claim 2 , wherein the one or more processors of the augmented reality-enabled device are further configured to:
create a first composite visual feed from the three-dimensional model data and the video data received via at least the first camera, wherein the first composite visual feed includes at least a portion of the instructions having one or more steps for unpackaging and/or coupling the medical device to the subject; and display, via the display of the augmented reality-enabled device, the first composite visual feed comprising at least the portion of the instructions.

4 . The system of claim 1 , wherein the augmented reality-enabled device further comprising at least a second camera, the first camera having a first field of view and the second camera having a second field of view that is different from the first field of view, and
wherein the one or more processors of the augmented reality-enabled device are further configured to:
receive, via at least the second camera, video data comprising images of the medical device and at least a portion of the subject's body;
communicate with the remote content server to transmit the images of the portion of the subject's body and receive body modeling data associated with the subject's body;
create a second composite visual feed from the received body modeling data and the video data received via at least the second camera; and
display, via the display of the augmented reality-enabled device, the second composite visual feed.

5 . The system of claim 1 , wherein the one or more processors of the augmented reality-enabled device are further configured to:
detect, based on the video data received from at least the first camera, completion of a predetermined action associated with the medical device and/or the packaging of the medical device; and automatically switch from receiving video data via at least the first camera to receiving video data via at least the second camera.

6 . The system of claim 5 , wherein the predetermined action is indicative of the medical device leaving a first field of view of at least the first camera of the augmented reality-enable device.

7 . The system of claim 6 , wherein the predetermined action is indicative of the medical device entering a second field of view of at least the second camera of the augmented reality-enabled device.

8 . The system of claim 1 , wherein the one or more processors of the augmented reality-enable device are further configured to:
track, using the video data received via at least the first camera, a relative position and/or orientation of the medical device and/or the packaging of the medical device; and create a first composite visual feed from the three-dimensional model data and the video data received via at least the first camera, wherein the first composite visual feed is a dynamic composite visual feed that updates a relative position and/or orientation of the three-dimensional model data based on the tracking of the relative position and/or orientation of the medical device and/or the packaging of the medical device.

9 . The system of claim 4 , wherein the one or more processors of the augmented reality-enabled device are further configured to:
track, using the video data received via at least the second camera, a relative position and/orientation of the subject's body; and create a second composite visual feed from the body modeling data and the video data received via at least the second camera, wherein the second composite visual feed is a dynamic composite visual feed that updates a relative position and/or orientation of the body modeling data based on the tracking of the relative position and/or orientation of the subject's body.

10 . The system of claim 1 , wherein the one or more processors of the augmented reality-enabled device are further configured to:
identify, based on the video data received via at least the first camera, a type of the medical device and/or a packaging status of the medical device.

11 . An augmented-reality system configured to assist a subject in the outpatient usage of a medical device, the system comprising:
a medical device configured to be coupled to a subject, the medical device comprising at least one physiological sensor configured to measure at least one physiological parameter associated with the subject when the medical device is coupled to the subject; and an augmented reality-enabled device comprising a display, at least a first camera having a first field of view, at least a second camera having a second field of view, a wireless communication device, and one or more processors in communication with the display, the wireless communication device, and the first and second cameras, wherein the one or more processors are configured to:
receive, via at least the first camera, video data comprising images of the medical device and/or a packaging of the medical device;
communicate, via the wireless communication device, with a remote content server to transmit the images of the medical device and/or the packaging of the medical device and to receive setup information associated with the medical device, wherein the setup information comprises three-dimensional model data associated with the medical device and/or the packaging of the medical device;
create a first composite visual feed from three-dimensional model data and the video data received via the first camera;
display, via the display of the augmented reality-enabled device, the first composite visual feed;
receive, via at least the second camera, video data comprising images of at least a portion of the subject's body;
communicate, via the wireless communication device, with the remote content server to transmit the images of the portion of the subject's body and receive body modeling data associated with the subject's body;
create a second composite visual feed from the received body modeling data and the video data received via at least the second camera; and
display, via the display of the augmented reality-enabled device, the second composite visual feed.

12 . A method of u

Assignees

• Koninklijke Philips Nv

Inventors

• Krans Jan Martijn
• Lowet Dietwig Jos Clement

Classifications

• G06T2219/2016

  Rotation, translation, scaling · CPC title

• G06T2210/41

  Medical · CPC title

• G06T2207/30196

  Human being; Person · CPC title

• G06T2207/10016

  Video; Image sequence · CPC title

• G06T2200/08

  involving all processing steps from image acquisition to 3D model generation · CPC title