Graphical user interfaces including touchpad driving interfaces for telemedicine devices

Patent metadata

Field	Value
Publication number	US-10061896-B2
Application number	US-201615154518-A
Country	US
Kind code	B2
Filing date	May 13, 2016
Priority date	May 22, 2012
Publication date	Aug 28, 2018
Grant date	Aug 28, 2018

Abstract

The present disclosure describes various aspects of remote presence interfaces (RPIs) for use on portable electronic devices (PEDs) to interface with remote telepresence devices. An RPI may allow a user to interact with a telepresence device, view a live video feed, provide navigational instructions, and/or otherwise interact with the telepresence device. The RPI may allow a user to manually, semi-autonomously, or autonomously control the movement of the telepresence device. One or more panels associated with a video feed, patient data, calendars, date, time, telemetry data, PED data, telepresence device data, healthcare facility information, healthcare practitioner information, menu tabs, settings controls, and/or other features may be utilized via the RPI.

First claim

What is claimed:

1. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, are configured to cause the processor to perform operations comprising:
communicatively connecting an electronic device to a remote presence device;
selectively displaying a live video feed from a camera of the remote presence device in a video panel on an electronic display of the electronic device;
receiving a navigation input that forms at least part of an intended navigation path of the remote presence device, wherein receiving a navigation input comprises:
overlaying a vector graphically represented as a line or arrow on the live video feed, wherein the vector has beginning point and an end point, the beginning point representing a current location of the remote telepresence device within the live video feed;
allowing an operator to move the end point of the vector with respect to the live video feed while the remote telepresence device is in motion, wherein a horizontal component of the vector is used to determine a magnitude and direction of a rotational velocity and/or an angular displacement of the remote telepresence device, and wherein a vertical component of the vector is used to determine a magnitude of a forward velocity and/or a forward displacement of the remote telepresence device;

displaying at least a portion of the intended navigation path of the remote presence device overlaid on the live video feed, wherein the displayed intended navigation path includes the vector;
transforming the navigation input into navigation instructions that are interpretable by the remote presence device;
transmitting the navigation instructions associated with the navigation input to the remote presence device;
updating the live video feed as the remote presence device moves in accordance with the navigation instructions.

2. The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:
selectively displaying a toolbar comprising at least one selectable setting function associated with at least one of the electronic device and the remote presence device.

3. The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:
selectively displaying a plurality of destination locations within a healthcare facility;
receiving a selection of one of the plurality of destination locations within the healthcare facility as the navigation input; and
transmitting the navigation instructions associated with the selected destination location to the remote presence device.

4. The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:
selectively displaying a map of a healthcare facility associated with the remote presence device, and
wherein the navigation input is provided with respect to the map.

5. The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:
receiving a selection of an avatar to visually represent the operator of the electronic device; and
transmitting the selected avatar to the remote presence device.

6. The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:
selectively overlaying a plurality of directional icons on the live video feed within the video panel, and
wherein receiving a navigation input comprises at least one of:
receiving a selection of a left directional icon to move the remote presence device to the left relative to the live video feed; and
receiving a selection of a right directional icon to move the remote presence device to the right relative to the live video feed;
receiving a selection of a reverse directional icon to move the remote presence device in reverse relative to the live video feed; and
receiving a selection of a forward directional icon to move the remote presence device forward relative to the live video feed.

7. The non-transitory computer-readable storage medium of claim 6 , wherein the navigation instructions associated with a selection of the reverse directional icon are configured to orient the live video feed from the remote presence device in the direction of movement, independent of a direction the remote presence device is facing.

8. The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:
selectively displaying a selection of navigational modes, including at least one of:
a cursor pointer mode configured to allow an operator to provide a navigation input relative to the live video feed via an on-screen cursor;
a head mode configured to allow an operator to provide a navigation input for controlling only the movement of a head portion of the remote presence device;
a laser pointer mode configured to allow an operator to provide a navigation input relative to the live video feed by controlling the location of a simulated on-screen illumination point;
a map drive mode configured to allow an operator to provide a navigation input relative to a displayed map;
a click drive mode configured to allow an operator to provide a navigation input relative to the live video feed by selecting a location within the live video feed; and
a drag-drive mode configured to allow an operator to provide a navigation input relative to the live video feed by defining a navigational path within the live video feed; and
receiving a selection of a navigational mode.

9. The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:
selectively displaying a plurality of patient identifiers, wherein each patient identifier is associated with a location within a healthcare facility;
receiving a selection of one of the plurality of patient identifiers; and
transmitting navigation instructions based on the location within the healthcare facility associated with the selected patient identifier.

10. The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:
displaying a request for a selection of at least one of a plurality of remote presence devices;
receiving a selection of one of the plurality of remote presence devices;
displaying a request for a selection of at least one of plurality of patients, each of the plurality of patients associated with a location within a healthcare facility;
receiving a selection of one of the plurality of patients; and
communicatively connecting the electronic device to the selected remote presence device, and
wherein receiving the navigation input comprises receiving the location within the healthcare facility associated with the selected patient.

11. The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:
selectively displaying an avatar representation of the remote telepresence device in an avatar panel on the electronic display of the electronic device.

12. The non-transitory computer-readable storage medium of claim 1 , wherein the intended navigation path is overlaid as an arrow on the live video feed.

13. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, are configured to cause the processor to perform operations comprising:
communicatively connecting an electronic device to a remote presence device;
selectively displaying a live video feed from a camera of the remote presence device in a video panel on an electronic display of the electronic device;
selectively displaying a list of destinations within a healthcare facility;
receiving a navigation inp

Assignees

• Intouch Tech Inc
• Irobot Corp

Inventors

• Jordan Charles S
• Young Andy
• Ng Mei Sheng
• Lurie Yair
• Lai Fuji
• Wright Timothy C
• Herzog Cody
• Whitney Blair
• Rizzi Bill
• Ballantyne James
• Wang Yulun
• Wong Cheuk Wah
• Kearns Justin H
• Taka Orjeta
• Karandikar Ramchandra

Classifications

• H04N7/142

  Constructional details of the terminal equipment, e.g. arrangements of the camera and the display · CPC title

• H04N7/147

  Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q) · CPC title

• G06Q50/22

  Social work or social welfare, e.g. community support activities or counselling services · CPC title

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G06F3/04847

  Interaction techniques to control parameter settings, e.g. interaction with sliders or dials · CPC title