Graphical user interfaces including touchpad driving interfaces for telemedicine devices

Patent metadata

Field	Value
Publication number	US-2016283685-A1
Application number	US-201615154518-A
Country	US
Kind code	A1
Filing date	May 13, 2016
Priority date	May 22, 2012
Publication date	Sep 29, 2016
Grant date	—

Abstract

The present disclosure describes various aspects of remote presence interfaces (RPIs) for use on portable electronic devices (PEDs) to interface with remote telepresence devices. An RPI may allow a user to interact with a telepresence device, view a live video feed, provide navigational instructions, and/or otherwise interact with the telepresence device. The RPI may allow a user to manually, semi-autonomously, or autonomously control the movement of the telepresence device. One or more panels associated with a video feed, patient data, calendars, date, time, telemetry data, PED data, telepresence device data, healthcare facility information, healthcare practitioner information, menu tabs, settings controls, and/or other features may be utilized via the RPI.

First claim

What is claimed:

1 . A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, are configured to cause the processor to perform operations comprising:
communicatively connecting an electronic device to a remote presence device; selectively displaying a video feed from the remote presence device in a video panel on an electronic display of the electronic device; selectively displaying patient information simultaneously with the live video feed; receiving a navigation input that forms at least part of an intended navigation path of the remote presence device; displaying at least a portion of the intended navigation path of the remote presence device overlaid on the live video feed; transforming the navigation input into navigation instructions that are interpretable by the remote presence device; and transmitting the navigation instructions associated with the navigation input to the remote presence device.

2 . The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:
selectively displaying a toolbar comprising at least one selectable setting function associated with at least one of the electronic device and the remote presence device.

3 . The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:
selectively displaying a plurality of destination locations within a healthcare facility; receiving a selection of one of the plurality of destination locations within the healthcare facility as the navigation input; and transmitting the navigation instructions associated with the selected destination location to the remote presence device.

4 . The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:
selectively displaying a map of a healthcare facility associated with the remote presence device, and wherein the navigation input is provided with respect to the map.

5 . The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:
receiving a selection of an avatar to visually represent the operator of the electronic device; and transmitting the selected avatar to the remote presence device.

6 . The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:
selectively overlaying a plurality of directional icons on the live video feed within the video panel, and wherein receiving a navigation input comprises at least one of:
receiving a selection of a left directional icon to move the remote presence device to the left relative to the live video feed; and
receiving a selection of a right directional icon to move the remote presence device to the right relative to the live video feed;
receiving a selection of a reverse directional icon to move the remote presence device in reverse relative to the live video feed; and
receiving a selection of a forward directional icon to move the remote presence device forward relative to the live video feed.

7 . The non-transitory computer-readable storage medium of claim 6 , wherein the navigation instructions associated with a selection of the reverse directional icon are configured to orient the live video feed from the remote presence device in the direction of movement, independent of a direction the remote presence device is facing.

8 . The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:
selectively displaying a selection of navigational modes, including at least one of:
a cursor pointer mode configured to allow an operator to provide a navigation input relative to the live video feed via an on-screen cursor;
a head mode configured to allow an operator to provide a navigation input for controlling only the movement of a head portion of the remote presence device;
a laser pointer mode configured to allow an operator to provide a navigation input relative to the live video feed by controlling the location of a simulated on-screen illumination point;
a map drive mode configured to allow an operator to provide a navigation input relative to a displayed map;
a click drive mode configured to allow an operator to provide a navigation input relative to the live video feed by selecting a location within the live video feed; and
a drag-drive mode configured to allow an operator to provide a navigation input relative to the live video feed by defining a navigational path within the live video feed; and
receiving a selection of a navigational mode.

9 . The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:
selectively displaying a plurality of patient identifiers, wherein each patient identifier is associated with a location within a healthcare facility; receiving a selection of one of the plurality of patient identifiers; and transmitting navigation instructions based on the location within the healthcare facility associated with the selected patient identifier.

10 . The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:
displaying a request for a selection of at least one of a plurality of remote presence devices; receiving a selection of one of the plurality of remote presence devices; displaying a request for a selection of at least one of plurality of patients, each of the plurality of patients associated with a location within a healthcare facility; receiving a selection of one of the plurality of patients; and communicatively connecting the electronic device to the selected remote presence device, and wherein receiving the navigation input comprises receiving the location within the healthcare facility associated with the selected patient.

11 . The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:
selectively displaying an avatar representation of the remote telepresence device in an avatar panel on the electronic display of the electronic device.

12 . The non-transitory computer-readable storage medium of claim 1 , wherein the intended navigation path is overlaid as an arrow on the live video feed.

13 . A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, are configured to cause the processor to perform operations comprising:
communicatively connecting an electronic device to a remote presence device; selectively displaying a video feed from the remote presence device in a video panel on an electronic display of the electronic device; selectively displaying patient information simultaneously with the live video feed; selectively displaying a list of destinations within a healthcare facility; receiving a navigation input with respect to the displayed list of destinations; transforming the navigation input into navigation instructions that are interpretable by the remote presence device; and transmitting the navigation instructions associated with the navigation input to the remote presence device.

14 . A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, are configured to cause the processor to perform operations comprising:
communicatively connecting an electronic device to a remote presence device; displaying a video feed from the remote telepresence device in a video panel on an electronic display of the electronic device; displaying a first virtual joystick on the electronic display of the electronic device; receiving

Assignees

• Intouch Tech Inc
• Irobot Corp

Inventors

• Jordan Charles S
• Young Andy
• Ng Mei Sheng
• Lurie Yair
• Lai Fuji
• Wright Timothy C
• Herzog Cody
• Whitney Blair
• Rizzi Bill
• Ballantyne James
• Wang Yulun
• Wong Cheuk Wah
• Kearns Justin
• Taka Orjeta
• Karandikar Ramchandra

Classifications

• G05D1/2232

  Touch screens · CPC title

• G05D1/2247

  providing the operator with simple or augmented images from one or more cameras · CPC title

• G05D1/2246

  displaying a map of the environment · CPC title

• G05D2107/65

  Hospitals · CPC title

• G05D2105/34

  for telepresence or videoconferencing · CPC title