System and method for remote virtual reality control of movable vehicle partitions

Patent metadata

Field	Value
Publication number	US-2016147233-A1
Application number	US-201414548596-A
Country	US
Kind code	A1
Filing date	Nov 20, 2014
Priority date	Nov 20, 2014
Publication date	May 26, 2016
Grant date	—

Abstract

A method for remote virtual reality control of movable vehicle partitions includes displaying a graphic model of at least a portion of a vehicle on an output device. The output device is located remotely from the vehicle and the vehicle has one or more movable vehicle partitions. The method includes processing images received from one or more imaging devices, the images including gestures relative to the graphic model. The method includes identifying one or more vehicle commands based on the gestures relative to the graphic model. The vehicle commands define control of the one or more movable vehicle partitions. The method further includes executing the vehicle commands at the vehicle.

First claim

1 . A computer-implemented method for remote virtual reality control of movable vehicle partitions, comprising:
displaying a graphic model of at least a portion of a vehicle on an output device, the output device located remotely from the vehicle, the vehicle having one or more movable vehicle partitions; processing images received from one or more imaging devices, the images including gestures relative to the graphic model; identifying one or more vehicle commands based on the gestures relative to the graphic model, the vehicle commands defining control of the one or more movable vehicle partitions; and executing the vehicle commands at the vehicle.

2 . The computer-implemented method of claim 1 , wherein the graphic model is a three-dimensional virtual reality model of the vehicle.

3 . The computer-implemented method of claim 1 , comprising updating the display of the graphic model based on the gestures relative to the graphic model.

4 . The computer-implemented method of claim 1 , comprising streaming a real-time video feed of the vehicle to the output device, the video feed received from one or more imaging devices located near the vehicle.

5 . The computer-implemented method of claim 4 , comprising streaming a real-time audio feed to the output device corresponding to the real-time video feed of the vehicle.

6 . The computer-implemented method of claim 1 , comprising generating a real-time virtual reality model of the vehicle based on sensor data received from the vehicle.

7 . The computer-implemented method of claim 6 , comprising displaying the real-time virtual reality model of the vehicle on the output device.

8 . The computer-implemented method of claim 7 , wherein the real-time virtual reality model of the vehicle is displayed simultaneously with the graphic model.

9 . The computer-implemented method of claim 1 , comprising storing the one or more vehicle commands in a memory.

10 . The computer-implemented method of claim 9 , comprising receiving at the output device, an authentication signal from the vehicle when the output device is located within a predetermined range of the vehicle.

11 . The computer-implemented method of claim 10 , wherein executing the vehicle commands at the vehicle includes, upon receiving the authentication signal, transmitting from the output device to the vehicle the one or more vehicle commands.

12 . A system for remote virtual reality control of movable vehicle partitions, comprising:
a vehicle having a controller and one or more movable vehicle partitions, the controller operably connected for computer communication to an output device; the output device, located remotely from the vehicle, the output device having a display, wherein the output device displays a graphic model of at least a portion of the vehicle on the display, wherein the output device includes a processor and the processor includes: a gesture module processes images received from one or more imaging devices, the images including gestures relative to the graphic model; and a vehicle command module identifies one or more vehicle commands based on the gestures relative to the graphic model, the vehicle commands defining control of the one or more movable vehicle partitions, the vehicle command module transmits the one or more vehicle commands to the controller for execution at the vehicle.

13 . The system of claim 12 , wherein the display of the output device includes a first user interface and a second user interface.

14 . The system of claim 13 , wherein the gesture module displays the graphic model on the first interface and the gesture module streams a real-time video feed of the vehicle to the second interface, the video feed received from one or more imaging devices located near the vehicle.

15 . The system of claim 13 , wherein the gesture module generates a real-time virtual reality model of the vehicle and displays the real-time virtual reality model of the vehicle on the second interface.

16 . The system of claim 12 , comprising a passive entry system, wherein upon the passive entry system authenticating the output device when the passive entry system determines the output device is within a predetermined range of the vehicle, the vehicle command module transmits the one or more vehicle commands to the controller for execution at the vehicle.

17 . The system of claim 12 , wherein the output device includes a database of one or more graphic models, each model associate with a vehicle and a user.

18 . The system of claim 17 , wherein the vehicle command module stores the one or more vehicle commands and associates the one or more vehicle commands with the user and the vehicle associated with the graphic model displayed on the output device, the vehicle command module transmits the one or more vehicle commands to a controller of the vehicle associated with the graphic model displayed on the output device.

19 . A non-transitory computer-readable storage medium storing instructions that, when executed by a computer, causes the computer to perform a method comprising:
displaying a graphic model of at least a portion of a vehicle on an output device, the output device located remotely from the vehicle, the vehicle having one or more movable vehicle partitions; processing images received from one or more imaging devices, the images including gestures relative to the graphic model; identifying one or more vehicle commands based on the gestures relative to the graphic model, the vehicle commands defining control of the one or more movable vehicle partitions; and transmitting the vehicle commands to the vehicle for execution.

20 . The non-transitory computer-readable storage medium of claim 19 , comprising generating a real-time virtual reality model of the vehicle and displaying the real-time virtual reality model of the vehicle on the output device simultaneously with the graphic model.

Assignees

• Honda Motor Co Ltd

Inventors

• Whinnery Joseph

Classifications

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• B60K35/26

  using acoustic output · CPC title

• B60K35/211

  producing three-dimensional [3D] effects, e.g. stereoscopic images · CPC title

• B60K35/29

  Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions · CPC title

• B60K35/23

  Head-up displays [HUD] (optical aspects of head-up displays G02B27/01) · CPC title