System and method for dynamic in-vehicle virtual reality

Patent metadata

Field	Value
Publication number	US-2019166352-A1
Application number	US-201916262814-A
Country	US
Kind code	A1
Filing date	Jan 30, 2019
Priority date	Oct 3, 2013
Publication date	May 30, 2019
Grant date	—

Abstract

A method for rendering views to an output device in a vehicle, including receiving vehicle data from a portable device. The vehicle data includes vehicle dynamics data and predictive vehicle data within a frame of reference of an exterior environment of the vehicle. The method also includes generating a view based on the vehicle data and a model. The model includes one or more components that define the view. The method also includes determining a difference between the vehicle dynamics data and the predictive vehicle data indicative of a perspective based on motion of the vehicle within the frame of reference of the exterior environment of the vehicle. The method further includes rendering the view to the output device by controlling the output device to update display of the view according to the model and the determined difference.

First claim

1 . A computer-implemented method for rendering views to an output device in a vehicle, comprising:
receiving vehicle data from a portable device, wherein the vehicle data includes vehicle dynamics data and predictive vehicle data within a frame of reference of an exterior environment of the vehicle; generating a view based on the vehicle data and a model, the model including one or more components that define the view; determining a difference between the vehicle dynamics data and the predictive vehicle data indicative of a perspective based on motion of the vehicle within the frame of reference of the exterior environment of the vehicle; rendering the view to the output device by controlling the output device to update display of the view according to the model and the determined difference.

2 . The computer-implemented method of claim 1 , wherein the predictive vehicle data triggers an event to define the view.

3 . The computer-implemented method of claim 1 , wherein the vehicle dynamics data includes a current velocity, a current orientation, and a current location of the vehicle, and wherein the predictive vehicle data includes a future velocity, a future orientation, and a future location of the vehicle at a future time.

4 . The computer-implemented method of claim 3 , wherein determining the difference between the vehicle dynamics data and the predictive vehicle data includes determining a relative velocity of the vehicle at a current time relative to the future time, and wherein rendering the view to the output device includes modifying the view according to the model and the relative velocity.

5 . The computer-implemented method of claim 1 , wherein the predictive vehicle data is calculated based on the vehicle data from the portable device.

6 . The computer-implemented method of claim 1 , wherein rendering the view includes augmenting the one or more components of the model based on the determined difference.

7 . The computer-implemented method of claim 1 , wherein the predictive vehicle data is calculated based on user data received from the portable device, and wherein the user data includes a velocity, an orientation and a location of a user within a frame of reference of the vehicle, wherein the user is located in the vehicle.

8 . A computing system for rendering views to an output device in a vehicle that is moving, comprising:
a processor operatively connected for computer communication to one or more vehicle systems of the vehicle and the output device, the processor including: a virtual reality data module receiving vehicle data from a portable device, wherein the vehicle data includes vehicle dynamics data and predictive vehicle data within a frame of reference of an exterior environment of the vehicle; a dynamic virtual reality module generates a view based on the vehicle data and a model, the model including one or more components that define the view; a rendering module determines a difference between the vehicle dynamics data and the predictive vehicle data indicative of a perspective based on motion of the vehicle within the frame of reference of the exterior environment of the vehicle, and renders the view to the output device by controlling the output device to update display of the view according to the model and the determined difference.

9 . The computing system of claim 8 , wherein the predictive vehicle data triggers an event to define the view.

10 . The computing system of claim 8 , wherein the vehicle dynamics data includes a current velocity, a current orientation, and a current location of the vehicle, and wherein the predictive vehicle data includes a future velocity, a future orientation, and a future location of the vehicle at a future time.

11 . The computing system of claim 10 , wherein the rendering module determines the difference between the vehicle dynamics data and the predictive vehicle data by determining a relative velocity of the vehicle at a current time relative to the future time, and renders the view to the output device by modifying the view according to the model and the relative velocity.

12 . The computing system of claim 8 , wherein the predictive vehicle data is calculated based on the vehicle data from the portable device.

13 . The computing system of claim 8 , wherein the rendering module augments one or more components of the model based on the determined difference.

14 . A non-transitory computer-readable medium comprising instructions that when executed by a processor perform a method for rendering views to an output device in a vehicle, comprising:
receiving vehicle data from a portable device, wherein the vehicle data includes vehicle dynamics data and predictive vehicle data within a frame of reference of an exterior environment of the vehicle; generating a view based on the vehicle data and a model, the model including one or more components that define the view; determining a difference between the vehicle dynamics data and the predictive vehicle data indicative of a perspective based on motion of the vehicle within the frame of reference of the exterior environment of the vehicle; rendering the view to the output device by controlling the output device to update display of the view according to the model and the determined difference.

15 . The non-transitory computer-readable medium of claim 14 , wherein the vehicle dynamics data includes a current velocity, a current orientation, and a current location of the vehicle, and wherein the predictive vehicle data includes a future velocity, a future orientation, and a future location of the vehicle at a future time.

16 . The non-transitory computer-readable medium of claim 15 , wherein determining the difference between the vehicle dynamics data and the predictive vehicle data includes determining a relative velocity of the vehicle at a current time relative to the future time, and wherein rendering the view to the output device includes modifying the view according to the model and the relative velocity.

17 . The non-transitory computer-readable medium of claim 14 , wherein the predictive vehicle data is calculated based on the vehicle data from the portable device.

18 . The non-transitory computer-readable medium of claim 14 , wherein rendering the view includes augmenting the one or more components of the model based on the determined difference.

19 . The non-transitory computer-readable medium of claim 14 , wherein the predictive vehicle data is calculated based on user data received from the portable device, and wherein the user data includes a velocity, an orientation and a location of a user within a frame of reference of the vehicle, wherein the user is located in the vehicle.

20 . The non-transitory computer-readable medium of claim 14 , wherein the predictive vehicle data triggers an event to define the view.

Assignees

• Honda Motor Co Ltd

Inventors

• Alaniz Arthur
• Whinnery Joseph
• Murrish Robert Wesley
• Gleeson-May Michael Eamonn

Classifications

• H04N13/117 Primary

  the virtual viewpoint locations being selected by the viewers or determined by viewer tracking · CPC title

• H04N13/366

  using viewer tracking · CPC title

• H04N13/344

  with head-mounted left-right displays · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• H04N13/398

  Synchronisation thereof; Control thereof · CPC title