System and method for dynamic in-vehicle virtual reality

Patent metadata

Field	Value
Publication number	US-10817048-B2
Application number	US-201916265602-A
Country	US
Kind code	B2
Filing date	Feb 1, 2019
Priority date	Oct 3, 2013
Publication date	Oct 27, 2020
Grant date	Oct 27, 2020

Abstract

A method for rendering views to an output device in a vehicle, including receiving vehicle data from a first frame of reference. The first frame of reference is defined by the vehicle relative to an exterior environment of the vehicle. The method includes determining vehicle occupant action data based on the vehicle data associated with a vehicle occupant of the vehicle in a second frame of reference different than the first frame of reference. The method including generating a view based on the vehicle data and a model, the model including one or more components that define the view, wherein generating the view includes modifying one or more components of the model according to the vehicle occupant action data. The method including rendering the view to the output device by controlling the output device to update display of the view according to the modified one more components of the model.

First claim

The invention claimed is:

1. A computer-implemented method for rendering views to a virtual reality device in a vehicle, comprising:
receiving vehicle data of the vehicle;
determining user data, the user data including vehicle occupant action data based on the vehicle data associated with a vehicle occupant;
generating a view for an immersive virtual reality or augmented reality of the virtual reality device based on the vehicle data and a model, the model including one or more components that define the view, wherein generating the view includes modifying one or more components of the model defined by an event according to the vehicle occupant action data, and wherein the modification is based on the vehicle data; and
rendering the view to an output device by controlling the output device to update display of the view according to the modified one or more components of the model.

2. The computer-implemented method of claim 1 , wherein vehicle data is associated with a change to a vehicle system, and the vehicle occupant action data is based on the change to the vehicle system associated with the vehicle occupant.

3. The computer-implemented method of claim 1 , wherein the vehicle occupant action data triggers the event defined by the model.

4. The computer-implemented method of claim 1 , wherein the modification causes a related adjustment to one or more vehicle systems.

5. The computer-implemented method of claim 1 , wherein the vehicle occupant action data is based on an interaction between the vehicle occupant and a first vehicle system, and wherein the vehicle occupant action data further triggers an adjustment of a second vehicle system.

6. The computer-implemented method of claim 5 , wherein the adjustment of the second vehicle system is based on the vehicle data.

7. An immersive virtual reality or augmented reality system for rendering views to a virtual reality device in a vehicle, comprising:
a processor operatively connected for computer communication to one or more vehicle systems of the vehicle and an output device, the processor including:
a virtual reality data module receiving vehicle data, and identifying vehicle occupant action data based on the vehicle data associated with a vehicle occupant of the vehicle;
a dynamic virtual reality module generates a view for the immersive virtual reality or augmented reality system of the virtual reality device based on the vehicle data and a model, the model including one or more components that define the view and the dynamic virtual reality module modifies at least one of the one or more components of the model according to the vehicle occupant action data, wherein an event defines a modification to at least one component of the model, and wherein the modification is based on the vehicle data; and
a rendering module renders the view to the output device by controlling the output device to update display of the view according to the modified one or more components of the model.

8. The computing system of claim 7 , wherein the vehicle occupant action data is based on an interaction between the vehicle occupant and one or more vehicle systems of the vehicle.

9. The computing system of claim 7 , wherein the vehicle occupant action data triggers the event defined by the model.

10. The computing system of claim 7 , wherein the modification causes a related adjustment to one or more vehicle systems.

11. The computing system of claim 7 , wherein the vehicle occupant action data is based on an interaction between the vehicle occupant and a first vehicle system, and wherein the vehicle occupant action data triggers an adjustment of a second vehicle system.

12. A non-transitory computer-readable medium comprising instructions that when executed by a processor perform a method for rendering views to a virtual reality device in a vehicle, comprising:
receiving vehicle data;
determining vehicle occupant action data associated with a vehicle occupant of the vehicle;
generating a view for an immersive virtual reality or augmented reality of the virtual reality device based on the vehicle data and a model, the model including one or more components that define the view, wherein generating the view includes modifying one or more components of the model defined by an event according to the vehicle occupant action data, and wherein the modification is based on the vehicle data; and
rendering the view to an output device by controlling the output device to update display of the view according to the modified one or more components of the model.

13. The non-transitory computer-readable medium of claim 12 , wherein the vehicle occupant action data is based on an interaction between the vehicle occupant and one or more vehicle systems of the vehicle.

14. The non-transitory computer-readable medium of claim 12 , wherein the vehicle occupant action data triggers the event defined by the model.

15. The non-transitory computer-readable medium of claim 12 , wherein the modification causes a related adjustment to one or more vehicle systems.

16. The non-transitory computer-readable medium of claim 12 , wherein the vehicle occupant action data is based on an interaction between the vehicle occupant and a first vehicle system, and wherein the vehicle occupant action data triggers an adjustment of a second vehicle system.

17. The non-transitory computer-readable medium of claim 16 , wherein the adjustment of the second vehicle system is based on the vehicle data.

Assignees

• Honda Motor Co Ltd

Inventors

• Alaniz Arthur
• Whinnery Joseph
• Murrish Robert Wesley
• Gleeson-May Michael Eamonn

Classifications

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G02B27/017

  Head mounted · CPC title

• B60R2300/20

  characterised by the type of display used · CPC title

• G02B2027/0187

  slaved to motion of at least a part of the body of the user, e.g. head, eye · CPC title

• B60R2300/8006

  for monitoring and displaying scenes of vehicle interior, e.g. for monitoring passengers or cargo · CPC title