System and method for dynamic in-vehicle virtual reality

Patent metadata

Field	Value
Publication number	US-10764554-B2
Application number	US-201916262826-A
Country	US
Kind code	B2
Filing date	Jan 30, 2019
Priority date	Oct 3, 2013
Publication date	Sep 1, 2020
Grant date	Sep 1, 2020

Abstract

A method for rendering views to an output device, including receiving vehicle data from a portable device. The vehicle data is from a frame of reference of an exterior environment of a vehicle. The method also includes receiving user data from a portable device. The user data includes a health data about a user from a frame of reference of an exterior environment of the vehicle. The method also includes generating a view based on the vehicle data, the user data and a model. The model includes one or more components that define the view. The method further includes determining a difference between the user data and the vehicle data. The method additionally includes rendering the view at a rendering speed to the output device by controlling the output device to update display of the view according to the determined difference. The rendering speed is based on the health data.

First claim

The invention claimed is:

1. A computer-implemented method for rendering views for an immersive virtual reality or augmented reality to an output device, comprising:
receiving vehicle data from a portable device, wherein the vehicle data is from a frame of reference of an exterior environment of a vehicle;
receiving user data from the portable device, wherein the user data includes a health data about a user from the frame of reference of the exterior environment of the vehicle;
generating a view for the immersive virtual reality or augmented reality based on the vehicle data, the user data, and a model, the model including one or more components that define the view;
determining a difference, from the frame of reference of the exterior environment of the vehicle, between the user data and the vehicle data; and
rendering the view at a rendering speed to the output device by controlling the output device to update display of the view for the immersive virtual reality or augmented reality according to the determined difference, wherein the rendering speed is reduced in response to the health data.

2. The computer-implemented method of claim 1 , wherein rendering the view to the output device includes modifying the view based on the health data to minimize sensory processing.

3. The computer-implemented method of claim 1 , wherein rendering the view includes augmenting the one or more components of the model based on the determined difference.

4. The computer-implemented method of claim 1 , wherein the portable device is operatively connected for computer communication to one or more portable medical devices worn by the user or in-vehicle biological health monitoring devices.

5. The computer-implemented method of claim 1 , further comprising:
receiving updated health data about the user; and
adjusting the rendering speed based on the updated health data.

6. The computer-implemented method of claim 1 , wherein the health data indicates motion or sensory issues including one or more of disorientation, vertigo, and motion sickness.

7. A computing system for rendering views for an immersive virtual reality or augmented reality to an output device, comprising:
a processor operatively connected for computer communication to one or more vehicle systems of a vehicle and the output device, the processor including:
a virtual reality data module receives vehicle data and user data from a portable device, wherein the vehicle data is from a frame of reference of an exterior environment of a vehicle, and wherein the user data includes a health data about a user from the frame of reference of the exterior environment of the vehicle;
a dynamic virtual reality module generates a view for the immersive virtual reality or augmented reality based on the vehicle data, the user data, and a model, the model including one or more components that define the view;
a rendering module determines a difference between the user data and the vehicle data indicative of a perspective based on motion of the vehicle within the frame of reference of the exterior environment of the vehicle from the vehicle data and motion of the user within the frame of reference of the vehicle from the user data and the rendering module renders the view to the output device by controlling the output device to update display of the view for the immersive virtual reality or augmented reality according to the determined difference, wherein rendering speed of the rendering is reduced in response to the health data.

8. The computer system of claim 7 , wherein the dynamic virtual reality module modifies the view based on the health data to minimize sensory processing.

9. The computer system of claim 7 , wherein the dynamic virtual reality module augments the one or more components of the model based on the determined difference.

10. The computer system of claim 7 , wherein the portable device is operatively connected for computer communication to one or more portable medical devices worn by the user or in-vehicle biological health monitoring devices.

11. The computer system of claim 7 , further comprising:
receiving updated health data about the user; and
adjusting the rendering speed based on the updated health data.

12. A non-transitory computer-readable medium comprising instructions that when executed by a processor perform a method for rendering views for an immersive virtual reality or augmented reality to an output device in a vehicle, comprising:
receiving vehicle data from a portable device, wherein the vehicle data is from a frame of reference of an exterior environment of a vehicle;
receiving user data from the portable device, wherein the user data includes a health data about a user from the frame of reference of the exterior environment of the vehicle;
generating a view for the immersive virtual reality or augmented reality based on the vehicle data, the user data, and a model, the model including one or more components that define the view;
determining a difference between the user data and the vehicle data; and
rendering the view at a rendering speed to the output device by controlling the output device to update display of the view for the immersive virtual reality or augmented reality according to the determined difference, wherein the rendering speed is reduced in response to the health data.

13. The non-transitory computer-readable medium of claim 12 , wherein rendering the view to the output device includes modifying the view based on the health data to minimize sensory processing.

14. The non-transitory computer-readable medium of claim 12 , wherein rendering the view includes augmenting the one or more components of the model based on the determined difference.

15. The non-transitory computer-readable medium of claim 12 , wherein the portable device is operatively connected for computer communication to one or more portable medical devices worn by the user or in-vehicle biological health monitoring devices.

16. The non-transitory computer-readable medium of claim 12 , further comprising:
receiving updated health data about the user; and
adjusting the rendering speed based on the updated health data.

17. The non-transitory computer-readable medium of claim 12 , wherein the health data indicates motion or sensory issues including one or more of disorientation, vertigo, and motion sickness.

Assignees

• Honda Motor Co Ltd

Inventors

• Alaniz Arthur
• Whinnery Joseph
• Murrish Robert Wesley
• Gleeson-May Michael Eamonn

Classifications

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• H04N13/344

  with head-mounted left-right displays · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06T19/00

  Manipulating three-dimensional [3D] models or images for computer graphics · CPC title

• H04N13/366

  using viewer tracking · CPC title