Spectator view tracking of virtual reality (VR) user in VR environments

Patent metadata

Field	Value
Publication number	US-11181990-B2
Application number	US-201715461442-A
Country	US
Kind code	B2
Filing date	Mar 16, 2017
Priority date	Mar 18, 2016
Publication date	Nov 23, 2021
Grant date	Nov 23, 2021

Abstract

A method, system, computer readable media and cloud systems are provided for generating views of a virtual reality environment for a spectator. One example method includes enabling a spectator to view into a virtual reality environment, and control what specific content within the environment the spectator wishes to see. Motions of an HMD worn by an HMD player can be tracked so as to provide a geared spectator view into the virtual reality environment. The gearing of the spectator view enables a spectator to view the virtual reality content in a more normal way which is not tied to the strict movements of the HMD worn by the HMD player. The gearing effects can be programmable or can be set based on the content being navigated by the HMD player or preferences of the individual spectators.

First claim

What is claimed is:

1. A method for processing virtual reality content for viewing by spectators, comprising,
receiving, at a server, a virtual reality stream associated with interaction by a head mounted display (HMD) player, the HMD player is configured to navigate a virtual reality environment, and the navigation of the virtual reality environment produces the virtual reality stream having an HMD player view;
receiving, at the server, a request via a device of a spectator to view the virtual reality stream via an HMD of the spectator;
sending, by the server, a feed of the virtual reality stream to the HMD of the spectator, the feed of the virtual reality stream being provided in real-time while the HMD player is navigating the virtual reality environment, the feed providing an HMD spectator view into the virtual reality environment shown in the HMD player view; and
adjusting, by the server, the HMD spectator view into the virtual reality environment in accordance with a gearing ratio, the gearing ratio defining a rate at which the HMD spectator view virtually moves to follow the HMD player view in real-time as the HMD player navigates the virtual reality environment, the HMD spectator view is virtually tied to and pulled by the HMD player view,
wherein the gearing ratio provides a dynamically adjustable delay to the HMD spectator view in relation to the HMD player view, based on a physics metric associated to a virtual rubber band connection between a virtual location of the HMD player view relative to a virtual location of the HMD spectator view.

2. The method of claim 1 , wherein the gearing ratio is dynamically adjusted by the server based on content encountered in the virtual reality environment.

3. The method of claim 1 , wherein the gearing ratio is dynamically adjusted by the server based on a preference of the spectator.

4. The method of claim 1 , wherein the dynamically adjustable delay provided by the gearing ratio causes movement of the HMD spectator view to change slower than movement of the HMD player view, the HMD player view moving at a rate controlled by the HMD player as the HMD player moves the HMD of the HMD player in a real-world space while navigating or moving in the virtual reality environment.

5. The method of claim 1 , wherein the dynamically adjustable delay provided by the gearing ratio causes movement of the HMD spectator view to automatically change in speed relative to movement of the HMD player view, the HMD player view moving at a rate controlled by the HMD player as the HMD player moves the HMD of the HMD player in a real-world space while navigating or moving in the virtual reality environment.

6. The method of claim 1 , wherein the dynamically adjustable delay provided by the gearing ratio is approximated by the physics metric that includes an elasticity of the virtual rubber band, such that an acceleration of speed of movement of the HMD player view causes an initial jerk pull on the virtual rubber band that then reacts to force the HMD spectator view to follow the HMD player view.

7. The method of claim 1 , wherein the dynamically adjustable delay provided by the gearing ratio is approximated by the physics metric that includes an elasticity of the virtual rubber band, such that an acceleration of speed of movement of the HMD player view causes the virtual rubber band to expand and pull to force the HMD spectator view to follow the HMD player view.

8. The method of claim 1 , wherein the gearing ratio skips or reduces following the HMD player view when the HMD player view moves faster than the dynamically adjustable delay imparted by the gearing ratio.

9. A method for processing virtual reality content for viewing by spectators, comprising,
processing, at a computer, a virtual reality stream associated with interaction by a head mounted display (HMD) worn by an HMD player, the HMD player is configured to navigate a virtual reality environment, and the navigation of the virtual reality environment produces the virtual reality stream having an HMD player view;
receiving, at the computer, a request associated with an HMD of a spectator to view the virtual reality stream via the HMD of the spectator;
sending, by the computer, a feed of the virtual reality stream to the HMD of the spectator, the feed of the virtual reality stream being provided in real-time while the HMD player is navigating the virtual reality environment, the feed providing an HMD spectator view into the virtual reality environment being navigated by the HMD player; and
adjusting, by the computer, the HMD spectator view into the virtual reality environment in accordance with a gearing ratio, the gearing ratio defining a rate at which the HMD spectator view virtually moves to follow the HMD player view in real-time as the HMD player navigates the virtual reality environment, the HMD spectator view is virtually tied to and pulled by the HMD player view,
wherein the gearing ratio provides a dynamically adjustable delay to the HMD spectator view in relation to the HMD player view based on a physics metric associated to a virtual rubber band connection between a virtual location of the HMD player view relative to a virtual location of the HMD spectator view.

10. The method of claim 9 , wherein the gearing ratio is dynamically adjusted by the computer based on content encountered in the virtual reality environment.

11. The method of claim 9 , wherein the gearing ratio is dynamically adjusted by the computer based on a preference of the spectator.

12. The method of claim 9 , wherein the dynamically adjustable delay provided by the gearing ratio causes movement of the HMD spectator view to change or react slower than movement of the HMD player view, the HMD player view moving at a rate controlled by the HMD player as the HMD player moves the HMD of the HMD player in a real-world space while navigating or moving in the virtual reality environment.

13. The method of claim 9 , wherein the dynamically adjustable delay provided by the gearing ratio causes movement of the HMD spectator view to automatically change in speed relative to movement of the HMD player view, the HMD player view moving at a rate controlled by the HMD player as the HMD player moves the HMD of the HMD player in a real-world space while navigating or moving in the virtual reality environment.

14. The method of claim 9 , wherein the dynamically adjustable delay provided by the gearing ratio is approximated by the physics metric that includes an elasticity of the virtual rubber band, such that an acceleration of speed of movement of the HMD player view causes an initial jerk pull on the virtual rubber band that then reacts to force the HMD spectator view to follow the HMD player view.

15. The method of claim 9 , wherein the dynamically adjustable delay provided by the gearing ratio is approximated by the physics metric that includes an elasticity of the virtual rubber band, such that an acceleration of speed of movement of the HMD player view causes the virtual rubber band to expand and pull to force the HMD spectator view to follow the HMD player view.

16. A non-transitory computer-readable medium having program instructions for processing virtual reality content for viewing by spectators, comprising,
program instructions for processing, at a computer, a virtual reality stream associated with interaction by a head mounted display (HMD) worn by an HMD player, the HMD player is configured to navigate a virtual reality environment, and the navigation of the virtual reality environment produces the virtual reality stream having an HMD player view;

Assignees

• Sony Interactive Entertainment Inc

Inventors

• Marks Richard
• Osman Steven

Classifications

• A63F13/86 Primary

  Watching games played by other players · CPC title

• A63F13/5258

  by dynamically adapting the position of the virtual camera to keep a game object or game character in its viewing frustum, e.g. for tracking a character or a ball · CPC title

• A63F13/335

  using Internet · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• A63F2300/303

  for displaying additional data, e.g. simulating a Head Up Display · CPC title