Cooperative immersive live action 360-degree video and virtual reality

Patent metadata

Field	Value
Publication number	US-10272329-B2
Application number	US-201615233904-A
Country	US
Kind code	B2
Filing date	Aug 10, 2016
Priority date	Aug 10, 2016
Publication date	Apr 30, 2019
Grant date	Apr 30, 2019

Abstract

A design for a cooperative live action virtual reality experience is described. A client makes use of a 360-degree display unit to play a 360-degree video file, a corresponding audio file, and an annotation requesting the user to make a selection that will dictate the progression of the virtual reality experience. The user input is processed in view of a script tree to determine the subsequent 360-degree video, audio, and annotation to send to the client. In some embodiments, progression of the virtual reality experience is dictated by annotation selections made by a second user or by both users who are cooperatively participating in the virtual reality experience.

First claim

What is claimed is:

1. A method of creating a shared interactive gaming experience comprising:
sending, from a first client device to a server over a network, a request to begin the shared interactive gaming experience, the first client device associated with a first 360-degree display unit;
receiving, at the first client device, a response to the request, the response allowing the first client device to initiate the shared interactive gaming experience;
connecting with a second client device over the network to cooperate in the shared interactive gaming experience, the second client device associated with a second 360-degree display unit;
obtaining a first 360-degree video file and a first annotation associated with the first 360-degree video file from a video database of the server based on a script tree in the video database, wherein:
the script tree represents a plurality of flows of the shared interactive gaming experience, each flow comprising a plurality of nodes organized based on possible user inputs, each node corresponding to one or more 360-degree video files and associated annotations;

presenting the first 360-degree video file and the first annotation visually using the first 360-degree display unit of the first client device, the first annotation including one or more options for selection by a user of the first client device;
receiving, at the first client device, a user input selecting one of the one or more options associated with the first annotation, wherein the user input results from motion of the first 360-degree display unit when the user of the first 360-degree display unit moves to select the one of the one or more options associated with the first annotation;
obtaining a second 360-degree video file and an associated second annotation that correspond to a subsequent node in the script tree for the first client device,

wherein the subsequent node is determined based on the received user input of the first client device and a user input of the second client device for the first annotation; and
presenting the second 360-degree video file and the second annotation visually using the first 360-degree display unit of the first client device while the second 360-degree display unit of the second client device is simultaneously presenting a third 360-degree video file and an associated third annotation that also correspond to the subsequent node in the script tree, wherein the second 360-degree video file and the third 360-degree video file provide the shared interactive experience from different perspectives.

2. The method of claim 1 , wherein each of a plurality of nodes of the logic tree contains at least one node that precedes it and at least one node that follows it.

3. The method of claim 1 , further comprising presenting a fourth 360-degree video file and a fourth annotation visually using the first 360-degree display unit of the first client device responsive to user input by the first client device in response to the second 360-degree video file and the second annotation.

4. The method of claim 3 , wherein a node of the script tree contains two or more outbound nodes, each outbound node associated with a choice to be made by one or more users.

5. The method of claim 1 , wherein a plurality of nodes of the logic tree contain multiple 360-degree video files and wherein a different 360-degree video file is presented to each client at each of the plurality of nodes of the script tree.

6. The method of claim 1 , further comprising:
presenting a fourth 360-degree video file and a fourth annotation visually using the first 360-degree display unit of the first client device responsive to user input by the first client device in response to the second 360-degree video file and second annotation;
receiving a user input in response to the fourth annotation; and
presenting the first 360-degree video file and the first annotation visually using the first 360-degree display unit of the first client device responsive to the received user input in response to the fourth annotation.

7. The method of claim 1 , wherein the second 360-degree video file and the second annotation are accessed for the first client device based on the user of the first client device having elected to be the first player and wherein the third 360-degree video file and the third annotation are accessed for the second client device based on the user of the second client device having elected to be the second player.

8. The method of claim 1 , wherein the second and third annotations are the same.

9. The method of claim 1 , wherein the second and third annotations are different.

10. A computer system, comprising:
memory; and
one or more processors, coupled to the memory, to:
send, from a first client device to a server over a network, a request to begin a shared interactive gaming experience, the first client device associated with a 360-degree display unit;
receive, at the first client device, a response to the request, the response allowing the first client device to initiate the shared interactive gaming experience;
connect with a second client device over the network to cooperate in the shared interactive gaming experience, the second client device associated with a second 360-degree display unit;
obtain a first 360-degree video file and a first annotation associated with the first 360-degree video file from a video database of the server based on a script tree in the video database, wherein:
the script tree represents a plurality of flows of the shared interactive gaming experience, each flow comprising a plurality of nodes organized based on possible user inputs, each node corresponding to one or more 360-degree video files and associated annotations;

present the first 360-degree video file and the first annotation visually using the first 360-degree display unit of the first client device, the first annotation including one or more options for selection by a user of the first client device;
receive, at the first client device, a user input selecting one of the one or more options associated with the first annotation, wherein the user input results from motion of the first 360-degree display unit when the user of the first 360-degree display unit moves to select the one of the one or more options associated with the first annotation;
obtain a second 360-degree video file and an associated second annotation that correspond to a subsequent node in the script tree for the first client device, wherein the subsequent node is determined based on the received user input of the first client device and a user input of the second client device for the first annotation; and
present a second 360-degree video file and the second annotation visually using the first 360-degree display unit of the first client device while the second 360-degree display unit of the second client device is simultaneously presenting a third 360-degree video file and an associated third annotation that also correspond to the subsequent node in the script tree, wherein the second 360-degree video file and the third 360-degree video file provide the shared interactive gaming experience from different perspectives.

11. The system of claim 10 , wherein each of a plurality of nodes of the script tree contains at least one node that precedes it and at least one node that follows it.

12. The system of claim 10 , wherein a plurality of nodes of the script tree contain multiple 360-degree video files and wherein a different 360-degree video file is presented to each client at each of the plurality of nodes of the logic tree.

13. The system of claim 10 , wherein the one or more processo

Assignees

• Google Inc
• Google Llc

Inventors

• Linder David
• Lange Scott D
• Rothera Alexander

Classifications

• A63F2300/8082

  Virtual reality · CPC title

• G02B27/01

  Head-up displays · CPC title

• G06F16/7335

  Graphical querying, e.g. query-by-region, query-by-sketch, query-by-trajectory, GUIs for designating a person/face/object as a query predicate (end-user interface involving hot spots associated with the video H04N21/4725; end-user interface for selecting a Region of Interest H04N21/4728) · CPC title

• A63F13/24

  Constructional details thereof, e.g. game controllers with detachable joystick handles · CPC title

• G06F16/7867

  using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings · CPC title