Systems and methods for using reduced hops to generate an augmented virtual reality scene within a head mounted system

Patent metadata

Field	Value
Publication number	US-10137361-B2
Application number	US-201314144210-A
Country	US
Kind code	B2
Filing date	Dec 30, 2013
Priority date	Jun 7, 2013
Publication date	Nov 27, 2018
Grant date	Nov 27, 2018

Abstract

Systems and methods for using reduced hops to generate an augmented virtual reality scene in a head mounted display. The head mounted display is used for game play via a game cloud system. The head mounted display includes a communications circuit for sending real-world media associated with a game program via a network. The real-world media is processed by the game cloud system and streamed directly from the communications circuit to the game cloud system. The head mounted display further includes a game processing circuit coupled to the communications circuit. The game processing circuit is used for decoding computer-generated interactive media received from the game cloud system via the network. The game processing circuit drives a portion of interactivity associated with the game program by superimposing the computer-generated interactive media on the real-world media. The computer-generated interactive media is generated based on the real-world media.

First claim

What is claimed is:

1. A head mounted display for game play via a game cloud system, the head mounted display comprising:
a communications circuit of the head-mounted display for sending real-world media to a game program via the Internet, the game program being executed by the game cloud system and the real-world media is captured via a camera of the head mounted display, the communications circuit of the head-mounted display is configured to communicate with the game cloud system via a router that connects to the Internet without using a computer to communicate with the router and the Internet;
a decoder in the head-mounted display coupled to the communications circuit, wherein the decoder is configured to decode compressed computer-generated interactive media received from a compressor of the game cloud system via the Internet and the router to provide decoded computer-generated interactive media; and
a game processing circuit driving a portion of interactivity associated with the game program by superimposing a portion of the decoded computer-generated interactive media on the real-world media, the compressed computer-generated interactive media generated based on the real-world media.

2. The head mounted display of claim 1 ,
wherein the game processing circuit is used for rendering images of the real-world media and the portion of decoded computer-generated interactive media, wherein the communications circuit is a wireless access card configured to receive the computer-generated interactive media from the game cloud system without using the computer.

3. The head mounted display of claim 1 , further comprising:
a user input circuit coupled to the game processing circuit, the user input circuit for generating an input based on a head action of a user; and
an audio circuit for generating sounds based on a portion of the decoded computer-generated interactive media or based on the input, wherein the communications circuit comprises a wireless access card configured to generate packets having the input for sending via the Internet to the game cloud system for processing of the input by the game cloud system.

4. The head mounted display of claim 1 , further comprising:
a user input circuit coupled to the game processing circuit, the user input circuit for generating an input based on a head action of a user, wherein the user input circuit includes one or more inertial sensors for determining a position and motion of the head mounted display, wherein the communications circuit is configured to generate packets having the input for sending via the Internet to the game cloud system for processing of the input by the game cloud system.

5. The head mounted display of claim 4 , wherein the inertial sensors include a gyroscope, a magnetometer, and an accelerometer.

6. The head mounted display of claim 1 , further comprising a communications circuit to facilitate peer-to-peer multichannel communication with another head mounted display via pairing.

7. The head mounted display of claim 1 , further comprising a user input circuit coupled to the game processing circuit, the user input circuit for generating an input based on a head action of a user, wherein the communications circuit, the user input circuit, and the game processing circuit are integrated in one or more individual circuit chips.

8. The head mounted display of claim 1 , wherein the game processing circuit includes a microprocessor for rendering the portion of decoded computer-generated interactive media, the head mounted display further comprising a buffer for buffering a stream of the compressed computer-generated interactive media.

9. The head mounted display of claim 1 , further comprising:
an additional communications circuit for communicating with a hand-held controller, wherein the additional communications circuit is configured to receive an input from the hand-held controller, wherein the communications circuit is configured to packetize the input and send the input via the Internet to the game cloud system.

10. The head mounted display of claim 1 , further comprising a user input circuit for receiving an action from a user to generate an input, wherein the input is a voice of a user or a gaze of the user, wherein the communications circuit is configured to generate packets from the input and send the packets via the Internet to the game cloud system.

11. The head mounted display of claim 10 , wherein the input is mapped to an input of a hand-held controller to determine a change in state of the game program.

12. The head mounted display of claim 1 , wherein the head mounted display is used with a hand-held controller that communicates directly with the game cloud system, wherein the hand-held controller is configured to packetize a selection of a button to generate one or more packets and send the one or more packets via the Internet to the game cloud system.

13. The head mounted display of claim 1 , further comprising:
an additional communications circuit configured to receive a position and motion of a hand-held controller from the hand-held controller; and
a display screen configured to display a single augmented virtual reality scene generated from a position and motion of the head mounted display and the position and motion of the hand-held controller.

14. The head mounted display of claim 1 , wherein the head mounted display is used with a hand-held controller that communicates with the computer.

15. The head mounted display of claim 1 , further comprising a user input circuit for receiving an action from a user to generate an input, the input including a position and motion detected by the user input circuit, wherein the communications circuit includes a wireless access card configured to communicate the input directly to the game cloud system.

16. The head mounted display of claim 1 , further comprising:
a display device configured to display one or more wireless networks for communication with the game cloud system;
a user input circuit configured to receive an indication of a selection of one of the wireless networks,
wherein the communications circuit is configured to couple to the game cloud system via the one of the wireless networks upon the reception of the indication of the selection of the one of the wireless networks by the user input circuit.

17. The head mounted display of claim 1 , further comprising:
a microcontroller configured to execute an operating system to further execute a network access application, wherein the network access application is executed to access one or more wireless networks;
a user input device configured to recognize a gesture to facilitate a determination that a selection of one of the wireless networks is made,
wherein the communications circuit is configured to couple to the game cloud system via the one of the wireless networks in response to the determination of the selection of the one of the wireless networks.

18. The head mounted display of claim 1 , wherein the communications circuit is configured to receive one or more packets of the computer-generated interactive media via the Internet and is configured to depacketize the one or more packets to extract the computer-generated interactive media from the packets.

19. The head mounted display of claim 1 , further comprising a video decoder, wherein the video decoder is a device separate from the decoder and is coupled to the decoder.

20. The head mounted display of claim 1 , further comprising:
a video audio separator configured to separa

Assignees

• Sony Computer Entertainment America Llc
• Sony Interactive Entertainment America Llc

Inventors

• Perry David

Classifications

• A63F2300/303

  for displaying additional data, e.g. simulating a Head Up Display · CPC title

• G06F3/012

  Head tracking input arrangements · CPC title

• G02B27/017

  Head mounted · CPC title

• A63F13/40

  Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment · CPC title

• G02B2027/014

  comprising information/image processing systems · CPC title