Method for tracking physical play objects by virtual players in online environments

Patent metadata

Field	Value
Publication number	US-9555337-B2
Application number	US-201314028119-A
Country	US
Kind code	B2
Filing date	Sep 16, 2013
Priority date	Sep 16, 2013
Publication date	Jan 31, 2017
Grant date	Jan 31, 2017

Abstract

Techniques are disclosed for tracking physical play objects by virtual or non-player characters in an electronic game environment. More specifically, techniques are disclosed for enabling a game system to track a physical toy object, using tracking information to update the game state, and transmitting updated game state to the toy object and update the toy state. Additionally, a player is able to control the physical toy object, and use the physical toy object to play a game. The game system may track a remote-controlled toy, a handheld toy, or the player himself or herself. The virtual feedback to changes in the physical environment results in a more immersive game experience for the player.

First claim

What is claimed is:

1. A method for providing an immersive physical and virtual interactive game play environment, the method comprising:
receiving, by a first game console, tracking data from a physical toy object in the physical game play environment, wherein the physical toy object is controlled by a player interacting with a first controller;
updating a game state of the virtual game play environment based on the received tracking data;
transmitting game state data to the physical toy object;
updating a current physical state of the physical toy object based on the game state data; and
rendering images displayed on a first display based on the updated game state.

2. The method of claim 1 , wherein the tracking data includes position and movement data for the physical toy object.

3. The method of claim 1 , wherein updating the game state based on the received tracking data comprises updating a behavior of a non-player character in the electronic game to respond to actions of the physical toy object, as controlled by the player.

4. The method of claim 1 , further comprising, transmitting, over a network, the received tracking data to a second game console, wherein the second game console renders a representation of the physical toy object.

5. The method of claim 4 , wherein the second game console receives tracking data from a second physical toy object.

6. The method of claim 4 , wherein the rendered images include a representation of the second toy object.

7. The method of claim 5 , wherein the second game console transmits the tracking data received from the second physical toy object to the first game console, and wherein the first and second game consoles each update a respective game state based on the tracking data received from the second physical toy object.

8. A non-transitory computer-readable storage medium storing instructions, which when executed on a processor, perform an operation for providing an immersive physical and virtual interactive game environment, the operation comprising:
receiving, by a first game console, tracking data from a physical toy object in the physical game play environment, wherein the physical toy object is controlled by a player interacting with a first controller;
updating a game state of the virtual game play environment based on the received tracking data;
transmitting game state data to the physical toy object;
updating a current physical state of the physical toy object based on the game state data; and
rendering images displayed on a first display based on the updated game state.

9. The computer-readable storage medium of claim 8 , wherein the tracking data includes position and movement data for the physical toy object.

10. The computer-readable storage medium of claim 8 , wherein updating the game state based on the received tracking data comprises updating a behavior of a non-player character in the electronic game to respond to actions of the physical toy object, as controlled by the player.

11. The computer-readable storage medium of claim 8 , wherein the operation further comprises, transmitting, over a network, the received tracking data to a second game console, wherein the second game console renders a representation of the physical toy object on a second display.

12. The computer-readable storage medium of claim 11 , wherein the second game console receives tracking data from a second physical toy object.

13. The computer-readable storage medium of claim 11 , wherein the rendered images on the first display include a representation of the second toy object.

14. The computer-readable storage medium of claim 13 , wherein the second game console transmits the tracking data received from the second physical toy object to the first game console, and wherein the first and second game consoles each update a respective game state based on the tracking data received from the second physical toy object.

15. A first game console system, comprising:
a processor;
a first controller in communication with the game console system;
a physical toy object, wherein the toy object is controlled via the first controller;
a memory storing an application program configured to perform an operation for providing an immersive physical and virtual interactive game environment, the operation comprising:
receiving, by the first game console, tracking data from the physical toy object, as controlled by a first player interacting with the first controller,
updating a game state of the virtual game play environment based on the received tracking data,
transmitting game state data to the physical toy object,
updating a current physical state of the toy object based on the game state data, and
rendering images displayed on a first display based on the updated game state.

16. The system of claim 15 , wherein the tracking data includes position and movement data for the physical toy object.

17. The system of claim 15 , wherein updating the game state based on the received tracking data comprises updating a behavior of a non-player character in the electronic game to respond to actions of the physical toy object, as controlled by the player.

18. The system of claim 15 , wherein the operation further comprises, transmitting, over a network, the received tracking data to a second game console, wherein the second game console renders a representation of the physical toy object on a second display.

19. The system of claim 18 , wherein the second game console receives tracking data from a second physical toy object.

20. The system of claim 19 , wherein the rendered images on the first display include a representation of the second physical toy object.

21. The system of claim 20 , wherein the second game console transmits the tracking data received from the second physical toy object to the first game console, and wherein the first and second game consoles each update a respective game state based on the tracking data received from the second physical toy object.

22. A method for providing an immersive game environment, comprising:
capturing, by a first camera controlled by a first game console, a video stream of at least a first player at a first location engaging in game play;
rendering, at a second location, the video stream captured by the first camera on a display connected to a second game console;
capturing, by a second camera controlled by the second game console, a video stream of at least a second player at the second location engaging in game play; and
rendering the video stream captured by the second camera on a display connected to a first game console.

23. The method of claim 22 , wherein one or more computer graphics (CG) effects are applied to the video stream captured by the first camera prior to being rendered on the display connected to the second game console.

24. The method of claim 22 , wherein one or more computer graphics (CG) effects are applied to the video stream captured by the second camera prior to being rendered on the display connected to the first game console.

Assignees

• Disney Entpr Inc

Inventors

• Garlington Joseph O
• Haseltine Eric

Classifications

• A63H27/00

  Toy aircraft; Other flying toys (toys with parachutes A63H33/20) · CPC title

• A63F13/327

  using wireless networks, e.g. Wi-Fi® or piconet · CPC title

• A63F13/65

  automatically by game devices or servers from real world data, e.g. measurement in live racing competition · CPC title

• A63F13/235

  using a wireless connection, e.g. infrared or piconet · CPC title

• A63F2300/8023

  the game being played by multiple players at a common site, e.g. in an arena, theatre, shopping mall using a large public display · CPC title