Immersive storytelling environment

Patent metadata

Field	Value
Publication number	US-9914057-B2
Application number	US-201715639072-A
Country	US
Kind code	B2
Filing date	Jun 30, 2017
Priority date	Sep 19, 2012
Publication date	Mar 13, 2018
Grant date	Mar 13, 2018

Abstract

Techniques for providing an immersive storytelling experience using a plurality of storytelling devices. Each of the storytelling devices may be configured to perform one or more actions based on a current context of a story and in response to a stimulus event. The actions include at least one of an auditory and a visual effect. Embodiments also provide a controller device configured to manage a playback of the story, by adjusting the stimulus event and the effect of each of the plurality of storytelling devices, based on the current context of the story, thereby creating an interactive and immersive storytelling experience.

First claim

What is claimed is:

1. A system, comprising:
a plurality of electronic devices, each configured to produce an effect based on a current context of a story in response to detecting an occurrence of a stimulus event, wherein the effect is at least one of an auditory and a visual effect, and wherein at least one of the respective stimulus events for each of the plurality of electronic devices comprises detecting, based on data values collected from one or more sensor devices, performance of a user action by a first user in a physical environment in which the plurality of electronic devices and the first user are located; and
a controller device configured to:
determine that the plurality of electronic devices are present in the physical environment and are available and compatible with the story, through wireless communication with each of the plurality of electronic devices;
manage a playback of the story within the physical environment, by transmitting one or more instructions to each of the plurality of electronic devices to adjust the stimulus event and the effect of each of the plurality of electronic devices, based on the current context of the story;
during the playback of the story, determine that a first one of the plurality of electronic devices has become unavailable; and
adjust the playback of the story within the physical environment, by transmitting one or more instructions to each of a second plurality of electronic devices, non-inclusive of the first electronic device, to update the stimulus event and the effect of each of the second plurality of electronic devices, based on an updated context of the story.

2. The system of claim 1 , wherein the story comprises a plurality of stimulus event and effect pairs, wherein each of the pairs corresponds to a type of electronic device.

3. The system of claim 2 , wherein the story further comprises one or more branches, wherein each of the one or more branches comprises two or more storyline arcs, wherein each of the storyline arcs includes at least one of the stimulus event and effect pairs.

4. The system of claim 3 , wherein the controller device is further configured to associate a plurality of elements of the story with compatible electronic devices based on a type of electronic device.

5. The system of claim 3 , wherein the controller device is configured to select one of the two or more storyline arcs, for use in playback of the story.

6. The system of claim 5 , wherein the selection of the storyline arc is based on at least one of an aggregate state of the story, a historical state based on previously played stories, a user profile for a user, and information about the user.

7. The system of claim 1 , wherein the visual effect comprises at least one of a real projection, a virtual display, and a physical action by a electronic device.

8. The system of claim 1 , wherein the auditory effect is either localized or non-localized, with respect to a electronic device producing the auditory effect.

9. The system of claim 1 , wherein another stimulus event for at least one of the plurality of electronic devices comprises at least one of:
a first electronic device coming within a predefined distance of a second electronic device.

10. The system of claim 1 , wherein one of the effects is further based on a location of a first electronic device.

11. The system of claim 1 , wherein the stimulus event is based on a location of the user that is determined by a camera on a first electronic device.

12. The system of claim 1 , wherein the stimulus event is based on a location of an object in the environment that is determined by a camera on a first electronic device.

13. The system of claim 1 , wherein another stimulus event for at least one of the plurality of electronic devices comprises a verbal statement by a user within the physical environment.

14. The system of claim 1 , wherein another stimulus event for at least one of the plurality of electronic devices comprises movement of the at least one of the plurality of electronic devices, wherein the movement comprises at least one of acceleration, roll, yaw and pitch of the at least one electronic device.

15. The system of claim 1 , wherein the controller device is further configured to maintain state data comprising at least one of:
a current playback position within the story;
a list of events that have occurred in the environment;
state information for at least one of the plurality of electronic devices; and
state information for the user in the context of the current story.

16. The system of claim 1 , wherein another stimulus event for at least one of the plurality of electronic devices comprises an action corresponding to an existing media device.

17. The system of claim 1 , wherein another stimulus event for at least one of the plurality of electronic devices comprises a physical user interaction with the electronic device.

18. A non-transitory computer-readable medium containing computer program code that, when executed, performs an operation comprising:
providing a plurality of electronic devices, each configured to produce an effect based on a current context of a story in response to a stimulus event, wherein the effect is at least one of an auditory and a visual effect, and wherein at least one of the respective stimulus events for each of the plurality of electronic devices comprises detecting, based on data values collected from one or more sensor devices, performance of a user action by a first user in a physical environment in which the plurality of electronic devices and the first user are located;
determining that the plurality of electronic devices are present in the physical environment and are available and compatible with the story, through wireless communication with each of the plurality of electronic devices;
transmitting one or more instructions to each of the plurality of electronic devices to manage a playback of the story within the physical environment, by adjusting the stimulus event and the effect of each of the plurality of electronic devices, based on the current context of the story; and
during the playback of the story:
determining that a first one of the plurality of electronic devices has become unavailable;
determining that a second electronic device, distinct from the electronic devices in the plurality of electronic devices is present within the physical environment and is currently available and compatible with the story; and
adjusting the playback of the story within the physical environment, by transmitting one or more instructions to each of a second plurality of electronic devices, non-inclusive of the first electronic device and inclusive of the second electronic device, to update the stimulus event and the effect of each of the second plurality of electronic devices, based on an updated context of the story.

19. A system, comprising:
a plurality of electronic devices, each configured to produce an effect based on a current context of a story in response to detecting an occurrence of a stimulus event, wherein the effect is at least one of an auditory and a visual effect, and wherein at least one of the respective stimulus events for each of the plurality of electronic devices comprises detecting performance of a user action by a first user in a physical environment in which the plurality of electronic devices and the first user are located; and
a controller device configured to:
determine that the plurality of electronic devices are present in the physical environment and are ava

Assignees

• Disney Entpr Inc

Inventors

• Muhlheim Eric Wilson
• Haseltine Eric Charles
• Garlington Joseph O'Brien
• Leung Theodore Wei-Yun
• Schlumberger Gabriel Sebastian

Classifications

• A63F13/327 Primary

  using wireless networks, e.g. Wi-Fi® or piconet · CPC title

• A63F13/537

  using indicators, e.g. showing the condition of a game character on screen · CPC title

• A63F2300/632

  by branching, e.g. choosing one of several possible story developments at a given point in time · CPC title

• A63F2300/6045

  for mapping control signals received from the input arrangement into game commands · CPC title

• A63F2300/405

  being a wireless ad hoc network, e.g. Bluetooth®, Wi-Fi®, piconet · CPC title