System and method for augmented and virtual reality

Patent metadata

Field	Value
Publication number	US-10587659-B2
Application number	US-201916659415-A
Country	US
Kind code	B2
Filing date	Oct 21, 2019
Priority date	Oct 28, 2011
Publication date	Mar 10, 2020
Grant date	Mar 10, 2020

Abstract

One embodiment is directed to a system for enabling two or more users to interact within a virtual world comprising virtual world data, comprising a computer network comprising one or more computing devices, the one or more computing devices comprising memory, processing circuitry, and software stored at least in part in the memory and executable by the processing circuitry to process at least a portion of the virtual world data; wherein at least a first portion of the virtual world data originates from a first user virtual world local to a first user, and wherein the computer network is operable to transmit the first portion to a user device for presentation to a second user, such that the second user may experience the first portion from the location of the second user, such that aspects of the first user virtual world are effectively passed to the second user.

First claim

What is claimed:

1. A system for enabling one or more users to interact with a virtual world comprising virtual world data, the system comprising:
a computer network comprising one or more computing devices, the one or more computing devices comprising memory, processing circuitry, and software stored at least in part in the memory and executable by the processing circuitry to process at least a portion of the virtual world data; and
a first user device, configured to be operated by a first user, comprising an environment-sensing system and a user-sensing system,

wherein the first user device is operatively coupled to the computer network,
wherein the environment-sensing system is configured to capture a local environment audio input,
wherein the user-sensing system is configured to capture a user audio input from the first user,
wherein at least a first portion of the virtual world data is the local environment audio input,
wherein at least a second portion of the virtual world data is the user audio input from the first user,
wherein the virtual world comprises a visual rendering by the one or more computing devices, and
wherein the visual rendering of the virtual world is presented in a three-dimensional format.

2. The system of claim 1 , wherein at least a portion of the virtual world changes in response to a change in the virtual world data.

3. The system of claim 1 , wherein at least a portion of the virtual world changes in response to a change in the audio input captured by the first user device.

4. The system of claim 1 , wherein the first user device is operable to provide an interface for enabling interaction between the first user and the virtual world in an augmented reality mode.

5. The system of claim 1 , wherein the first user device is operable to provide an interface for enabling interaction between the first user and the virtual world in a virtual reality mode.

6. The system of claim 1 , wherein the first user device is operable to provide an interface for enabling interaction between the first user and the virtual world in a combination of augmented reality and virtual reality modes.

7. The system of claim 1 , wherein the virtual world data is transmitted over a data network.

8. The system of claim 1 , wherein the computer network is operable to transmit the first portion of the virtual world data to a second user device for presentation to a second user, such that the second user may hear the local environment audio input of the first portion of the virtual world data at a location of the second user.

9. The system of claim 8 , wherein the first user and the second user are in different physical locations.

10. A system for enabling one or more users to interact with a virtual world comprising virtual world data, the system comprising:
a first user device operatively coupled to a computer network, the computer network comprising one or more computing devices, the one or more computing devices comprising memory, processing circuitry, and software stored at least in part in the memory and executable by the processing circuitry to process a first portion of the virtual world data;
a user-sensing system operatively coupled to the first user device and configured to capture a first input from a first user, wherein the user-sensing system is configured to transmit the first input to the computer network; and
an environment-sensing system operatively coupled to the first user device and configured to capture a second input from a local environment of the first user device, wherein the environment-sensing system is configured to transmit the second input to the computer network,

wherein the computer network is configured to alter virtual world data based on at least one of the first input and the second input,
wherein the first user device is configured to present virtual content to the first user based on altered virtual world data,
wherein the virtual world comprises a visual rendering by the one or more computing devices, and
wherein the visual rendering of the virtual world is presented in a three-dimensional format.

11. The system of claim 10 , wherein the virtual content is selected from a group consisting of visual content, audio content, and haptic content.

12. The system of claim 10 , wherein the first input from the first user is selected from a group consisting of gesture data, audio data, geographic location data, and optical characteristic data.

13. The system of claim 10 , wherein the second input from the local environment is selected from a group consisting of audio data from the local environment and visual data from a physical object in the local environment.

14. The system of claim 10 , further comprising a second user device configured to receive the virtual content.

15. The system of claim 14 , wherein the second user device is configured to present the virtual content to a second user.

Assignees

• Magic Leap Inc

Inventors

• Miller Samuel A

Classifications

• A63F2300/695

  Imported photos, e.g. of the player · CPC title

• A63F2300/1093

  using visible light · CPC title

• G06F3/016

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• A63F13/35

  Details of game servers · CPC title