System and method for augmented and virtual reality

Patent metadata

Field	Value
Publication number	US-10862930-B2
Application number	US-202016752577-A
Country	US
Kind code	B2
Filing date	Jan 24, 2020
Priority date	Oct 28, 2011
Publication date	Dec 8, 2020
Grant date	Dec 8, 2020

Abstract

One embodiment is directed to a system for enabling two or more users to interact within a virtual world comprising virtual world data, comprising a computer network comprising one or more computing devices, the one or more computing devices comprising memory, processing circuitry, and software stored at least in part in the memory and executable by the processing circuitry to process at least a portion of the virtual world data; wherein at least a first portion of the virtual world data originates from a first user virtual world local to a first user, and wherein the computer network is operable to transmit the first portion to a user device for presentation to a second user, such that the second user may experience the first portion from the location of the second user, such that aspects of the first user virtual world are effectively passed to the second user.

First claim

What is claimed:

1. A system comprising:
a first user device configured to communicate with a computer network comprising one or more computing devices, the one or more computing devices comprising:
one or more processors, and
memory storing instructions which, when executed by the one or more processors, cause the one or more processors to process first virtual world data;

wherein the computer network is configured to:
receive, via a user-sensing system, from a first user, a first input, and
receive, via an environment-sensing system, from a local environment of the first user device, a second input,

wherein:
one or more of the one or more computing devices are configured to generate second virtual world data based on the first virtual world data and further based on at least one of the first input and the second input,
the first user device is further configured to present, based on the second virtual world data, virtual content to the first user,
presenting the virtual content to the first user comprises presenting a visual rendering of the virtual content in a 3D format, and
presenting the visual rendering of the virtual content in the 3D format comprises presenting the visual rendering on a display based on a position and orientation of the first user device.

2. The system of claim 1 , wherein:
the first input comprises audio data from the first user,
the second input comprises audio data from the local environment, and
generating the second virtual world data comprises generating the second virtual world data based on the audio data from the first user and further based on the audio data from the local environment.

3. The system of claim 1 , wherein the display comprises a see-through display of the first user device.

4. The system of claim 1 , wherein the virtual content comprises one or more of visual content, audio content, and haptic content.

5. The system of claim 1 , wherein:
the first input comprises one or more of gesture data, audio data, geographic location data, and optical characteristic data, and
generating the second virtual world data comprises generating the second virtual world data based on the one or more of gesture data, audio data, geographic location data, and optical characteristic data.

6. The system of claim 1 , wherein:
the second input comprises visual data from a physical object in the local environment, and
generating the second virtual world data comprises generating the second virtual world data based on the visual data.

7. The system of claim 1 , further comprising a second user device configured to present second virtual content, based on the second virtual world data, to a second user.

8. The system of claim 1 , wherein generating the second virtual world data comprises generating the second virtual world data based on both the first input and the second input.

9. The system of claim 1 , wherein generating the second virtual world data comprises generating a virtual object based on at least one of the first input and the second input.

10. The system of claim 9 , wherein the virtual object is associated with a physical object in the local environment.

11. The system of claim 1 , wherein the computer network comprises a smartphone.

12. The system of claim 11 , wherein the first user device is further configured to removably couple with the smartphone.

13. The system of claim 1 , wherein the computer network comprises a personal computer.

14. The system of claim 1 , wherein presenting the visual rendering on the display comprises presenting the visual rendering at a position on the display determined based on a location of a first physical object.

15. The system of claim 1 , wherein presenting the visual rendering on the display comprises presenting the visual rendering at a position on the display determined based on the position and orientation of the first user device.

16. The system of claim 1 , wherein the position of the first user device comprises a geospatial location of the first user device.

17. The system of claim 1 , wherein presenting virtual content to the first user comprises presenting the virtual content to the first user in response to a determination that a location of the first user device corresponds to a first location.

18. The system of claim 1 , wherein presenting virtual content to the first user comprises presenting the virtual content to the first user in response to detecting a first physical object.

19. The system of claim 1 , wherein the first user device comprises a wearable device comprising the display, and wherein the display comprises a head-mounted see-through display.

20. The system of claim 19 , wherein the wearable device is configured to communicate with the computer network via a smartphone.

Assignees

• Magic Leap Inc

Inventors

• Miller Samuel A

Classifications

• H04L65/4015 Primary

  where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/016

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• A63F2300/8082

  Virtual reality · CPC title

• A63F2300/695

  Imported photos, e.g. of the player · CPC title