Mixed reality viewer system and method

Patent metadata

Field	Value
Publication number	US-10572000-B2
Application number	US-201715818463-A
Country	US
Kind code	B2
Filing date	Nov 20, 2017
Priority date	Mar 6, 2017
Publication date	Feb 25, 2020
Grant date	Feb 25, 2020

Abstract

A mixed reality viewing system includes a viewer configured to be secured to a steady platform and operable by a user to view a theme through the viewer. The viewer includes a display device, a user interface comprising a zoom control, and at least one sensor comprising at least one camera. The mixed reality viewing system also includes a computer graphics generation system communicatively coupled to the viewer. The computer graphics generation system is configured to generate streaming media of a real world environment based on image data captured via the at least one camera of the viewer, generate augmented reality graphics, virtual reality graphics, or both, superimposed on the streaming media of the real world environment, and transmit the streaming media of the real world environment along with the superimposed augmented reality graphics, virtual reality graphics, or both, to be displayed on the display device of the viewer.

First claim

The invention claimed is:

1. A mixed reality viewing system, comprising:
a viewer configured to be secured to a steady platform and operable by a user to view a theme through the viewer, wherein the viewer comprises:
a display device;
a user interface comprising a zoom control; and
at least one sensor, the at least one sensor comprising at least one camera; and

a computer graphics generation system communicatively coupled to the viewer and configured to:
determine a magnification of the zoom control;
generate streaming media including augmented reality graphics superimposed on image data of a real world environment captured via the at least one camera of the viewer in response to determining that the zoom control is zoomed to a first magnification;
generate additional streaming media of a virtual reality environment in response to determining that the zoom control is zoomed to a second magnification different than the first magnification; and
transmit the streaming media or the additional streaming media to be displayed on the display device of the viewer.

2. The mixed reality viewing system of claim 1 , wherein the computer graphics generation system is configured to:
transmit the streaming media including the augmented reality graphics superimposed on the image data of the real world environment to be displayed on the display device in response to determining that the zoom control is zoomed to the first magnification; and
transmit the additional streaming media of the virtual reality environment to be displayed on the display device in response to determining that the zoom control is zoomed to the second magnification, wherein the second magnification is higher than the first magnification.

3. The mixed reality viewing system of claim 1 , wherein the viewer comprises:
a viewer portion comprising the display device and the user interface, wherein the viewer portion is rotatable by the user to adjust an angle of view; and
a fixture portion rotatably coupled to the viewer portion and fixedly coupling the viewer to the steady platform.

4. The mixed reality viewing system of claim 1 , wherein the display device of the viewer comprises a first display and a second display, and wherein the first display is configured to display the streaming media or the additional streaming media to a first eye of the user and the second display is configured to display the streaming media or the additional streaming media to a second eye of the user.

5. The mixed reality viewing system of claim 4 , wherein the first display and the second display include respective characteristic dimensions that enable guests other than the user to view the streaming media or the additional streaming media on the first display, the second display, or both.

6. The mixed reality viewing system of claim 1 , wherein the viewer comprises a speaker.

7. The mixed reality viewing system of claim 1 , wherein each camera of the at least one camera of the viewer comprises a digital high speed camera having a frame-rate of at least sixty frames per second with a horizontal resolution of at least 4000 pixels.

8. The mixed reality viewing system of claim 1 , wherein the at least one sensor comprises one or more orientation and position sensors, one or more multi degree-of-freedom inertial measurement units, one or more light sensors, one or more presence sensors, one or more antennas, or a combination thereof.

9. The mixed reality viewing system of claim 1 , comprising a remote display device, wherein the computer graphics generation system is configured to transmit the streaming media or the additional streaming media to be displayed on the remote display device.

10. The mixed reality viewing system of claim 1 , wherein the computer graphics generation system has a model of the real world environment surrounding the viewer, wherein the model comprises spatial information of the viewer relative to the real world environment.

11. A fixed-position viewer, comprising:
a display configured to display a streaming media to a user;
a camera configured to capture image data of a real world environment surrounding the fixed-position viewer;
at least one sensor configured to collect information for generation of the streaming media;
a user interface comprising a zoom control configured to enable the user to zoom-in and zoom-out on the streaming media displayed on the display; and
a computer graphics generation system configured to:
receive the image data of the real world environment and the information collected by the at least one sensor;
render the streaming media based at least on the image data and the information; and
transition the streaming media from an augmented reality environment to a virtual reality environment in response to determining that the zoom control is zoomed beyond a pre-determined threshold magnification.

12. The fixed-position viewer of claim 11 , wherein the camera comprises a digital high speed camera with a frame rate of at least sixty frames per second and a horizontal resolution of at least 4000 pixels.

13. The fixed-position viewer of claim 11 , comprising one or more speakers configured to provide audio effects corresponding to the streaming media displayed on the display.

14. The fixed-position viewer of claim 11 , wherein the at least one sensor comprises one or more orientation and position sensors, one or more multi degree-of-freedom inertial measurement units, one or more light sensors, one or more presence sensors, one or more antennas, or a combination thereof.

15. The fixed-position viewer of claim 11 , wherein the display includes a characteristic dimension that enables one or more guests other than the user of the fixed-position viewer to view the streaming media on the display.

16. The fixed-position viewer of claim 11 , wherein the information collected by the at least one sensor comprises user information, and wherein at least some content of the streaming media displayed on the display is customized to the user based on the user information.

17. A method, comprising:
receiving real-time data from at least one sensor and a user interface of a fixed-position viewer;
analyzing the real-time data via a computer graphics generation system;
generating gaming effects, via the computer graphics generation system, based on the real-time data, wherein generating the gaming effects via the computer graphics generation system comprises:
generating streaming media including augmented reality graphics overlaid onto a visualization of a real world environment in response to determining that a zoom control of the user interface is zoomed to a first magnification; and
generating additional streaming media including virtual reality graphics that replace the visualization of the real world environment in response to determining that the zoom control of the user interface is zoomed to a second magnification that is different than the first magnification;

transmitting, via the computer graphics generation system, the gaming effects including the streaming media or the additional streaming media to the fixed-position viewer; and
displaying, via the computer graphics generation system, the streaming media or the additional streaming media on a display of the fixed-position viewer.

18. The method of claim 17 , wherein the second magnification is greater than the first magnification.

19. The method of claim 17 , wherein receiving the real-time data comprises receiving, via the computer graphics generation system, data collected via at least

Assignees

• Universal City Studios Llc

Inventors

• Cossairt Travis
• Yeh Wei

Classifications

• A63G31/16

  creating illusions of travel · CPC title

• A63F13/25 Primary

  Output arrangements for video game devices · CPC title

• A63F13/211

  using inertial sensors, e.g. accelerometers or gyroscopes · CPC title

• A63F13/213

  comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence) · CPC title

• A63F13/837

  Shooting of targets · CPC title