Systems and methods for textual overlay in an amusement park environment

Patent metadata

Field	Value
Publication number	US-10699485-B2
Application number	US-201815862498-A
Country	US
Kind code	B2
Filing date	Jan 4, 2018
Priority date	Jan 4, 2018
Publication date	Jun 30, 2020
Grant date	Jun 30, 2020

Abstract

Present systems and methods are directed to a system that includes a visualization device that includes a display viewable by a user. The system also includes a computer graphics generation system communicatively coupled to the visualization device. The computer graphics generation system includes a processor and a memory device communicatively coupled to the processor, such that the memory device stores instructions that cause the processor to generate an environment of real-world images, augmented-reality images, or a combination thereof. The instructions also cause the processor to receive and analyze data associated with the environment to determine an appropriate text location, determine appropriate textual characteristics for text based at least in part on the appropriate text location, and overlay the text having the appropriate textual characteristics onto the environment at the appropriate text location.

First claim

The invention claimed is:

1. A system, comprising:
a visualization device comprising a display viewable by a user;
a computer graphics generation system communicatively coupled to the visualization device, wherein the computer graphics generation system comprises a processor and a memory device communicatively coupled to the processor and configured to store instructions configured to cause the processor to:
generate an environment comprising real-world images, augmented-reality images, or a combination thereof;
receive and analyze data associated with the environment to provide a data analysis, wherein the data analysis comprises indications of significance for the real-world images, the augmented-reality images, or the combination thereof;
provide a ranking of the real-world images, the augmented-reality images, or the combination thereof based at least on the indications of significance;
determine an appropriate text location based at least on the ranking;
determine appropriate textual characteristics for text based at least in part on the appropriate text location;
determine content for the text to correspond with a sound narrative provided via a speaker of the system; and
overlay the text comprising the appropriate textual characteristics and comprising the content corresponding with the sound narrative onto the environment at the appropriate text location.

2. The system of claim 1 , wherein the appropriate textual characteristics comprise a size of the text, a color of the text, a font of the text, a duration for displaying the text, or a combination thereof.

3. The system of claim 2 , wherein the instructions are configured to cause the processor to determine the color of the text based on a respective background color at the appropriate text location.

4. The system of claim 1 , wherein the data associated with the environment comprises a position, a size, or a combination thereof, of the real-world images or the augmented-reality images in the environment.

5. The system of claim 1 , wherein the instructions are configured to cause the processor to determine the appropriate text location, wherein the appropriate text location is a location that covers one or more of the real-world images or the augmented-reality images having a relatively low calculated significance and that enables the user to visualize one or more of the real-world images or the augmented-reality images having a relatively high calculated significance.

6. The system of claim 1 , wherein the instructions are configured to cause the processor to determine the appropriate text location, wherein the appropriate text location is a location that covers one or more of the real-world images or the augmented-reality imges having a relatively low calculated significance and that enables the user to visualize one or more of the real-world images or the augmented-reality images having a relatively high calculated significance.

7. The system of claim 1 , wherein the instructions are configured to cause the processor to update the text in coordination with a timestamp, wherein the timestamp provides a start time and an end time for the processor to overlay the text.

8. The system of claim 1 , wherein the instructions are configured to cause the processor to determine a gaze direction of the user and to determine the appropriate textual characteristics based at least in part on the gaze direction.

9. The system of claim 1 , wherein the visualization device is configured to be worn by the user.

10. The system of claim 1 , wherein the instructions are configured to cause the processor to update the text in coordination with a detected image of the real-world images, the augmented-reality images, or a combination thereof, to synchronize the overlay of the text with the sound narrative.

11. The system of claim 1 , wherein the visualization device is configured to be worn by the user.

12. A method for overlaying text on a display of a visualization device, comprising:
generating, via one or more processors, an environment on the display, the environment comprising real-world images, augmented-reality images, virtual-reality images, or a combination thereof;
providing, via the one or more processors, a ranking of the real-world images, the augmented-reality images, the virtual-reality images, or the combination thereof based at least on relative significance of the real-world images, the augmented-reality images, the virtual-reality images or the combination thereof in the environment;
determining, via the one or more processors, an appropriate text location based at least on the ranking;
determining, via the one or more processors, appropriate textual characteristics for the text based at least in part on the appropriate text location;
determining, via the one or more processors, content for the text to correspond with a sound narrative provided via a speaker device; and
overlaying, via the one or more processor, the text comprising the appropriate textual characteristics and comprising the content corresponding with the sound narrative onto the environment on the display at the appropriate text location.

13. The method of claim 12 , wherein the appropriate textual characteristics comprise a size of the text, a color of the text, a font of the text, a duration for displaying the text, or a combination thereof.

14. The method of claim 12 , wherein determining, via the one or more processors, the appropriate text location is based on a position, a size, or a combination thereof, of the real-world images, the virtual-reality images, the augmented-reality images, or the combination thereof in the environment.

15. The method of claim 12 , comprising updating, via the one or more processors, the text based on a timestamp, an action by a user, a change in a gaze direction of the user, a change in the real-world images, the augmented reality images, the virtual reality images within the environment, or a combination thereof.

16. The method of claim 12 , comprising:
determining, via the one or more processors, a gaze direction of a user; and
determining, via the one or more processors, the appropriate text location bsaed at least in part on the gaze direction.

17. The method of claim 16 , comprising determining, via the one or more processors, the appropriate textual characteristics based at least in part on the gaze direction.

18. A tangible, non-transitory, computer-readable medium that stores instructions executable by one or more processors in a computer graphics generation system communicatively coupled to a visualization device configured to be worn by a user, wherein the instructions are configured to cause the one or more processors to:
generate an environment visible to the user via the visualization device by displaying real-world images, virtual-reality images, augmented-reality images, or a combination thereof on a display of the visualization device;
receive and analyze a signal indicative of a gaze direction of the user;
receive and analyze data related to the environment;
determine an appropriate text location based at least in part on the signal indicative of the gaze direction of the user and the data related to the environment;
determine content for text to correspond with a sound narrative provided via a speaker of the visualization device; and
update, in synchronization with the sound narrative, the text in coordination with a position of a ride vehicle to overlay the text onto the environment at the appropriate text location.

19. The tangible, non-t

Assignees

• Universal City Studios Llc

Inventors

• Zielkowski Amanda Kate

Classifications

• G06V20/20

  in augmented reality scenes · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G02B27/017

  Head mounted · CPC title

• A63G31/16 Primary

  creating illusions of travel · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title