Image correction system and method

Patent metadata

Field	Value
Publication number	US-2025095123-A1
Application number	US-202418883601-A
Country	US
Kind code	A1
Filing date	Sep 12, 2024
Priority date	Sep 18, 2023
Publication date	Mar 20, 2025
Grant date	—

Abstract

An image correction system may include a head-mounted display, a server, and a local correction device. The head-mounted display includes a display configured to display one or more corrected images and one or more sensors configured to generate initial tracking information and updated tracking information, wherein the initial tracking information is associated with a first time point and the updated tracking information is associated with a second time point subsequent to the first time point. The local correction device is configured to: receive the tracking information from the head-mounted display, transmit the initial tracking information to a server, receive one or more rendered images from the server, generate the one or more corrected images based on the one or more rendered images and the updated tracking information, and transmit the one or more corrected images to the head-mounted display.

First claim

1 . An image correction system, comprising:
a head-mounted display comprising: a display configured to display one or more corrected images; and one or more sensors configured to generate tracking information over a period of time, the tracking information comprising initial tracking information and updated tracking information, wherein the initial tracking information is associated with a first time point and the updated tracking information is associated with a second time point subsequent to the first time point; a server configured to generate one or more rendered images based at least in part on the initial tracking information; and a local correction device configured to: receive the tracking information from the head-mounted display; transmit the initial tracking information to the server; receive the one or more rendered images from the server; generate one or more corrected images based on the one or more rendered images and the updated tracking information; and transmit the one or more corrected images to the head-mounted display.

2 . The image correction system of claim 1 , wherein the local correction device is configured to generate the one or more corrected images by correcting for lens distortion associated with the head-mounted display.

3 . The image correction system of claim 2 , wherein the local correction device is configured to generate the one or more corrected images by applying one or more of timewarp, spacewarp, lens distortion factor corrections, or late latch corrections.

4 . The image correction system of claim 3 , wherein correcting for the lens distortion factor occurs subsequent to applying the one or more of timewarp, spacewarp, or late latch corrections.

5 . The image correction system of claim 1 , wherein the local correction device and the head-mounted display are coupled to a ride vehicle.

6 . The image correction system of claim 1 , wherein the local correction device is affixed to or embedded in a housing of the head-mounted display.

7 . The image correction system of claim 1 , wherein the local correction device is wirelessly coupled to the server.

8 . The image correction system of claim 7 , wherein the local correction device is coupled to the head-mounted display via a wired connection.

9 . The image correction system of claim 1 , wherein a local correction device transmits one or more corrected images to no more than one head-mounted display.

10 . The image correction system of claim 1 , wherein the one or more sensors comprise at least a camera and an inertial measurement unit (IMU) that generate tracking information.

11 . The image correction system of claim 10 , wherein the tracking information generated by the camera is communicated to the local correction device and subsequently the server, and the tracking information generated by the IMU is communicated to the local correction device and not the server.

12 . An image correction method, comprising:
generating, at a server, one or more rendered images of an augmented reality/virtual reality (AR/VR) environment, wherein the one or more rendered images comprise at least one frame that is rendered based on tracking information; receiving, at a local correction device, the one or more rendered images; applying a first stage correction to the one or more rendered images, wherein the first stage correction is based on updated tracking information; applying a second stage correction to the one or more rendered images to generate one or more corrected images, wherein the second stage correction is a distortion correction associated with a head-mounted display; and transmitting the one or more corrected images to the head-mounted display.

13 . The image correction method of claim 12 , wherein the head-mounted display comprises a projector, and the distortion correction is a function of distortions of display surfaces on which a projected image will be displayed.

14 . The image correction method of claim 12 , wherein the head-mounted display comprises a lens, and the distortion correction is a function of the distortion of the lens.

15 . The image correction method of claim 12 , wherein the local correction device or the head-mounted display is configured to apply a third stage correction to the one or more rendered images.

16 . The image correction method of claim 12 , wherein the tracking information is generated at the head-mounted display and communicated to the server via the local correction device.

17 . The image correction method of claim 12 , wherein the updated tracking information is generated at the head-mounted display and communicated to the local correction device and not to the server.

18 . A non-transitory computer-readable medium, the computer-readable medium comprising processor-executable code that when executed by a processor, causes the processor to:
receive one or more rendered images of an augmented reality/virtual reality (AR/VR) environment, wherein the one or more rendered images comprise at least one frame that is rendered based on tracking information; apply a first stage correction to the one or more rendered images, wherein the first stage correction is based on updated tracking information; apply a second stage correction to the one or more rendered images to generate one or more corrected images, wherein the second stage correction is a distortion correction associated with a head-mounted display; and transmit the one or more corrected images to the head-mounted display.

19 . The non-transitory computer-readable medium of claim 18 , wherein the processor-executable code, when executed by the processor, causes the processor to:
receive the tracking information from the head-mounted display; and transmit the tracking information to a server configured to generate the one or more rendered images of the AR/VR environment.

20 . The non-transitory computer-readable medium of claim 18 , wherein the distortion correction is one or more of timewarp, spacewarp, lens distortion factor corrections, or late latch corrections.

Assignees

• Universal City Studios Llc

Inventors

• Goergen Patrick John
• Jordan Robert Michael

Classifications

• G06T5/80 Primary

  Geometric correction · CPC title

• G06T7/20

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F3/14

  Digital output to display device {; Cooperation and interconnection of the display device with other functional units} · CPC title

• A63G31/16

  creating illusions of travel · CPC title