Projecting images and videos onto engineered curved surfaces

Patent metadata

Field	Value
Publication number	US-2020014896-A1
Application number	US-201916575639-A
Country	US
Kind code	A1
Filing date	Sep 19, 2019
Priority date	Feb 6, 2018
Publication date	Jan 9, 2020
Grant date	—

Abstract

Techniques for projecting images onto fabricated surfaces. One or more electronic files containing an engineering diagram that describes a three-dimensional shape of the fabricated surface are retrieved. Warp transformation information for transforming images to be projected onto the fabricated surface is calculated, based on the engineering diagram, positional information defining a three-dimensional position of a projection device, relative to the fabricated surface, and positional information of an intended viewer relative to the fabricated surface. The warp transformation information is applied to one or more images to generate one or more transformed images. Embodiments project, using the projection device, the one or more transformed images onto the fabricated surface.

First claim

What is claimed is:

1 . A method, comprising:
receiving one or more electronic files containing an engineering diagram relating to a surface; parsing the one or more electronic files to determine a plurality of parameters describing a three-dimensional shape of the surface; calculating warp transformation information for transforming images to be projected onto the surface, based on the determined plurality of parameters, first positional information defining a three-dimensional position of a projection device, relative to the surface, and second positional information of an intended viewer relative to the surface; receiving one or more images to project onto the surface; applying the warp transformation information to the one or more images to generate one or more transformed images; and projecting, using the projection device, the one or more transformed images onto the surface.

2 . The method of claim 1 , wherein the one or more images further comprise frames of video data.

3 . The method of claim 1 , wherein calculating the warp transformation information for transforming images to be projected onto the surface, based on the determined plurality of parameters and first positional information defining a three-dimensional position of the projection device, relative to the surface, further comprises:
simulating projection of a first image onto a virtual representation of the surface, based on the determined plurality of parameters and the first positional information defining the three-dimensional position of the projection device, relative to the surface.

4 . The method of claim 3 , wherein calculating the warp transformation information for transforming images to be projected onto the surface, based on the determined plurality of parameters and first positional information defining a three-dimensional position of the projection device, relative to the surface, further comprises:
mapping a plurality of points between the first image and a second image, wherein the second image comprises a simulated projection of the first image.

5 . The method of claim 1 , wherein the engineering diagram further comprises a computer-aided design (CAD) file that defines a surface geometry of the surface.

6 . The method of claim 1 , wherein the warp transformation information is applied to the one or more images to generate one or more transformed images in real-time using one or more graphics processing units (GPUs).

7 . The method of claim 1 , wherein the one or more images further comprise frames of video data, and further comprising generating a digital file that is formatted according to a predefined video encoding standard, wherein the digital file contains at least a representation of the transformed images generated from the frames of video data.

8 . The method of claim 1 , wherein the first positional information further defines a pose and an orientation of the projection device.

9 . The method of claim 8 , wherein the warp transformation information is applied to the one or more images to generate one or more transformed images, such that when the one or more transformed images are projected onto the surface using the projection device, the projected image is substantially similar in appearance to the one or more images when viewed from a location of the intended viewer.

10 . The method of claim 1 , wherein the projection device further comprises a normal-throw projection device, and wherein the first positional information further comprises three-dimensional coordinates defining a center of a visible lens of the normal-throw projection device.

11 . The method of claim 1 , wherein the first positional information is calculated using multiple different projector positions.

12 . The method of claim 1 , wherein calculating warp transformation information for transforming images to be projected onto the surface is further based on generating a three-dimensional virtual representation of the surface, using the engineering diagram.

13 . The method of claim 12 , wherein calculating warp transformation information for transforming images to be projected onto the surface, based on the determined plurality of parameters and first positional information defining a three-dimensional position of the projection device, relative to the surface further comprises:
receiving a selection of a bounding box that corresponds to a rectangular portion of a camera plane; and calculating the warp transformation information, based on the bounding box selection and one or more generated bijective mappings relating to a projector plane for the projection device and the camera plan.

14 . A projection system, comprising:
one or more projection devices; a non-transitory computer-readable medium containing electronic data corresponding to one or more images to project onto a surface and warp transformation information for transforming images to be projected onto the surface, wherein the warp transformation information is calculated based on a plurality of parameters describing a three-dimensional shape of the surface, first positional information defining one or more three-dimensional positions of the one or more projection device, relative to the surface, and second positional information of an intended viewer relative to the surface; and logic configured to:
parse one or more electronic files containing an engineering diagram, to determine the plurality of parameters describing the three-dimensional shape of the surface
retrieve the electronic data corresponding to the one or more images to project onto the surface from the non-transitory computer-readable medium;
apply the warp transformation information to the one or more images to generate one or more transformed images; and
project, using the one or more projection devices, the one or more transformed images onto the surface.

15 . The projection system of claim 14 , wherein the one or more images further comprise frames of video data.

16 . The projection system of claim 14 , wherein the warp transformation information for transforming images to be projected onto the surface, is calculated by, at least in part:
simulating projection of a first image onto a virtual representation of the surface, based on the determined plurality of parameters and the first positional information defining the three-dimensional position of the one or more projection devices, relative to the surface; and mapping a plurality of points between the first image and a second image, wherein the second image comprises a simulated projection of the first image.

17 . The projection system of claim 14 , wherein the warp transformation information for transforming images to be projected onto the surface is further based on generating a three-dimensional virtual representation of the surface, using the engineering diagram.

18 . The projection system of claim 14 , wherein the first positional information further defines a pose and an orientation of the one or more projection devices, and wherein the second positional information defines a location of the intended viewer.

19 . The projection system of claim 18 , wherein the warp transformation information is applied to the one or more images to generate one or more transformed images, such that when the one or more transformed images are projected onto the surface using the one or more projection devices, the projected image is substantially similar in appearance to the one or more images when viewed from the location of the intended viewer.

Assignees

• Boeing Co

Inventors

• Tripathi Shubham
• Viswanathan Kapaleeswaran
• Ayyagari Arun

Classifications

• H04N9/3185 Primary

  Geometric adjustment, e.g. keystone or convergence (optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14) · CPC title

• H04N9/3147

  Multi-projection systems (video walls G06F3/1446) · CPC title

• H04N9/3194

  including sensor feedback · CPC title

• G09G3/001

  using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background (slide projectors per se G03B23/00 = 42 HP) · CPC title

• G06T3/0093

  Physics · mapped topic