Three-dimensional stereoscopic projection on complex surfaces

Patent metadata

Field	Value
Publication number	US-9489724-B2
Application number	US-201414230706-A
Country	US
Kind code	B2
Filing date	Mar 31, 2014
Priority date	Mar 31, 2014
Publication date	Nov 8, 2016
Grant date	Nov 8, 2016

Abstract

A method of displaying. The method includes using a system including three-dimensional stereoscopic projection equipment to project an image onto a complex surface of a physical object disposed in an area. The complex surface includes at least one curve or angle. The system also includes a device worn by a user or disposed on a mobile device. The method further includes warping the image based on a geometry of the complex surface, tracking a position and orientation of the user or the mobile device, and further warping the image based on the position and orientation.

First claim

What is claimed is:

1. A method comprising:
using a system comprising three-dimensional stereoscopic projection equipment to project an image onto a complex surface of a physical object disposed in an area, the complex surface comprising at least one curve or angle, the system also comprising a device worn by a user or disposed on a mobile device;
tracking a first position and first orientation of a point of view of the user or the mobile device;
warping the image based on a geometry of the complex surface and the first position and first orientation, wherein warping the image causes the image to appear to the user or the mobile device as a three-dimensional representation comprising a moving virtual object as seen from a first perspective of the user or the mobile device at the first position;
tracking a second position and second orientation of the point of view of the user or the mobile device; and
further warping and modifying the image based on the second position and second orientation, wherein modifying the image comprises presenting the image as a view of the moving virtual object as seen from a second perspective of the user or the mobile device at the second position.

2. The method of claim 1 , wherein the physical object comprises a part, and wherein the image further comprises written instructions for taking an action with the virtual object with respect to the physical object.

3. The method of claim 1 , wherein the three-dimensional representation further comprises a tool, and wherein the image comprises using the tool to perform an action with respect to the physical object.

4. The method of claim 1 , wherein the virtual object comprises a virtual representation of a second physical object to be added to the physical object.

5. An apparatus comprising:
a system comprising three-dimensional stereoscopic projection equipment configured to project an image onto a complex surface of a physical object disposed in an area, the complex surface comprising at least one curve or angle, the system also comprising a device worn by a user or disposed on a mobile device;
a computer in communication with the system, the computer configured to:
track, using the device, a first position and first orientation of a point of view of the user or the mobile device;
cause the system to warp the image based on a geometry of the complex surface and the first position and first orientation, wherein warping the image causes the image to appear to the user or the mobile device as a three-dimensional representation comprising a moving virtual object as seen from a first perspective of the user or the mobile device at the first position;
track, using the device, a second position and second orientation of the point of view of the user or the mobile device; and
cause the system to further warp and modify the image based on the position and orientation, wherein modifying the image comprises presenting the image as a view of the moving virtual object as seen from a second perspective of the user or the mobile device at the second position.

6. The apparatus of claim 5 , wherein the computer is further configured to cause the system to project one or more images selected from the group consisting of: first images of assembling a second part on the complex surface, second images of disassembly of the complex surface, third images of reworking of the complex surface, fourth images of using a tool on the complex surface, fifth images comprising written instructions for taking an action with respect to the complex surface, sixth images for inspecting the complex surface, and seventh images for a demonstration of use of the complex surface.

7. The method of claim 1 , wherein modifying the image further comprises removing a portion of the virtual object.

8. The method of claim 1 , wherein the first position comprises a first three-dimensional position of the user or the mobile device in the area.

9. The method of claim 8 , wherein the second position comprises a second three-dimensional position of the user or the mobile device in the area.

10. The method of claim 1 , wherein the complex surface is a circuit board.

11. The method of claim 10 , wherein the image further comprises parts and wiring to be added to the circuit board.

12. The method of claim 1 , wherein the image is a full-color image.

13. The method of claim 2 , wherein the action is one of assembly, disassembly, or maintenance of the part.

14. The method of claim 3 , wherein the tool is a drill.

15. The method of claim 4 , wherein the virtual object further comprises a virtual representation of a third physical object to be added to the physical object, and wherein the image further comprises instructions directing an order in which the second physical object and third physical object are to be added to the physical object.

Assignees

• Boeing Co

Inventors

• Davies Paul Robert
• Gunther Steven Matthew

Classifications

• H04N9/3185

  Geometric adjustment, e.g. keystone or convergence (optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14) · CPC title

• H04N13/366

  using viewer tracking · CPC title

• G06T3/005

  Physics · mapped topic

• H04N13/0468

  Electricity · mapped topic

• G06T5/006 Primary

  Physics · mapped topic