Augmenting physical appearance using illumination

Patent metadata

Field	Value
Publication number	US-2016209740-A1
Application number	US-201615082171-A
Country	US
Kind code	A1
Filing date	Mar 28, 2016
Priority date	Dec 4, 2013
Publication date	Jul 21, 2016
Grant date	—

Abstract

A system for augmenting the appearance of an object including a plurality of projectors. Each projector includes a light source and a lens in optical communication with the light source, where the lens focuses light emitted by the light source on the object. The system also includes a computer in communication with the plurality of projectors, the computer including a memory component and a processing element in communication with the memory component and the plurality of projectors. The processing element determines a plurality of images to create an augmented appearance of the object and provides the plurality of images to the plurality of projectors to project light corresponding to the plurality of images onto the object to create the augmented appearance of the object. After the images are projected onto the object, the augmented appearance of the objected is substantially the same regardless of a viewing angle for the object.

First claim

What is claimed is:

1 . A system for augmenting the appearance of an object comprising:
a plurality of projectors; and a computer in communication with the plurality of projectors, comprising:
a memory component;
a processing element in communication with the memory component and the plurality of projectors; wherein
the processing element determines a plurality of images to create an augmented appearance of the object and provides the plurality of images to the plurality of projectors to project light corresponding to the plurality of images onto the object to create the augmented appearance of the object and takes into account the augmented appearance of the object from multiple viewpoints.

2 . The system of claim 1 , wherein the object is an actuated three-dimensional object.

3 . The system of claim 2 , wherein the combination of the augmented appearance of the object and actuation of the object replicate a target performance onto the object.

4 . The system of claim 1 , further comprising at least one camera in communication with the computer, wherein
the at least one camera captures feedback images and provides the feedback images to the computer; and the processing element analyses the feedback images and generates the plurality of images based on the feedback images.

5 . The system of claim 1 , wherein the processing element analyzes at least one input and generates the plurality of images based on the at least one input.

6 . The system of claim 1 , wherein the plurality of images are a deformed version of a target animation, rendered by the processing element from a point of view of each projector of the plurality of projectors.

7 . The system of claim 6 , wherein the deformed version of the target animation is determined by the processing element using properties assigned by a user, conveying semantics of the target animation.

8 . The system of claim 6 , wherein the deformed version of the target animation is determined by the processing element using properties determined by a facial recognition program, conveying semantics of the target animation.

9 . The system of claim 1 , wherein the processing element creates blending maps to smooth the plurality of images at intersections of images within the plurality of images.

10 . A system for modifying the appearance of an object to correspond to a target appearance having high frequency details and low frequency details, the system comprising:
a moveable object; a first projector in optical communication with the moveable object and configured to project a first image onto a first section of the object; a second projector in optical communication with the moveable object and configured to project a second image onto a second section of the object; wherein the movement of the object includes at least one of deformation or articulation; the low frequency details of the target appearance are replicated by movement of the object; the high frequency details of the target appearance are replicated by the first and second images projected onto the object; and the combination of the low frequency details and the high frequency details replicate the target appearance onto the object.

11 . The system of claim 10 , wherein the object is a mechanically actuated avatar.

12 . The system of claim 10 , wherein the movement of the object includes both deformation and articulation.

13 . The system of claim 10 , wherein the combination of the high frequency details and the low frequency details takes into account multiple viewpoints.

14 . The system of claim 10 , wherein the first image and the second image overlap at least in part at an overlap portion of the object and the first image and the second image are adjusted to compensate for the overlapping light areas of the first and second images in the overlap portion.

15 . The system of claim 14 , wherein compensating for the overlapping light areas comprises adjusting the intensities of the first image and the second image.

16 . The system of claim 10 , wherein the object comprises:
a frame; a partially translucent skin layer operably connected to the frame; and a plurality of actuators configured to move one or more sections of the frame and/or the skin layer.

17 . The system of claim 16 , further comprising adjusting the first image and the second image based on light transport of light within the object.

18 . The system of claim 16 , further comprising adjusting the first image and the second image based on a projector defocus of the first projector and the second projector, respectively.

19 . The system of claim 16 , wherein the skin layer is silicone.

20 . The system of claim 10 , further comprising:
at least one camera in optical communication with the object; and a computer in communication with the at least one cameras, the first projector, and the second projector, wherein the at least one camera captures feedback images of the avatar as the first and second images are projected thereon; and the computer uses the feedback images to adjust one or more parameters of the first and second images to better match the high frequency details of the target appearance.

21 . The system of claim 20 , wherein the at least one camera comprises a plurality of cameras.

22 . The system of claim 20 , wherein the at least one camera comprises a camera movable between at least a first position and a second position to capture the feedback images from two or more locations.

23 . The system of claim 10 , wherein the high frequency details of the target performance replicated onto the object are adapted taking into account the dynamics and deformation of the target performance and the dynamics and deformation of the moveable object.

24 . The system of claim 10 , wherein the movement of the moveable object is computed taking into account the dynamics and deformation of the target performance and the dynamics and deformation of the moveable object.

Assignees

• Disney Entpr Inc

Inventors

• Grundhofer Anselm
• Bermano Amit
• Bickel Bernd
• Bruschweiler Philipp
• Gross Markus
• Iwai Daisuke

Classifications

• G03B21/10

  Projectors with built-in or built-on screen · CPC title

• H04N5/7458

  the modulator being an array of deformable mirrors, e.g. digital micromirror device [DMD] · CPC title

• G03B21/00

  Projectors or projection-type viewers; Accessories therefor (devices for changing pictures G03B23/00) · CPC title

• H04N9/3185

  Geometric adjustment, e.g. keystone or convergence (optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14) · CPC title

• G03B2206/00

  Systems for exchange of information between different pieces of apparatus, e.g. for exchanging trimming information, for photo finishing · CPC title