Apparatus and methods for bringing an object to life

Patent metadata

Field	Value
Publication number	US-10257482-B2
Application number	US-201715702039-A
Country	US
Kind code	B2
Filing date	Sep 12, 2017
Priority date	Jan 26, 2016
Publication date	Apr 9, 2019
Grant date	Apr 9, 2019

Abstract

This disclosure relates to apparatus and methods for bringing an object to life using a projection apparatus. An object may be augmented with a projected image by detecting a landmark associated with the object, determining a modified version of an image to compensate for an orientation of the projection apparatus to the landmark, and implementing a light generated by the projection apparatus to project the modified version of the image on a surface of the object.

First claim

What is claimed is:

1. A projection apparatus comprising:
a housing;
a light source carried by the housing, the light source configured to generate and project light on a surface of an object;
an image sensor carried by the housing, the image sensor configured to generate visual output signals conveying visual information within a field of view of the image sensor;
an orientation sensor carried by the housing, the orientation sensor configured to generate orientation output signals conveying orientation information of the housing independent of the visual output signals;
one or more processors carried by the housing, the one or more processors configured by machine readable instructions to:
detect a landmark of a given type within the field of view of the image sensor based on the visual output signals, the given type of the landmark being associated with the object;
select an image based on the given type of the landmark;
determine a modified version of the image based on the visual output signals, the orientation output signals, or the visual output signals and the orientation output signals to compensate for an orientation of the housing relative to the landmark; and
implement the light generated by the light source to project the modified version of the image on the surface of the object.

2. The projection apparatus of claim 1 , further comprising an audio output carried by the housing, wherein the one or more processors are further configured to effectuate operation of the audio output to generate audio based on the image.

3. The projection apparatus of claim 2 , wherein the audio generated by the audio output is binaural audio that seems to originate from the object.

4. The projection apparatus of claim 1 , further comprising a distance sensor carried by the housing, the distance sensor configured to generate distance output signals conveying distance information relating to a distance between the housing and the object, wherein the one or more processors are further configured to determine the modified version of the image based on the distance output signals.

5. The projection apparatus of claim 1 , wherein the landmark includes a label, a sticker, an augmented reality marker, a part of the object, or an entire shape of the object.

6. The projection apparatus of claim 1 , wherein the one or more processors are further configured to animate the image.

7. The projection apparatus of claim 1 , wherein the one or more processors are further configured to animate the image based on one or more of the given type of the landmark, a user input received through an input device, or remotely received information.

8. The projection apparatus of claim 1 , further comprising a wireless communication device carried by the housing, wherein the one or more processors are further configured to effectuate transmission of control output signals by the wireless communication device, the control output signals configured to effectuate operation of the object based on the projection of the image.

9. The projection apparatus of claim 1 , further comprising a wireless communication device carried by the housing, wherein the one or more processors are further configured to effectuate transmission of control output signals by the wireless communication device, the control output signals configured to effectuate operation of a second object based on the projection of the image.

10. A method for using a projection apparatus, the method comprising:
generating visual output signals conveying visual information within a field of view of an image sensor;
generating orientation output signals conveying orientation information of a housing independent of the visual output signals, wherein the housing carries a light source configured to generate and project light on a surface of an object;
detecting a landmark of a given type within the field of view of the image sensor based on the visual output signals, the given type of the landmark being associated with the object;
selecting an image based on the given type of the landmark;
determining a modified version of the image based on the visual output signals, the orientation output signals, or the visual output signals and the orientation output signals to compensate for an orientation of the housing relative to the landmark; and
implementing the light generated by the light source to project the modified version of the image on the surface of the object.

11. The method of claim 10 , further comprising operating an audio output to generate audio based on the image.

12. The method of claim 11 , wherein the audio generated by the audio output is binaural audio that seems to originate from the object.

13. The method of claim 10 , further comprising generating distance output signals conveying distance information relating to a distance between the housing and the object, wherein the modified version of the image is further determined based on the distance output signals.

14. The method of claim 10 , wherein the landmark includes a label, a sticker, an augmented reality marker, a part of the object, or an entire shape of the object.

15. The method of claim 10 , further comprising animating the image.

16. The method of claim 10 , further comprising animating the image based on one or more of the given type of the landmark, a user input received through an input device, or remotely received information.

17. The method of claim 10 , further comprising transmitting control output signals via a wireless communication device, the control output signals configured to effectuate operation of the object based on the projection of the image.

18. The method of claim 10 , further comprising transmitting control output signals via a wireless communication device, the control output signals configured to effectuate operation of a second object based on the projection of the image.

19. A projection apparatus comprising:
a housing;
a light source carried by the housing, the light source configured to generate and project light on a surface of an object;
an audio output carried by the housing;
an image sensor carried by the housing, the image sensor configured to generate visual output signals conveying visual information within a field of view of the image sensor;
an orientation sensor carried by the housing, the orientation sensor configured to generate orientation output signals conveying orientation information of the housing independent of the visual output signals;
one or more processors carried by the housing, the one or more processors configured by machine readable instructions to:
detect a landmark of a given type within the field of view of the image sensor based on the visual output signals, the given type of the landmark being associated with the object;
select an image based on the given type of the landmark;
determine a modified version of the image based on the visual output signals, the orientation output signals, or the visual output signals and the orientation output signals to compensate for an orientation of the housing relative to the landmark;
implement the light generated by the light source to project the modified version of the image on the surface of the object; and
effectuate operation of the audio output to generate audio based on the image, wherein the audio generated by the audio output is binaural audio that seems to originate from the object.

20. The projection apparatus of claim 19 , wherein the one or more processors are further configured to animate the

Assignees

• Disney Entpr Inc

Inventors

• Goslin Michael P
• Haseltine Eric
• Olson Blade A

Classifications

• H04N9/315

  Modulator illumination systems (general applications of lighting devices F21V; general optical systems G02B; lamp houses for projectors not peculiar to the presence of an electronic spatial light modulator G03B21/20) · CPC title

• H04N9/3194 Primary

  including sensor feedback · CPC title

• G03B21/147

  Optical correction of image distortions, e.g. keystone · CPC title

• H04N9/3188

  Scale or resolution adjustment (scaling in general G06T3/40; resolution modifying circuits for displays in general G09G5/391) · CPC title

• H04S7/30

  Control circuits for electronic adaptation of the sound field · CPC title