Methods and systems for content processing

Patent metadata

Field	Value
Publication number	US-9692984-B2
Application number	US-201514681832-A
Country	US
Kind code	B2
Filing date	Apr 8, 2015
Priority date	May 1, 2009
Publication date	Jun 27, 2017
Grant date	Jun 27, 2017

Abstract

Disclosed are technologies are useful in enabling a smart phone to respond to a user's environment, e.g., so it can serve as an intuitive hearing and seeing device. Some of the detailed arrangements involve using radio base station SDR equipment (e.g., at a cell tower) to perform image recognition operations for phones; forecasting service needs from remote processors delegating a remote execution task to a service provider chosen in a competitive process; using nearby processors, e.g., in an automobile, another phone, or set-top box, for remote execution tasks; phones with separable camera and/or illumination components; phone camera illumination using different colors of light; using search tree methods with image frames captured at different focuses; using a phone's microprojector to aid in object identification; correcting lens aberrations by texture mapping captured imagery onto a corrective polygon surface using a phone GPU; etc. A great variety of other features are also detailed.

First claim

I claim:

1. A method of operating a camera-equipped mobile phone, the method comprising the acts:
activating a first LED light source of a first visible light color, for a first interval, while capturing image data from a subject using said mobile phone, the subject having previously been printed with an image conveying a steganographic digital watermark that modulates at least one color channel, but does not modulate all color channels of the image as modulation of image luminance:
activating a second LED light source of a second visible light color different than the first, for a second interval different than the first, while capturing image data from said subject using said mobile phone; and processing the captured image data to extract payload data from said steganographic digital watermark.

2. The method of claim 1 wherein both said activating acts occur during a single frame exposure.

3. The method of claim 1 wherein said activating acts occur during different frame exposures.

4. A non-transitory computer readable medium containing programming instructions that, when executed by a processor of a camera-equipped mobile phone that is also equipped with a first LED light source of a first visible light color, and a second LED light source of a second visible light color, cause the mobile phone to perform acts including:
activating only the first LED light source, for a first interval, while capturing image data from a subject using the camera of said mobile phone;
activating only a second LED light source of a second visible light color different than the first, for a second interval different than the first, while capturing image data from said subject using the camera of said mobile phone; and
processing the captured image data to extract payload data from a steganographic digital watermark conveyed by an image printed on said subject, the steganographic digital watermark modulating at least one color channel of the image, but not modulating all color channels of the image as modulation of image luminance.

5. A mobile phone including the non-transitory computer readable medium of claim 4 , a processor, a camera, and said first and second LED light sources.

6. The method of claim 1 that includes:
activating only said first LED light source for said first interval, while capturing image data from the printed subject using said mobile phone; and
activating only said second LED light source for said second interval different than the first, while capturing image data from said printed subject using said mobile phone.

7. The method of claim 6 that further includes activating both said first and second LED light sources, together, for a third interval.

8. The method of claim 1 that further includes:
sensing temporal variations in ambient illumination; and
controlling timing of one of said activating acts in response to said sensed temporal variations in ambient illumination.

9. The method of claim 1 that further includes:
sensing temporal variations in color of ambient illumination; and
controlling timing of one of said activating acts in response to said sensed temporal variations in color of ambient illumination;
wherein the method activates a blue LED light source to increase illumination of the printed subject with light of a blue color, to counteract orangeness of ambient lighting.

10. The method of claim 1 that further includes:
sensing temporal variations in intensity of ambient illumination; and
controlling timing of one of said activating acts in response to said sensed temporal variations in intensity of ambient illumination.

11. The method of claim 1 that further includes:
sensing temporal variations in ambient illumination;
predicting a future state of said ambient illumination, based on said sensed temporal variations; and
controlling timing of one of said activating acts in response to said predicted future state of said ambient illumination.

12. The method of claim 1 that further includes:
sensing temporal variations in ambient illumination; and
capturing a frame of imagery at a time selected based on said sensed temporal variations.

13. The method of claim 1 that further includes:
sensing temporal variations in color of ambient illumination; and
capturing a frame of imagery at a time selected based on said sensed temporal variations in color.

14. The method of claim 1 that further includes:
sensing temporal variations in intensity of ambient illumination; and
capturing a frame of imagery at a time selected based on said sensed temporal variations in intensity.

15. A smartphone system comprising a wireless transceiver, a microphone, a display, a battery, a processor, and at least first and second LED light sources of first and second visible light colors, respectively, the processor being configured to control the smartphone system to perform acts including:
activate a first LED light source of a first visible light color, for a first interval, while capturing image data with the camera from a subject, the subject having been previously printed with an image conveying a steganographic digital watermark that modulates at least one color channel, but does not modulate all color channels of the image as modulation of image luminance;
activate a second LED light source of a second visible light color different than the first, for a second interval different than the first, while capturing image data with the camera; and
processing the captured image data to extract payload data from said steganographic digital watermark.

16. The smartphone system of claim 15 in which the processor is further configured to control the smartphone system to perform acts including:
activate only said first LED light source for said first interval, while capturing image data; and
activate only said second LED light source for said second interval different than the first, while capturing image data.

17. The smartphone system of claim 15 in which the processor is further configured to control the smartphone system to:
sense temporal variations in of ambient illumination;
predict a future state of said ambient illumination, based on said sensed temporal variations; and
control timing of one of said activating acts in response to said predicted future state of said ambient illumination.

18. The smartphone system of claim 15 in which the processor is further configured to control the smartphone system to perform acts including:
sense temporal variations in ambient illumination; and
control timing of one of said activating acts in response to said sensed temporal variations in ambient illumination.

19. The smartphone system of claim 15 in which the processor is further configured to control the smartphone system to perform acts including:
sense temporal variations in ambient illumination; and
capture a frame of imagery at a time selected based on said sensed temporal variations.

Assignees

• Digimarc Corp

Inventors

• Lord John D

Classifications

• G06V10/945 Primary

  User interactive design; Environments; Toolboxes · CPC title

• H04N23/74

  by influencing the scene brightness using illuminating means · CPC title

• H04N23/56

  provided with illuminating means · CPC title

• G06F18/40

  Software arrangements specially adapted for pattern recognition, e.g. user interfaces or toolboxes therefor · CPC title

• H04N23/10

  for generating image signals from different wavelengths · CPC title