Intuitive computing methods and systems

Patent metadata

Field	Value
Publication number	US-9444924-B2
Application number	US-201514642296-A
Country	US
Kind code	B2
Filing date	Mar 9, 2015
Priority date	Oct 28, 2009
Publication date	Sep 13, 2016
Grant date	Sep 13, 2016

Abstract

The present disclosure describes portable devices (e.g., smart phones and tablets), related methods and systems. One claim relates to a portable computing device including a device input for initiating a discovery mode. The discovery mode includes processing camera-captured video imagery or microphone-captured audio to obtain identification of an object depicted in camera-captured video imagery or to obtain identification of microphone-captured audio. The portable computing device operates to initiate a discovery mode including processing real-time video imagery captured with a camera, cause a sensor pane to be displayed on a touch screen display, in which real-time captured video imagery is displayed along with augmented reality graphics within the sensor pane, and cause user-selectable graphic icons to be displayed within a first area of the touch screen display, and cause a user-selectable graphic icon to be displayed on touch screen display to facilitate switching discovery modes from image to audio.

First claim

We claim:

1. A portable tablet computing device comprising:
a wireless communications interface;
a touch screen display;
a camera for capturing video imagery;
a microphone for capturing audio;
a device input for initiating a discovery mode, in which the discovery mode includes processing camera-captured video imagery or microphone-captured audio to obtain identification of an object depicted in camera-captured video imagery or to obtain identification of microphone-captured audio, an identification obtained through the wireless communications interface;
one or more multi-core processors; and
memory storing software instructions for configuring said one or more multi-core processors for:
responsive to a request received via said device input, initiating a discovery mode including processing real-time video imagery captured with said camera;
causing a sensor pane to be displayed on said touch screen display, in which real-time captured video imagery is displayed along with augmented reality graphics within the sensor pane, and causing user-selectable graphic icons to be displayed within a first area of said touch screen display;
causing highlighting of an object represented in captured real-time video imagery that is displayed within the sensor pane; and
causing a user-selectable graphic icon to be displayed on said touch screen display to facilitate switching discovery modes from image to audio.

2. The portable tablet computing device of claim 1 in which the first area overlays the sensor pane, in which said memory stores software instructions for configuring said one or more multi-core processors for touch screen control of a size of the first area displayed on said touch screen display relative to the sensor pane.

3. The portable tablet computing device of claim 1 in which said memory stores software instructions for configuring said one or more multi-core processors for displaying a visual bar via said touch screen display, the visual bar separating the first area from the sensor pane.

4. The portable tablet computing device of claim 1 in which said device input comprises hardwiring to receive a user's indication to initiate a discovery mode.

5. The portable tablet computing device of claim 1 in which said memory stores software instructions for configuring said one or more multi-core processors for: responsive to the request received via said device input, initiating the discovery mode including processing video imagery captured with said camera by communicating data associated with captured video imagery to a remotely located server.

6. The portable tablet computing device of claim 1 in which said memory stores software instructions for configuring said one or more multi-core processors for: responsive to the request received via said device input, initiating the discovery mode including processing video imagery captured with said camera with an edge filtering operation to identify image features.

7. The portable tablet computing device of claim 1 in which said memory stores software instructions for configuring said one or more multi-core processors for: responsive to the request received via said device input, initiating the discovery mode including processing video imagery captured with said camera by generating a greyscale image associated with captured video imagery.

8. The portable tablet computing device of claim 1 in which said memory stores software instructions for configuring said one or more multi-core processors for: responsive to the request received via said device input, initiating the discovery mode including processing imagery by omitting image information.

9. The portable tablet computing device of claim 2 in which the first area comprises a geolocation pane.

10. A portable computing device comprising:
a wireless communications interface;
a touch screen display;
a camera for capturing video imagery;
a microphone for capturing audio;
a device input for initiating a discovery mode, in which the discovery mode includes processing camera-captured video imagery or microphone-captured audio to obtain identification of an object depicted in camera-captured video imagery or to obtain identification of microphone-captured audio, an identification obtained through the wireless communications interface;
means for, responsive to a request received via said device input, initiating a discovery mode including processing real-time video imagery captured with said camera;
means for causing a sensor pane to be displayed on said touch screen display, in which real-time captured video imagery is displayed along with augmented reality graphics within the sensor pane, and causing user-selectable graphic icons to be displayed within a first area of said touch screen display;
means for causing highlighting of an object represented in captured real-time video imagery that is displayed within the sensor pane; and
means for causing a user-selectable graphic icon to be displayed on said touch screen display to facilitate switching discovery modes from image to audio.

11. The portable computing device of claim 10 in which the first area overlays the sensor pane, further comprising means for touch screen control of a size of the first area displayed on said touch screen display relative to the sensor pane.

12. The portable computing device of claim 10 further comprising means for displaying a visual bar via said touch screen display, the visual bar separating the first area from the sensor pane.

13. The portable computing device of claim 10 in which said device input comprises hardwiring to receive a user's indication to initiate a discovery mode.

14. The portable computing device of claim 10 further comprising means for, responsive to the request received via said device input, initiating the discovery mode including processing video imagery captured with said camera by communicating data associated with captured imagery to a remotely located server.

15. The portable computing device of claim 10 further comprising means for, responsive to the request received via said device input, initiating the discovery mode including processing video imagery captured with said camera with an edge filtering operation to identify image features.

16. The portable computing device of claim 10 further comprising means for, responsive to the request received via said device input, initiating the discovery mode including processing video imagery captured with said camera by generating a greyscale image associated with captured video imagery.

17. The portable computing device of claim 10 further comprising means for, responsive to the request received via said device input, initiating the discovery mode including processing imagery by omitting image information.

18. The portable computing device of claim 11 in which the first area comprises a geolocation pane.

19. A computer program product being embodied in non-transitory computer readable storage media and comprising portable computing device executable instructions for:
initiating a discovery mode, in response to a request received via a device input, in which the discovery mode includes processing camera-captured imagery to obtain identification of an object depicted in the camera-captured imagery through a wireless communications interface of the portable computing device;
causing captured imagery including video to be displayed in a first area on a portable computing device touch screen display along with augmented reality graphics;
controlling a user interface to display

Assignees

• Digimarc Corp

Inventors

• Rodriguez Tony F
• Rhoads Geoffrey B

Classifications

• H04W4/02 Primary

  Services making use of location information · CPC title

• H04M1/724

  User interfaces specially adapted for cordless or mobile telephones · CPC title

• H04N23/667

  Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes · CPC title

• H04N23/80

  Camera processing pipelines; Components thereof · CPC title

• G06F18/24

  Classification techniques · CPC title