Visual completion

Patent metadata

Field	Value
Publication number	US-8971571-B1
Application number	US-201213421127-A
Country	US
Kind code	B1
Filing date	Mar 15, 2012
Priority date	Jan 6, 2012
Publication date	Mar 3, 2015
Grant date	Mar 3, 2015

Abstract

Methods and devices for initiating, updating, and displaying the results of a search of an object-model database are disclosed. In one embodiment, a method is disclosed that includes receiving video data recorded by a camera on a wearable computing device and, based on the video data, detecting a movement corresponding to a selection of an object. The method further includes, before the movement is complete, initiating a search on the object of an object-model database. The method still further includes, during the movement, periodically updating the search and causing the wearable computing device to overlay the object with object-models from the database corresponding to results of the search.

First claim

The invention claimed is:

1. A method comprising:
receiving video data recorded by a camera on a wearable computing device;
based on the video data, detecting a movement corresponding to a selection of an object;
before the movement is complete, initiating a search on the object of an object-model database; and
during the movement, periodically updating the search and causing the wearable computing device to overlay, on a display, the object with object-models from the database corresponding to results of the search.

2. The method of claim 1 , wherein the object-models comprise at least one of two-dimensional images and three-dimensional models.

3. The method of claim 1 , wherein at least one of the object-models comprises a representation of the object.

4. The method of claim 1 , wherein the object-models are semi-transparent.

5. The method of claim 1 , wherein overlaying the object with each object-model comprises aligning the object-model with the object.

6. The method of claim 5 , wherein aligning the object-model with the object comprises at least one of scaling the object-model and rotating the object-model.

7. The method of claim 1 , further comprising receiving an acceptance of one of the object-models.

8. The method of claim 7 , further comprising causing the wearable computing device to display information associated with the accepted object-model.

9. The method of claim 1 , wherein the movement comprises a movement corresponding to an outline of the object.

10. The method of claim 1 , wherein the movement comprises a movement that occludes the object.

11. The method of claim 1 , wherein the movement comprises one of a rotation of the object and a rotation around the object.

12. A method comprising:
causing a camera on a wearable computing device to record video data of a movement corresponding to a selection of an object;
before the movement is complete, initiating a search on the object of an object-model database; and
during the movement, periodically updating the search and causing the wearable computing device to overlay, on a display, the object with object-models from the database corresponding to results of the search.

13. The method of claim 12 , wherein initiating the search comprises transmitting to a server a request for the search, the request comprising at least a portion of the video data.

14. The method of claim 12 , further comprising displaying the video data on the display.

15. The method of claim 12 , further comprising:
during the movement, causing the wearable computing device to display information associated with each of the object-models.

16. The method of claim 12 , further comprising:
receiving an acceptance of one of the object-models; and
responsively causing the wearable computing device to display information associated with the accepted object-model.

17. The method of claim 12 , further comprising:
during the movement, caching information associated with each of the object-models;
receiving an acceptance of one of the object-models; and
responsively causing the wearable computing device to display the cached information associated with the accepted object-model.

18. A method comprising:
a wearable computing device receiving a selection of an object;
initiating a search on the object of an object-model database; and
updating the search and causing the wearable computing device to overlay, on a display, the object with object-models from the database corresponding to results of the search.

Assignees

• Starner Thad Eugene
• Essa Irfan
• Google Inc

Inventors

• Starner Thad Eugene
• Essa Irfan

Classifications

• G06V20/20 Primary

  in augmented reality scenes · CPC title

• G06V40/28

  Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113) · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06T2210/62

  Semi-transparency · CPC title

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title