Object information derived from object images

Patent metadata

Field	Value
Publication number	US-9785651-B2
Application number	US-201615169948-A
Country	US
Kind code	B2
Filing date	Jun 1, 2016
Priority date	Nov 6, 2000
Publication date	Oct 10, 2017
Grant date	Oct 10, 2017

Abstract

Search terms are derived automatically from images captured by a camera equipped cell phone, PDA, or other image capturing device submitted to a search engine to obtain information of interest, and at least a portion of the resulting information is transmitted back locally to, or nearby, the device that captured the image.

First claim

What is claimed is:

1. A computer implemented visual search engine comprising:
a searchable database indexing a collection of data associated with a plurality of known objects, the collection indexed according to a plurality of image-derived keys; and
a network-accessible search server coupled with the searchable database and, upon a processor in the server executing software instructions stored in a non-transitory computer readable memory, configured to:
receive, from a mobile device over a network, image-related data from an image of a query object;
derive a search query associated with the query object and including a first set of image-derived keys derived from the image-related data;
submit the search query to the searchable database;
receive a results set, including an information address associated with at least one known object from the plurality of known objects, from the searchable database; and
transmit at least a portion of the results set back to the mobile device over the network.

2. The engine of claim 1 , wherein the image-related data includes at least one of the following: a single image, multiple images, motion imagery, and video data.

3. The engine of claim 1 , wherein the image-related data includes at least some image-derivable keys.

4. The engine of claim 1 , wherein the image-related data includes salient parameters.

5. The engine of claim 1 , wherein the image-related data includes search terms.

6. The engine of claim 1 , wherein the search query includes attributes of the query object.

7. The engine of claim 6 , wherein the attributes include at least one of the following: a name, a type, a size, a shape, a dimension of relevance, a color, a position, a location, a make, a model, and a time.

8. The engine of claim 1 , wherein the search query and the first set of image-derivable keys are both based on at least one of the following: search terms, keywords, salient parameters, images, sounds, hashes, and know object attributes.

9. The engine of claim 1 , wherein the results set include at least one of the following: a hyperlink, an image, audio data, video data, a translation, spoken information, a web page, streaming data, product information, transaction information, account information, the information address, a code, instructions, and graphics.

10. The engine of claim 1 , wherein the plurality of known objects comprise a propriety collection of records.

11. The engine of claim 1 , wherein the plurality of known objects include at least one of the following: a box, a DVD, a poster, a logo, text, a document, a magazine, an advertisement, a car, a building, a store, a theatre, a machine, a part, a symbol, a newspaper, a product, a vending machine, a television, a person, a face, biometric information, a fingerprint, an iris, a billboard, a street sign, on-screen content, a sign language, a beverage product, printed media, a photograph, a restaurant, a piece of art, a ticket, a barcodes, a matrix code, a computer, a three dimensional object, a product promotion, and a logo.

12. The engine of claim 1 , wherein the plurality of known objects include three dimensional objects that change over time.

13. The engine of claim 12 , wherein the three dimensional objects that change over time include at least one of the following: a gesture, a pattern, an automobile, an animate object, a person's face.

14. The engine of claim 1 , wherein the at least the portion of the results set is transmitted back to the mobile device in real-time.

15. The engine of claim 14 , wherein the at least the portion of the result set enables interactivity with a machine.

16. The engine of claim 1 , wherein the network-accessible search server is further configured to generate the at least the portion of the result set by tailoring the result set to accommodate the mobile device.

17. The engine of claim 1 , wherein the information address includes at least one of the following: a URL, a URI, a hyperlink, a network address, an IP address, a telephone number, a radio channel, a television channel, and a physical location.

18. The engine of claim 1 , wherein the at least the portion of the results set comprises sorted results.

19. The engine of claim 18 , wherein the sorted results are determined based on a metric distance.

20. The engine of claim 1 , wherein the searchable database comprises multiple databases partitioned across multiple processors.

Assignees

• Nant Holdings Ip Llc

Inventors

• Boncyk Wayne C
• Cohen Ronald H

Classifications

• G06F2218/08

  Feature extraction · CPC title

• G06F18/25

  Fusion techniques · CPC title

• H04N23/80

  Camera processing pipelines; Components thereof · CPC title

• G06Q30/0261

  based on user location · CPC title

• G06Q30/0601

  Electronic shopping [e-shopping] · CPC title